This is part 1 of a 3 part series detailing the major updates we are releasing to Kapiche over the next couple of weeks. In this part, we will discuss our move to concepts over topics.

Part 2 will cover the UI changes and part 3 will discuss two exciting new features that many of our current customers have been waiting for; Dashboards and Advanced Query!

The world of text analytics can be a complicated place at times. We made a very conscious decision at the beginning to avoid as much complication as we could, and have tried to remove as much complication from our tool as possible in order to bridge the gap and simplify the experience for those new to text analytics. But what we have found is that our users have different thresholds for ‘complicated. So, for various reasons (the most important being feedback from our customers obviously!) we’ve decided to step back from that a little bit in our biggest update and return more power to our users.

More power over language model

Historically, Kapiche wasn’t able to take much input from users on the unstructured insights identified. Our machine learning algorithms would build a language model for you and gave you very limited control over that model. This didn’t sit well with our users, particularly the more advanced users. By talking to our customers, we learned that different people want to report at different semantic granularities. The only way to enable this was to give our users more power to modify the language model built by Kapiche and more control over how you report out of the tool.

Concepts now replace topics

With our next release, besides the very obvious UI improvements (which we will cover in part 2), you will notice another big change: concepts have replaced topics.

For those who have not yet used the tool (get a demo here), in the existing product, topics are one or more important terms (called concepts) joined together. A kind of higher order semantic construct that was used throughout the rest of the product as the basic unit of reporting. A user’s ability to edit these topics was very limited, and they didn’t get fine grained control over the topics - they were at the mercy of the Kapiche algorithms. This is changing.

GPS + Sat Nav = Location Services

From now on, the basic unit of reporting is a concept. This, coupled with a much more powerful query interface gives you a lot more power over the language model. Want to track mentions of GPS and Sat Nav and call it Location Services? That’s now doable in Kapiche. We still provide the functionality to group concepts into higher order semantic constructs (whether they be topics or themes), but we give you fine grained control over the language model if you need it.

To prevent things getting overwhelming, we’ve also added a concept slider, so you can control which concepts are displayed by default.

One of the main advantages we have seen from returning the power to users is that we have been able to relax our criteria for adding concepts to the language model. As a result, Kapiche now finds approximately 25% more concepts by default.

So what does all of this mean for users?

As a Kapiche user, you now have a lot more power over what the tool automatically discovers, allowing you to report out in a way that fits best with your business objectives.

You no longer need to adjust your mental model of what your customers are saying to fit in with what Kapiche has identified. Instead, you can take the understanding you have of your customers, refine it, and report on it with Kapiche in a way that resonates best with your business. You now have a lot more control!