Coveo Qubit vs. Kameleoon

Coveo Qubit is a very helpful platform mainly for organizations that need to provide a solid business model before carrying out any implementation or new functionality. In addition, it is a very good tool to generate changes and show different content to different types of clients, with their personalization and segmentation criteria.It is ideal for simultaneous testing and customization, only one of these activities individually is not recommended.

Incentivized

• We can easily create A/B tests and personalizations to target specific audiences and improve the customer journey
• The widget editor is intuitive and very easy to use, a lot of features are available without any code
• The result analysis dashboard is easy to read and understand : we have very detailed data to analyze the performance of our experiments, even on pages with low traffic thanks to the CUPED algorithm.
• We strongly recommend Kameleoon !

• The testing platform itself is continually evolving. This means that we are always able to try new ideas as well as quickly and efficiently put others into practice.
• The beta programme and the additional functionality products are both exciting to see as well as ensuring we can cherry pick the functionality we need. This means that we don't end up paying for functionality we don't need

Incentivized

• The segment builder is incredibly intuitive and easy to use. Works wonderfully with Mixpanel. Our team managed to set up our segments and experiments within a couple of hours.
• Great customer service and willingness to help with any of our questions.
• Very secure testing environment for our A/B testing experiments. We had a staging environment easily set up for review and testing before live deployment. We needed a HIPAA compliant solution, and Kameleoon delivers.

• Some of the reporting within Qubit has been overly simplified in the past, a point they are continually addressing.
• At times the syntax of experience (test) creation can be specific to Qubit and so there is a slight learning curve for developers.
• Unless developers have much time to allocate to creating tests in Qubit, marketers may potentially find simple tests limited. I would recommend having someone in-house as we do.

Incentivized

• Interface of the graphics editor is quite conceptual. It is fine after a few days but it takes a little while to recognize some icons.
• Their online tutorial could also be easily improved.
• If you want to do major graphical changes on your website, you will have to inject JS and CSS code which requires some technical background but I don’t know if that point can be improved.

Qubit helps out immensely and lays out in plain English the profitability of each of our A-B tests. Say Qubit has provided us overall with a 5% profit increase this year (that is a completely arbitrary figure for illustration only), then if we didn't renew it could be seen as us taking a 5% loss as Qubit wouldn't be there. The results of our tests are showing no slowing down and as Qubit and Toast grow to understand each other better we can only see our performance getting better as the years go on.

already renewed :)

Overall navigation on Qubit is very user friendly and requires a minimal training to be up and running. Be it reviewing existing experiences or setting up new experiences, the process is pretty simple for business user. Add some basic development skills to your kitty, you can do magic with Qubit and make your website do wonders!

Incentivized

Kameleoon offers one of the best UI's I've seen when I've compared it to 4 of the other big competitors in the landscape. They have some improvement areas when it comes to the UX - Which is easily solvable if/when prioritized. There's a little to much "clicking" and "new tabs" in my opinion

I would say that the Qubit account managers are always available for any request. We have a lot of different promotions that could always do with last minute optimizing or changes and Qubit can be relied on to get this changes up and running in an impressive amount of time, so that we don't need to patch live or wait for the next IT sprint. Invaluable to our business.

Technology is good for A/B testing and personalisation - allowing any team with a dedicated developer to create test relatively easily and to report/analyse them in a fair amount of details. Some advanced features, especially on the set up of test cells, are dearly missing. Unfortunately, new features are often not free of bugs... Also, support is sub-par, which means new features are realised without proper documentation, example or training (but of our Qubit counterparts and internally).

Incentivized

Qubit are supportive and flexible in providing support. They are happy working out of usual hours, even on weekends and if I have any doubts about the set up of an experience they’re quick to respond and willing to check my work. On particularly big revenue days they monitor our account and they’re quick to identify and problem solve any issues.

Incentivized

Our Kameleoon team is also very dedicated to us. We have weekly meetings to review our project roadmap and the results of our ongoing campaigns. Kameleoon’s team is very supportive and ambitious for every project. The responsiveness of the teams is also very helpful and reassuring when there are up and downs (as happens in every relationship).

The training was great, but would be great to have a script or PDF with some explanations of the qubit JS layer. Without the script you can just try to learn on your own, so the training is not as powerfull as it could be. On the other hand - would be great to have training related to reading statistics or personalisation.

Incentivized

Implementation couldn't be easier. All we needed to do was insert the tag. (easy) and set up the data layer. (dev required) This was pretty smooth in comparison to some of the other tools we use on our site, and was done in less than a day. Note : Data needs to be collected for a set period of time before you can accurately rely on the data that you are receiving. This is normal though with everyone else that we have used

Incentivized

We're using Qubit as a fully managed testing platform, and their account management and level of service we've received from any other contact (technical, support, sales etc) was above any of their competitors. Integration and on-boarding was well done and we feel confident that the campaigns are developed and tested thoroughly.

Incentivized

The agency that helped create our new Headless website recommended Kameleoon and Growth book on top of the stalwart Optimizely. Our final round of POC was between Optimizely and Kameleoon, and the thing that pushed Kameleoon ahead was the size of their snippet and how easy it was to set up the Segment integration out of the box to do what we needed it to do. Although Kameleoon is relatively "new" to the North American market, they have continued to perform above and beyond our expectations.

Incentivized

Our requirements change throughout the year like most E Commerce retailers. At Christmas and Peak we're dealing with around ten times the usual traffic on the site. Qubit had no problems with this at all, tests continued to fire, and stats were still reported accurately. I don't think that it is the most server intensive .js anyway, but we have seen no issues at all.

Incentivized

• Faster recognition of customer needs - finding out exactly what customers are doing when they come on site.
• Assessment of online assets for effectiveness and improvements - facilitated the analysis of 500 online feedback questionnaires for a campaign.
• Mapping out lead conversion and helping identify opportunities to improve it.

• The platform allows us to test and learn different functionalities.
• We run multiple feature experiments at different levels of the customer journey (search, login, and checkout) to improve efficiency and our conversion rate.
• We are also able to boost our fidelity program to the right audience thanks to AI.
• And obviously, optimize the user experience continuously.