Coveo Qubit vs. Webtrends Optimize

Coveo Qubit is a very helpful platform mainly for organizations that need to provide a solid business model before carrying out any implementation or new functionality. In addition, it is a very good tool to generate changes and show different content to different types of clients, with their personalization and segmentation criteria.It is ideal for simultaneous testing and customization, only one of these activities individually is not recommended.

Incentivized

There are certainly a few things to consider. If you're looking to run A/B/n or Multivariate tests with some basic segmentation or targeting then Webtrends Optimize is capable of providing that. If budget is a major consideration then that is another area where Optimize may be more attractive. However, based on both of these criteria it is my opinion that there are other tools out there that provide more value. For segmentation discovery, identification of user affinities, and execution of an effective targeting and personalization strategy then there are certainly other tools that should be considered.

• The testing platform itself is continually evolving. This means that we are always able to try new ideas as well as quickly and efficiently put others into practice.
• The beta programme and the additional functionality products are both exciting to see as well as ensuring we can cherry pick the functionality we need. This means that we don't end up paying for functionality we don't need

Incentivized

• The Webtrends team are excellent at taking the time to understand and learn about our distinct business needs, and recommend suggestions in response.
• The Webtrends platform has undergone several changes over the time I was using it. This illustrates the constant thrive to improve their service to users, something I greatly appreciated.
• Webtrends Optimize enables the whole process to be simple with its handy instructional guides that can inform clients about using the service.

• Some of the reporting within Qubit has been overly simplified in the past, a point they are continually addressing.
• At times the syntax of experience (test) creation can be specific to Qubit and so there is a slight learning curve for developers.
• Unless developers have much time to allocate to creating tests in Qubit, marketers may potentially find simple tests limited. I would recommend having someone in-house as we do.

Incentivized

• The cost is a factor. When you're trying to save money, particularly as a startup (a lot of our clients are up-and-comers) it has to be seen as an investment...but the cost to implement the system is fairly large.
• There's a bit of a steep learning curve, you can't just dive into the program.
• It's not impossible but it's not as easy as snapping your fingers to easily implement the program cross-platform.

Incentivized

Qubit helps out immensely and lays out in plain English the profitability of each of our A-B tests. Say Qubit has provided us overall with a 5% profit increase this year (that is a completely arbitrary figure for illustration only), then if we didn't renew it could be seen as us taking a 5% loss as Qubit wouldn't be there. The results of our tests are showing no slowing down and as Qubit and Toast grow to understand each other better we can only see our performance getting better as the years go on.

Difficulty was getting business units to take the time and spend the money to test, and then implement, best options.

Overall navigation on Qubit is very user friendly and requires a minimal training to be up and running. Be it reviewing existing experiences or setting up new experiences, the process is pretty simple for business user. Add some basic development skills to your kitty, you can do magic with Qubit and make your website do wonders!

Incentivized

Set up of basic tests that do not use segmentation or targeting is an intuitive experience that can be learned quickly by new users. However, as the need for segmentation and other more advanced capabilities arise, the experience begins to degrade.

I would say that the Qubit account managers are always available for any request. We have a lot of different promotions that could always do with last minute optimizing or changes and Qubit can be relied on to get this changes up and running in an impressive amount of time, so that we don't need to patch live or wait for the next IT sprint. Invaluable to our business.

zero complaints. I'm not aware of it ever failing.

Technology is good for A/B testing and personalisation - allowing any team with a dedicated developer to create test relatively easily and to report/analyse them in a fair amount of details. Some advanced features, especially on the set up of test cells, are dearly missing. Unfortunately, new features are often not free of bugs... Also, support is sub-par, which means new features are realised without proper documentation, example or training (but of our Qubit counterparts and internally).

Incentivized

Zero complaints. It seemed to do its job quickly and accurately.

Qubit are supportive and flexible in providing support. They are happy working out of usual hours, even on weekends and if I have any doubts about the set up of an experience they’re quick to respond and willing to check my work. On particularly big revenue days they monitor our account and they’re quick to identify and problem solve any issues.

Incentivized

The support from the team at Webtrends Optimize is unparalleled. There is always someone to consult should there be any issues.

The training was great, but would be great to have a script or PDF with some explanations of the qubit JS layer. Without the script you can just try to learn on your own, so the training is not as powerfull as it could be. On the other hand - would be great to have training related to reading statistics or personalisation.

Incentivized

Online training was ok. Because every test is a custom test, there's only so much that can be covered in a generic lesson.

Implementation couldn't be easier. All we needed to do was insert the tag. (easy) and set up the data layer. (dev required) This was pretty smooth in comparison to some of the other tools we use on our site, and was done in less than a day. Note : Data needs to be collected for a set period of time before you can accurately rely on the data that you are receiving. This is normal though with everyone else that we have used

Incentivized

Implementation was pretty straightforward

We're using Qubit as a fully managed testing platform, and their account management and level of service we've received from any other contact (technical, support, sales etc) was above any of their competitors. Integration and on-boarding was well done and we feel confident that the campaigns are developed and tested thoroughly.

Incentivized

Webtrends Optimize is one of the best solutions out there for digital marketers to improve their sales by providing a better experience for their customers' journey. With that said, it is also a costly solution in comparison to other services in the market today. The adage of you gets what you pay for is true as they are a market leader in the optimization space.

Incentivized

Our requirements change throughout the year like most E Commerce retailers. At Christmas and Peak we're dealing with around ten times the usual traffic on the site. Qubit had no problems with this at all, tests continued to fire, and stats were still reported accurately. I don't think that it is the most server intensive .js anyway, but we have seen no issues at all.

Incentivized

• Faster recognition of customer needs - finding out exactly what customers are doing when they come on site.
• Assessment of online assets for effectiveness and improvements - facilitated the analysis of 500 online feedback questionnaires for a campaign.
• Mapping out lead conversion and helping identify opportunities to improve it.

• So far we haven't seen an ROI that we can accurately measure due to only running a couple of tests that haven't resulted in direct, site wide changes. However, we have learnt a lot about how to set up the right processes and documentation.