Google Content Experiments (discontinued) vs. Webtrends Optimize

Google Content Experiments is suited for large and small organizations, no matter your organizational goals. It is not recommended for organizations that are only interested in qualitative data, as there are other tools for receiving specific user experience feedback. It is also not recommended that you implement tests without some sort of goal in mind.

Incentivized

There are certainly a few things to consider. If you're looking to run A/B/n or Multivariate tests with some basic segmentation or targeting then Webtrends Optimize is capable of providing that. If budget is a major consideration then that is another area where Optimize may be more attractive. However, based on both of these criteria it is my opinion that there are other tools out there that provide more value. For segmentation discovery, identification of user affinities, and execution of an effective targeting and personalization strategy then there are certainly other tools that should be considered.

• When you need to measure against event-based goals
• If you need to see how the test variations performed against secondary goals
• Given that the the platform requires you actually code a new page with a unique URL, this tool can be good for radical redesigns.
• Great insights into other information about your testing groups, like whether or not they're mobile, screen size, browser, or really any dimension available in GA.

• The Webtrends team are excellent at taking the time to understand and learn about our distinct business needs, and recommend suggestions in response.
• The Webtrends platform has undergone several changes over the time I was using it. This illustrates the constant thrive to improve their service to users, something I greatly appreciated.
• Webtrends Optimize enables the whole process to be simple with its handy instructional guides that can inform clients about using the service.

• You can only optimise for one goal, so if you have several conversions, like phone call and email you need to do it manually.
• It seems not to work that well for pages with lower amounts of traffic - not great for new or niche sites.

Incentivized

• The cost is a factor. When you're trying to save money, particularly as a startup (a lot of our clients are up-and-comers) it has to be seen as an investment...but the cost to implement the system is fairly large.
• There's a bit of a steep learning curve, you can't just dive into the program.
• It's not impossible but it's not as easy as snapping your fingers to easily implement the program cross-platform.

Incentivized

Content Experiments just makes it is simple and easy to implement A|B tests. We will be evaluating other tools in search of a more robust system for multivariate and cross-page testing, such as Optimizely or Visual Website Optimizer. However, for basic testing, you can't really beat it.

Difficulty was getting business units to take the time and spend the money to test, and then implement, best options.

Set up of basic tests that do not use segmentation or targeting is an intuitive experience that can be learned quickly by new users. However, as the need for segmentation and other more advanced capabilities arise, the experience begins to degrade.

zero complaints. I'm not aware of it ever failing.

Zero complaints. It seemed to do its job quickly and accurately.

Using the free tool, overall "live support" is limited. However, there are plenty of online resources to get started. If you need handheld support, it is best to upgrade the service or hire a developer through one of Google's partner agencies. There could be more support for understanding what makes a test useful or not.

Incentivized

The support from the team at Webtrends Optimize is unparalleled. There is always someone to consult should there be any issues.

Online training was ok. Because every test is a custom test, there's only so much that can be covered in a generic lesson.

Implementation was pretty straightforward

Google Website Optimizer was a better product but has been discontinued. We have also used Test and Target , which has more features but we have been doing fine with Google Content Experiments. Most testing situations can be handled with Google Content Experiments.

Incentivized

Webtrends Optimize is one of the best solutions out there for digital marketers to improve their sales by providing a better experience for their customers' journey. With that said, it is also a costly solution in comparison to other services in the market today. The adage of you gets what you pay for is true as they are a market leader in the optimization space.

Incentivized

• Doing good experiments/Optimize has helped to take out the guesswork of the things we want to implement.
• We have done fairly complex changes such as changing navigation and managed to see improvements outcomes immediately before we have to request developer.
• Our teams have become more data centric in how they approach changes.

Incentivized

• So far we haven't seen an ROI that we can accurately measure due to only running a couple of tests that haven't resulted in direct, site wide changes. However, we have learnt a lot about how to set up the right processes and documentation.