Lucky Orange vs. Optimizely Web Experimentation

Lucky Orange is one of the few players in the marketplace to provide real-time, live heatmaps along with navigation interactions, including at the secondary and tertiary levels. The Lucky Orange dashboard provides basic user behavioral metrics, and the user recordings allow you to get deeper insights into user behavior beyond the heatmap overlays. Also, the addition of real-time polling and chat capabilities enable you to engage with your users while they are on-page and push/promote special offers and promos, as well as survey website visitors about their experience.

Incentivized

I think it can serve the whole spectrum of experiences from people who are just getting used to web experimentation. It's really easy to pick up and use. If you're more experienced then it works well because it just gets out of the way and lets you really focus on the experimentation side of things. So yeah, strongly recommend. I think it is well suited both to small businesses and large enterprises as well. I think it's got a really low barrier to entry. It's very easy to integrate on your website and get results quickly. Likewise, if you are a big business, it's incrementally adoptable, so you can start out with one component of optimizing and you can build there and start to build in things like data CMS to augment experimentation as well. So it's got a really strong a pathway to grow your MarTech platform if you're a small company or a big company.

Incentivized

• Session recordings provide detailed playbacks of how people are using your website
• Heatmaps work well and display what people are clicking on over a range of screen sizes.
• Pricing makes this a great entry point to understand a range of tools that you can use to understand your customers better.
• Integrates well with other tools, from GA to Adobe Analytics to Optimizely.

Incentivized

• The Platform contains drag-and-drop editor options for creating variations, which ease the A/B tests process, as it does not require any coding or development resources.
• Establishing it is so simple that even a non-technical person can do it perfectly.
• It provides real-time results and analytics with robust dashboard access through which you can quickly analyze how different variations perform. With this, your team can easily make data-driven decisions Fastly.

Incentivized

• Deletes older data that we sometimes like to go back and reference. It would be nice to access an archive.
• Sometimes we get too many recordings that are very similar to one another. Would be nice to have a filter to reduce similar recordings.

Incentivized

• The results view is dense and difficult to package easily for leadership, and when filtering by segment it's hard to read comparative outcomes without clearing or swapping filters
• The organization of experiments and statuses is a cluttered list and the search is limited in use - would love to see that improve with time
• There are so many other MarTech products out there, would love to see more dedicated integrations so we don't have to invest in something like Zapier or Tray to build hacky automations

Incentivized

The pricing options for large business are very lacking. The value of Lucky Orange doesn't really increase after your first 50,000 page visits but the service is on a sliding scale so the more traffic you have the more they charge. In addition, we got lots of useful information out of lucky orange in the beginning but after a while we knew what things needed to be fixed and are waiting on our developers to create the AB tests.

Incentivized

Because it's an incredible and essential tool for my line of work as a conversion optimization specialist. Really couldn't do my job nearly as effectively without it. It's paid for itself many times over and I feel like I'm only beginning to unlock the tools potential.

Optimizely Web Experimentation's visual editor is handy for non-technical or quick iterative testing. When it comes to content changes it's as easy as going into wordpress, clicking around, and then seeing your changes live--what you see is what you get. The preview and approval process for sharing built experiments is also handy for sharing experiments across teams for QA purposes or otherwise.

Incentivized

I would rate Optimizely Web Experimentation's availability as a 10 out of 10. The software is reliable and does not experience any application errors or unplanned outages. Additionally, the customer service and technical support teams are always available to help with any issues or questions.

Incentivized

I would rate Optimizely Web Experimentation's performance as a 9 out of 10. Pages load quickly, reports are complete in a reasonable time frame, and the software does not slow down any other software or systems that it integrates with. Additionally, the customer service and technical support teams are always available to help with any issues or questions.

Incentivized

Good, timely responses from knowledgeable support team members.

Incentivized

They always are quick to respond, and are so friendly and helpful. They always answer the phone right away. And [they are] always willing to not only help you with your problem, but if you need ideas they have suggestions as well.

The tool itself is not very difficult to use so training was not very useful in my opinion. It did not also account for success events more complex than a click (which my company being ecommerce is looking to examine more than a mere click).

The implementation through the tag management system took a bit of trial and error at first, mostly due to the asynchronous nature of the TMS. We had to manipulate the implementation to assure that the Optimizely code was written to the page at the right time to allow the experiment content load in the browser without showing any of the original content first. We also needed to make some adjustments to the TMS code to get the integration with Site Catalyst timed appropriately.

Lucky Orange and Hotjar are pretty similar in a lot of ways. One element that Lucky Orange definitely leads in is pricing. Much better and easily justified price points. Ultimately, it comes down to whether or not a new client has already had experience with one or the other and whether they're willing to switch to Lucky Orange if they're not already using it, based upon price.

Incentivized

The ability to do A/B testing in Optimizely along with the associated statistical modelling and audience segmentation means it is a much better solution than using something like Google Analytics were a lot more effort is required to identify and isolate the specific data you need to confidently make changes

Incentivized

It's incredibly flexible and adapts well to organizations of all sizes, whether you’re running a single site or managing multiple departments and platforms. The ability to deploy experiments seamlessly across different environments is a huge plus, especially for growing businesses. While it’s highly scalable, the last point would depend on the right team leveraging its full potential.

Incentivized

• It is hard to quantify into numbers how much their app helps us, but we know that each customer that we are able to help with the live view feature is much more likely to convert had we not been able to help them.
• Having a live chat on its own is useful and we see an average increase of 30% in conversions when our live chat is active.

Incentivized

• we saved money by not implementing certain copy/design
• we learned that customers from different states react different to a variation
• we are slowly learning where conversion happens and where to fix the frictions
• Testing shorter vs longer journeys increased funnel conversion in some states - we avoided implementing this nationwide

Incentivized