TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    AB Tasty

    Score8.8 out of 10
    Mid-Size Companies (51-1,000 employees)
    AB Tasty is a SAAS application created for e-marketers that enables them to optimize their website and conversion rate without technical knowledge. They can test several versions of their pages to identify which one has the biggest impact on their business objectives, e.g. click-through rate on a call to action button, add-to-cart rate, global conversion rate of their website.N/A

    Optimizely Web Experimentation

    Score8.7 out of 10
    N/AWhether launching a first test or scaling a sophisticated experimentation program, Optimizely Web Experimentation aims to deliver the insights needed to craft high-performing digital experiences that drive engagement, increase conversions, and accelerate growth.N/A
    Pricing
    AB TastyOptimizely Web Experimentation
    Editions & Modules
    No answers on this topic
    No answers on this topic
    Offerings
    Pricing Offerings
    AB TastyOptimizely Web Experimentation
    Free Trial
    NoYes
    Free/Freemium Version
    NoNo
    Premium Consulting/Integration Services
    NoYes
    Entry-level Setup FeeNo setup feeOptional
    Additional Details
    More Pricing Information
    Community Pulse
    AB TastyOptimizely Web Experimentation
    Considered Both Products
    AB Tasty
    Chose AB Tasty
    AB Tasty is the king when it comes to cost/benefit. It is not the cheapest but not the most expensive. It is a very advanced tool and we like the fact of not having to pay extra fees for more advanced features that we may only use for one test. Also, the chat support …
    Incentivized
    Chose AB Tasty
    The product roadmap is interesting. Support is quite professional. Features are very useful.
    Incentivized
    Chose AB Tasty
    AB Tasty is great, probably the best optimizing tool you can use. Easy, loads of features, great support from CSM. Great variation editor whereas Monetate and VWO don't have a lot of features/widgets. Optimizely is good but again not a lot of capability without a dev. Whereas …
    Incentivized
    Chose AB Tasty
    AB Tasty has very aggressive pricing and a simple-to-use toolset. We feel that AB Tasty gives us what we need and the other vendors don't provide additional value to justify the cost.
    Incentivized
    Chose AB Tasty
    We selected AB Tasty mostly because we got a sense that their dev and customer service teams were going to go above and beyond to help us out. We were right! The cost was also a factor as they came in a small bit lower, but cost wasn't the only factor.
    Incentivized
    Chose AB Tasty
    AB Tasty is far more affordable than most of them, but with the same functionality and better reporting (reporting looks similar to Optimizely). Monetate requires an agency or a dedicated CRO team to manage and run tests, and is best for large companies with a lot of traffic …
    Incentivized
    Chose AB Tasty
    We selected AB Tasty over other leading A/B Testing platforms due to its huge list of features, dedicated account support and competitive licensing model.
    Incentivized
    Chose AB Tasty
    It's a different tool - and could probably borrow some of the UI and ease of use from the other tools, but excels in providing prebuilt functionality and more detailed targeting. It also needs a lot more learning - when the other tools are pretty much pick up and go.
    Incentivized
    Chose AB Tasty
    We benchmarked AB Tasty vs. Kameleoon and Optimizely - the clear 3 leaders for me at the time I made the survey. Optimizely was and is still too expensive compared to the other two.

    We then tested AB Tasty against Kameleoon with the acquisition team for 8 weeks. I was using Kame…
    Incentivized
    Chose AB Tasty
    About Google Analytics, Google Tag Manager and Hotjar, they are not the same product but we use them in our CRO strategy and we continue using them to complete AB Tasty capacities. Optimizely is a direct competitor and we worked with it for two years, it is a good tool too, but …
    Incentivized
    Chose AB Tasty
    We used Webtrends Optimize before AB Tasty. We needed to change because, with Webtrends, you had to be a developer to use it. It was in 2015, I think Webtrends can now be used by non-technical users. In 2015, we made a request for proposals and AB Tasty was the most affordable …
    Incentivized
    Chose AB Tasty
    AB Tasty compared to Optimizely has a better GUI, support including code development is included, updates are made monthly.
    Incentivized
    Chose AB Tasty
    AB testing tool are all converging. Be focused on price and roadmap.
    Optimizely
    Chose Optimizely Web Experimentation
    I do not have any issues with AB Tasty. They are great. We went with Optimizely because they have several other products that will work together with our business model. Optimizely has grown and it now offers many other products that work with experimentation like CMS, CMP, ODP …
    Incentivized
    Chose Optimizely Web Experimentation
    we used Optimizely Web Experimentation then AB Tasty but came back to Optimizley because of its robust stat sig and features as well as all of the products we will be able to work in synchronization.
    Incentivized
    Chose Optimizely Web Experimentation
    Optimizely Web Experimentation appeared to be much more user friendly and easier to self-manage than AB Tasty
    Incentivized
    Chose Optimizely Web Experimentation
    > Adobe's pretty cool for its recomentation / AI / ML engine > VWO's wysiwyg is pretty solid and the heatmapping is nice > abtasty's consent features are pretty cool to launch patch and AB Test Consent Rate > Monetate & Dynamic Yield's pre-built personalization features help …
    Incentivized
    Chose Optimizely Web Experimentation
    Optimizely is my favorite due to its ease of use and exceptional testing capabilities. It is not the cheapest tool, but the other tools that could be compared are not cheap—you get what you pay for. Some of the smaller tools are making gains, though!
    Incentivized
    Chose Optimizely Web Experimentation
    Optimizely has the best combination of all the best features of all the personalization platforms I've ever evaluated or used on a regular basis.
    Incentivized
    Chose Optimizely Web Experimentation
    Optimizely Web Experimentation is perfect for medium or advance use but not for basic use. For basic use or new users VWO would be a better fit, or for users who would do a test once per month with low traffic. Optimizely is more for users or companies who use cro or do …
    Incentivized
    Chose Optimizely Web Experimentation
    Analytics are vastly superior, platform UI is by far the easiest to use, and capabilities are best in class. If your organization has any budget for a web experimentation tool, it should be using Optimizely Web Experimentation.
    Incentivized
    Chose Optimizely Web Experimentation
    More complex
    Incentivized
    Chose Optimizely Web Experimentation
    Optimizely has a more robust toolset and is also more affordable.
    Incentivized
    Chose Optimizely Web Experimentation
    Better documentation releases new features and a better UI experience.
    Incentivized
    Chose Optimizely Web Experimentation
    Optimizely has better customer service if you need to talk to a person and a great library of documentation if you run into issues and want to troubleshoot yourself. Web Experimentation has allowed for our testing capabilities to grow as our research program develops. …
    Incentivized
    Chose Optimizely Web Experimentation
    Better UI, more integrated with our enterprise
    Incentivized
    Key User Insights
    Would buy again
    100%
    Would buy again
    5 Answers
    94%
    Would buy again
    75 Answers
    Delivers good value for the price
    100%
    Delivers good value for the price
    5 Answers
    95%
    Delivers good value for the price
    62 Answers
    Happy with the feature set
    100%
    Happy with the feature set
    5 Answers
    94%
    Happy with the feature set
    75 Answers
    Lived up to sales and marketing promises
    No answers on this topic
    90%
    Lived up to sales and marketing promises
    45 Answers
    Implementation went as expected
    100%
    Implementation went as expected
    5 Answers
    86%
    Implementation went as expected
    51 Answers
    TrustRadius Insights
    AB TastyOptimizely Web Experimentation
    Highlights

    TrustRadius
    Research Team Insight
    Published

    Optimizely and AB Tasty are both A/B testing tools designed to help businesses to test the performance of different versions of web content. Both A/B testing tools are used by businesses of all sizes, though Optimizely is more popular with larger enterprises while A/B Tasty is used more often by smaller to mid-sized businesses.

    Features

    Optimizely and AB Tasty both include essential A/B testing features such as split testing and test scheduling, but they also each have standout features that set them apart from each other.

    Optimizely includes funnel analysis features that allow businesses to see the steps users go through to reach a certain page or complete a certain event. This feature is useful when determining where users are dropping off in processes like registration. Optimizely also includes easy to use visual editor features that allow users to quickly create multiple versions of pages using HTML, CSS, and JavaScript.

    AB Tasty includes built-in heatmaps that allow businesses to see what parts of pages users interact with most often and what areas aren’t being used. Heatmaps help businesses see what features are getting the most attention and if any important features are not being noticed by users. Additionally, AB Tasty includes surveys businesses can use to directly ask users questions about the page they are using. AB Tasty also includes a widget library developers can use to make simple changes to a page without writing code.

    Limitations

    Though Optimizely and AB Tasty both offer robust feature sets, they also have a few limitations that are important to consider.

    Optimizely doesn’t have built-in Heatmaps, so it can be difficult to see what elements of a page users are interacting with most often. Optimizely does include an integration with Hotjar, but for businesses looking for a complete package, heatmaps aren’t available. Additionally, Optimizely doesn’t include surveys, so it can be more difficult to receive direct feedback from users compared to AB Tasty.

    AB Tasty doesn’t include features for funnel analysis. As a result, when testing processes such as user registration, or product purchases it can be tricky to see where users drop off without additional analytics tools. AB Tasty’s visual editor is also not as robust as Optimizely’s which is a more complete development tool.

    Pricing

    Both AB Tasty and Optimizely do not list complete pricing information, though quotes are available from their sales team. Optimizely includes three pricing tiers for businesses, including a cheaper “essentials” package, and a more feature-complete “enterprise” package. AB Tasty is priced depending on the business in question.

    Features
    AB TastyOptimizely Web Experimentation
    Testing and Experimentation
    Comparison of Testing and Experimentation features of AB Tasty and Optimizely Web Experimentation
    Feature
    AB Tasty
    8.1
    22 Ratings
    1% below category average
    Optimizely Web Experimentation
    8.0
    150 Ratings
    3% below category average
    a/b experiment testing8.122 Ratings9.0150 Ratings
    Split URL testing7.215 Ratings8.5122 Ratings
    Multivariate testing8.119 Ratings8.4127 Ratings
    Multi-page/funnel testing9.016 Ratings7.9116 Ratings
    Mobile app testing5.05 Ratings8.066 Ratings
    Test significance8.22 Ratings8.4136 Ratings
    Visual / WYSIWYG editor10.018 Ratings8.2121 Ratings
    Advanced code editor8.28 Ratings8.0114 Ratings
    Page surveys5.03 Ratings6.217 Ratings
    Preview mode7.69 Ratings7.6133 Ratings
    Test duration calculator10.02 Ratings7.9101 Ratings
    Experiment scheduler9.16 Ratings8.2101 Ratings
    Client-side tests9.99 Ratings7.888 Ratings
    Server-side tests7.01 Ratings7.244 Ratings
    Mutually exclusive tests9.14 Ratings8.274 Ratings
    Cross-browser testing00 Ratings8.186 Ratings
    Visitor recordings00 Ratings8.418 Ratings
    Experiment workflow and approval00 Ratings7.881 Ratings
    Dynamic experiment activation00 Ratings7.565 Ratings
    Audience Segmentation & Targeting
    Comparison of Audience Segmentation & Targeting features of AB Tasty and Optimizely Web Experimentation
    Feature
    AB Tasty
    8.5
    21 Ratings
    0% below category average
    Optimizely Web Experimentation
    8.2
    142 Ratings
    4% below category average
    Standard visitor segmentation9.120 Ratings8.4137 Ratings
    Behavioral visitor segmentation7.418 Ratings7.6113 Ratings
    Traffic allocation control9.121 Ratings9.1135 Ratings
    Website personalization8.219 Ratings7.8103 Ratings
    Results and Analysis
    Comparison of Results and Analysis features of AB Tasty and Optimizely Web Experimentation
    Feature
    AB Tasty
    8.2
    22 Ratings
    2% below category average
    Optimizely Web Experimentation
    8.3
    138 Ratings
    1% below category average
    Heatmap tool7.38 Ratings9.313 Ratings
    Click analytics7.616 Ratings8.833 Ratings
    Scroll maps8.58 Ratings8.517 Ratings
    Conversion tracking8.121 Ratings8.744 Ratings
    Goal tracking9.021 Ratings8.2117 Ratings
    Test reporting8.222 Ratings7.9126 Ratings
    Results segmentation8.019 Ratings7.793 Ratings
    Experiments results dashboard9.19 Ratings8.049 Ratings
    Form fill analysis00 Ratings8.065 Ratings
    CSV export00 Ratings7.992 Ratings
    User Ratings
    AB TastyOptimizely Web Experimentation
    Likelihood to Recommend
    9.0
    (53 ratings)
    8.7
    (238 ratings)
    Likelihood to Renew
    7.7
    (8 ratings)
    9.5
    (51 ratings)
    Usability
    9.0
    (1 ratings)
    10.0
    (58 ratings)
    Availability
    -
    (0 ratings)
    10.0
    (7 ratings)
    Performance
    -
    (0 ratings)
    7.3
    (6 ratings)
    Support Rating
    7.3
    (2 ratings)
    10.0
    (16 ratings)
    Online Training
    -
    (0 ratings)
    3.0
    (1 ratings)
    Implementation Rating
    -
    (0 ratings)
    8.0
    (11 ratings)
    Configurability
    -
    (0 ratings)
    6.0
    (1 ratings)
    Product Scalability
    -
    (0 ratings)
    8.0
    (148 ratings)
    User Testimonials
    AB TastyOptimizely Web Experimentation
    Likelihood to Recommend
    AB Tasty
    A/B Tasty tool allows us do easy testing without burdening our limited developer resources all the time. Reports are simple enough to interpret. Support has been excellent and proactive, also the onboarding was successful. It is also an advantage that we have the possibility to drive all our traffic to the test versions rather than being limited to specific user amount per month. We can recommend A/B Tasty for testing purposes, as the platform keeps it’s promises, doesn’t require too much technical knowledge and the support is excellent.
    Incentivized
    Read full review
    Optimizely
    No answers on this topic
    Pros
    AB Tasty
    • Customer-focused. Over the past year, AB Tasty has worked with us to overcome many obstacles (e.g. tracking hurdles, ITP issues, etc.). The team always finds a solution in a timely manner to ensure we're able to execute on experiments.
    • Reliability. One of the biggest hurdles earlier this year were the ITP regulations set out by Apple. Over 40% of our ad traffic was Safari users. AB Tasty was using 3rd party cookies but quickly migrated over to a local session storage solution that circumvented the issue.
    Incentivized
    Read full review
    Optimizely
    • The Platform contains drag-and-drop editor options for creating variations, which ease the A/B tests process, as it does not require any coding or development resources.
    • Establishing it is so simple that even a non-technical person can do it perfectly.
    • It provides real-time results and analytics with robust dashboard access through which you can quickly analyze how different variations perform. With this, your team can easily make data-driven decisions Fastly.
    Incentivized
    Read full review
    Cons
    AB Tasty
    No answers on this topic
    Optimizely
    No answers on this topic
    Likelihood to Renew
    AB Tasty
    No answers on this topic
    Optimizely
    I rated this question because at this stage, Optimizely does most everything we need so I don't foresee a need to migrate to a new tool. We have the infrastructure already in place and it is a sizeable lift to pivot to another tool with no guarantee that it will work as good or even better than Optimizely
    Incentivized
    Read full review
    Usability
    AB Tasty
    No answers on this topic
    Optimizely
    Optimizely Web Experimentation's visual editor is handy for non-technical or quick iterative testing. When it comes to content changes it's as easy as going into wordpress, clicking around, and then seeing your changes live--what you see is what you get. The preview and approval process for sharing built experiments is also handy for sharing experiments across teams for QA purposes or otherwise.
    Incentivized
    Read full review
    Reliability and Availability
    AB Tasty
    No answers on this topic
    Optimizely
    I would rate Optimizely Web Experimentation's availability as a 10 out of 10. The software is reliable and does not experience any application errors or unplanned outages. Additionally, the customer service and technical support teams are always available to help with any issues or questions.
    Incentivized
    Read full review
    Performance
    AB Tasty
    No answers on this topic
    Optimizely
    I would rate Optimizely Web Experimentation's performance as a 9 out of 10. Pages load quickly, reports are complete in a reasonable time frame, and the software does not slow down any other software or systems that it integrates with. Additionally, the customer service and technical support teams are always available to help with any issues or questions.
    Incentivized
    Read full review
    Support Rating
    AB Tasty
    Support is good, but it would be better if it was quicker or if AB Tasty provided a quicker SLA. At times, you require stuff urgently but AB Tasty support isn't as quick as I personally like it to be.
    Incentivized
    Read full review
    Optimizely
    They always are quick to respond, and are so friendly and helpful. They always answer the phone right away. And [they are] always willing to not only help you with your problem, but if you need ideas they have suggestions as well.
    Read full review
    Online Training
    AB Tasty
    No answers on this topic
    Optimizely
    No answers on this topic
    Implementation Rating
    AB Tasty
    No answers on this topic
    Optimizely
    No answers on this topic
    Alternatives Considered
    AB Tasty
    We selected AB Tasty mostly because we got a sense that their dev and customer service teams were going to go above and beyond to help us out. We were right! The cost was also a factor as they came in a small bit lower, but cost wasn't the only factor.
    Incentivized
    Read full review
    Optimizely
    No answers on this topic
    Scalability
    AB Tasty
    No answers on this topic
    Optimizely
    No answers on this topic
    Return on Investment
    AB Tasty
    • Since we use AB tasty our conversion rates have significantly increased on the Watch pages.
    • We can report positive comments about the evolutions of our interfaces, from our expert users. And so improved customer satisfaction.
    • The solution allows us to validate or invalidate without taking major risk while gaining in reactivity, our proposals relook pages.
    • Commitment rates are much higher, multiplied by 2 or 3, when we implement customizations that are relevant. These customizations are very relevant insofar as we are governed by the seasonality of events as a media site.
    Read full review
    Optimizely
    No answers on this topic
    ScreenShots

    AB Tasty Screenshots

    Screenshot of the reporting interface.Screenshot of the dynamic widget library.Screenshot of AB Tasty's WYSIWYG editorScreenshot of the campaign management dashboardScreenshot of targeting criteria, available so users can target specific user segments

    Optimizely Web Experimentation Screenshots

    Screenshot of AI-Powered Experimentation with Opal:

- Instant Test Ideas: Generates high-quality A/B test ideas based on any goals and audience insights.
- Smarter Experimentation: The AI can suggest impactful variations, reducing guesswork and increasing test velocity.
- More Than Just Ideas: From hypothesis generation to analyzing results, Opal helps optimize every stage of the experimentation process.Screenshot of the Web Experimentation Visual Editor :

- Tweak experiments using the visual editor or dive into custom code when needed.
- Modify elements, update styling, or add dynamic behaviors.
- Ensure perfect variations while keeping control over every detail of the experiment.Screenshot of AI Content Suggestions:

- Generates copy variations to supercharge experiments.
- The AI suggests high-impact messaging for tests when hovering over a field.
- AI-powered content suggestions help skip the brainstorming process.Screenshot of Advanced Audience Targeting:

- Delivers personalized experiences by targeting users based on behaviors, attributes, and real-time conditions.
- Defines precise audience segments using first-party data, geolocation, and device type.
- Can test and optimize for different audience groups to maximize impact and engagement.Screenshot of Custom Templates in the Visual Editor:

- Offers pre-built templates for common test setups.
- Standardized variations and maintains brand integrity with reusable templates.
- Templates can be customized visually or tweak them with code for full flexibility.Screenshot of the Web Experimentation Results Page:

- Data visualizations help interpret experiment performance.
- Displays which variations are winning with built-in statistical significance calculations.
- Results can be filtered by audience segments, events, and conversions to uncover key trends.