Features
Top Performing Features
a/b experiment testing
Create and test variations of a website, changing site elements such as headlines, CTAs, images, page design and layout, technical SEO changes, and new feature additions and collect statistical results of each variation’s conversion rates or other metrics.
Category average: 8.6
Split URL testing
Test out larger design changes by splitting your site traffic across two different landing pages to identify which site performs the best. It can be used to test the impact and feasibility of things such as new designs, personalization efforts, and new site architecture.
Category average: 8.2
Visual / WYSIWYG editor
Set up A/B testing campaigns using a WYSIWYG editor to create site versions and preview design changes before testing them. These editors often don’t require coding knowledge in order to operate them.
Category average: 7.4
Advanced code editor
Allows users to create and edit experiments with HTML, CSS, JS.
Category average: 7.2
Testing and Experimentation
These features enable companies to plan, set up, and execute different types of tests (e.g. A/B, A/B/n, multivariate, split URL tests).
a/b experiment testing
Create and test variations of a website, changing site elements such as headlines, CTAs, images, page design and layout, technical SEO changes, and new feature additions and collect statistical results of each variation’s conversion rates or other metrics.
Category average: 8.6
Split URL testing
Test out larger design changes by splitting your site traffic across two different landing pages to identify which site performs the best. It can be used to test the impact and feasibility of things such as new designs, personalization efforts, and new site architecture.
Category average: 8.2
Test significance
Ability to set the statistical significance level, or confidence interval, of a given test, for example at the 90% or 95% level.
Category average: 7.3
Visual / WYSIWYG editor
Set up A/B testing campaigns using a WYSIWYG editor to create site versions and preview design changes before testing them. These editors often don’t require coding knowledge in order to operate them.
Category average: 7.4
Advanced code editor
Allows users to create and edit experiments with HTML, CSS, JS.
Category average: 7.2
Preview mode
Preview your experiment before running it live on your site or app.
Category average: 7
Test duration calculator
Automatic calculation of the estimated test duration needed to gain statistically significant results.
Category average: 7.4
Audience Segmentation & Targeting
A set of tools used for website optimization experiments (e.g. A/B, A/B/n, funnel, split URL, multivariate tests) that can help users segment their audience in to different groups for the purpose of exposing specific audiences to tests or personalization efforts.
Standard visitor segmentation
Ability to segment, or target audiences based on criteria you set (e.g. URL, cookies, IP address, custom javascript, traffic source, device, browser, language, ad campaign, geo-targeting, time of day) and enable tests to run for specific visitor segments.
Category average: 7.8
Website personalization
Ability to optimize user experience for individual site visitors based on certain characteristics and past actions (e.g. past purchases, geolocation, demographics, device type, referral source, etc..). An example of this is product and/or content recommendations based on visitor characteristics.
Category average: 8.2
Results and Analysis
Tools that allow users to evaluate the results of website optimization tests (e.g. A/B, A/B/n, multivariate, and split URL tests), or view visitor interaction with webpages and specific site elements.
Goal tracking
Enables users to set up key website/mobile performance metrics on their landing pages and track them.
Category average: 7.5
Test reporting
Provides users with reports for each test that record the performance of each variation tested against selected metrics such as conversion rate. These reports indicate when a given test variation has performed statistically better than the original (control) site version.
Category average: 7.4
Experiments results dashboard
Provides users with a dashboard displaying test results for all live tests. Some products may also include test result histories accessible from the dashboard.
Category average: 6.5