Testlio vs. UserTesting

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
Testlio
Score 9.7 out of 10
N/A
Testlio offers "fused software testing." The approach leverages a proprietary software testing platform, partnerships and integrations with DevOps leaders, and a global services delivery team in 150+ countries.N/A
UserTesting
Score 8.0 out of 10
N/A
UserTesting helps UX researchers, designers, product teams, and marketers gather actionable insights through research, testing, and feedback. With a network of real people ready to share their perspectives, UserTesting enables organizations to make customer-first decisions at scale.N/A
Pricing
TestlioUserTesting
Editions & Modules
No answers on this topic
No answers on this topic
Offerings
Pricing Offerings
TestlioUserTesting
Free Trial
NoYes
Free/Freemium Version
NoNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeOptionalNo setup fee
Additional Details
More Pricing Information
Community Pulse
TestlioUserTesting
Best Alternatives
TestlioUserTesting
Small Businesses

No answers on this topic

Smartlook
Smartlook
Score 8.2 out of 10
Medium-sized Companies

No answers on this topic

Optimal
Optimal
Score 9.0 out of 10
Enterprises

No answers on this topic

Optimal
Optimal
Score 9.0 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
TestlioUserTesting
Likelihood to Recommend
9.6
(0 ratings)
8.1
(0 ratings)
Likelihood to Renew
-
(0 ratings)
8.2
(0 ratings)
Usability
-
(0 ratings)
8.1
(0 ratings)
Availability
-
(0 ratings)
9.1
(0 ratings)
Performance
-
(0 ratings)
9.1
(0 ratings)
Support Rating
-
(0 ratings)
8.3
(0 ratings)
Implementation Rating
-
(0 ratings)
4.6
(0 ratings)
Configurability
-
(0 ratings)
7.3
(0 ratings)
Product Scalability
-
(0 ratings)
7.3
(0 ratings)
Vendor post-sale
-
(0 ratings)
9.1
(0 ratings)
Vendor pre-sale
-
(0 ratings)
9.1
(0 ratings)
User Testimonials
TestlioUserTesting
Likelihood to Recommend
We use Testlio to outsource all of our testing needs for all feature releases on our streaming product across all the major platforms such as Fire TV, Apple TV, Roku, iOS and Android mobile, and Samsung TV. The Testlio platform is great but what's even more valuable is the team that runs it. Their customer success teams and test leads have all been a real pleasure to work with. They've been very helpful and valuable by customizing their testing process and approach to fit our business needs at our company. Because they have been so flexible with their process, our testing component have been very quick, accurate and successful. I would recommend this product/company to anyone looking to hire a dedicated QA team to their software product.
Read full review
When working with general market customers. For example, a person between the ages of 30 and 60 who has a checking account and a mortgage with their primary bank, as long as they don't get too specific about a particular bank.
Read full review
Pros
  • Westin and Sidhi were proactive in preparing for test runs
  • Westin was quick to reschedule calls, provide constant updates on our progress, and helped us get rollover hours
  • Sidhi ensured testing was thorough with her commitment to creating high-quality test scripts with screenshots and details information
Read full review
  • Product Manager who follows up on your UserTesting usage and gives advice/support when you need it.
  • UserTesting University is a great platform to learn how to use UT and general information about research.
  • UserTesting can find participants quickly, so you won't need to wait long before you can start the analysis.
Read full review
Cons
  • Sometimes testers don't put correct information in bugs.
Read full review
  • A centralized platform to recommend products and use cases would be handy so that users can suggest what they could use more of.
  • Integration with newer payment methods and gift card services could expand the user base.
  • Some products are business-critical and thus require sophisticated testing. This service could be added.
Read full review
Likelihood to Renew
No answers on this topic
I'm actually trying to get a license for my current job at my current company (recently moved to a new company). I gave it this rating because I am about to go to our executive to ask that we purchase it! I know that there will be value because we are forecasting a high volume of research next year
Read full review
Usability
No answers on this topic
It can be difficult to organize our tests and go back and find information. I think the AI tools are helping and will help with this, but for now it is time consuming to sort through all of the tests and information and then synthesize it and share it with others. It just takes a lot of time.
Read full review
Reliability and Availability
No answers on this topic
Never encountered any problems
Read full review
Performance
No answers on this topic
Perfectly fine. Never had any problems.
Read full review
Support Rating
No answers on this topic
I've used the "power hour," as I think it's called. This really helped me gain a greater understanding of my specific needs and wants from the platform. This excellent service points to the excellent relationship UserTesting provides its clients. I would recommend this service to any of my colleagues.
Read full review
Implementation Rating
No answers on this topic
From a technical perspective, the implementation was extremely smooth. Most of the change management / implementation hurdles were clearing use of the tool through our various security, legal, and information privacy teams. Once these concerns were addressed (UserTesting.com was very helpful in providing all the needed documentation), the implementation process was very simple and we were able to get going right away.
Read full review
Alternatives Considered
When comparing Testlio against other vendors, several key factors set it apart and made it the preferred choice for us. Testlio's singular focus on testing services we thought would include a depth of expertise and quality that generalist dev shops can't match. Secondly, Testlio's flexible engagement models stood out significantly. Unlike other vendors that might offer more rigid, one-size-fits-all solutions, Testlio provides customizable testing services that can be scaled up or down based on project needs.
Read full review
UserTesting is probably the most polished with the largest tester pool, fastest turnaround, and great tools for both moderated and unmoderated tests. Userlytics is a solid alternative, especially for the budget-conscious. It supports usability testing on lots of devices, and you can do both moderated and unmoderated sessions. The UI isn’t as seamless as UserTesting’s, but it gets the job done and it's pretty flexible in terms of study setup and participant targeting.
Trymata is the most basic, but it’s relatively straightforward and affordable. You still get session recordings and written responses, but lacks dashboard polish or advanced features. It’s great for smaller teams or one-off tests.
Read full review
Scalability
No answers on this topic
The package we have limits the number of people who can set up tests. This prevents us from scaling the use of the platform.
Read full review
Return on Investment
  • Making sure we don't have a "buggy" website helps legitimize our company and build our reputation as a contender in the web3 space
Read full review
  • We can build tests and gather the insights from those tests to validate our products at a breakneck pace.
  • By quickly validating our assumptions, we can adjust or refine our designs to ensure the final results are more user-focused.
  • Recently, by testing and comparing two different flows for a form, we were able to create the right solution that gave us better leads compared to the former form. This results in better leads, better data about the user, and better support at the end for this user.
Read full review
ScreenShots

UserTesting Screenshots

Screenshot of UserTesting's several solutions for gathering rich customer experience narratives.Screenshot of Interactive Path Flows
Built on recent research in data mining, the Interactive Path Flow aggregates interaction data across multiple participant sessions to visualize the customer journey, surface unexpected behaviors, and locate key moments in the customer journey.Screenshot of Keyword Mapping
Similar keywords are automatically grouped based on overall sentiment (positive, negative, or neutral) to identify themes. Highlight reels associated with each keyword are grouped together, to discover the why behind each sentiment.Screenshot of Video capture and live streaming
Digital and real-world customer experiences are recorded on desktop and mobile devices or live streamed for in-platform viewing.Screenshot of Audience targeting
Audiences are specified by screening contributors from UserTesting’s global network of contributors or connecting to any preferred network.