Testlio vs. UserTesting

Testlio is well-suited to work with us due to its flexibility and scalability, which align perfectly with the dynamic needs of a growing technology firm. Testlio's global network of professional testers provides the breadth and depth of testing expertise necessary to cover the array of technologies and platforms used by us. Additionally, this combination of Testlio's flexible testing solutions and our need for cost-effective, comprehensive QA support makes Testlio an ideal partner for ensuring a high standard of software quality.

Incentivized

Well suited to its original purpose- usability testing and interviews. This can be performed at pace, given the large audience (although our brands are very well known so this should not be a barrier) and there is a decent level of task customisation when conducting unmoderated testing. Its less appropriate for survey where you are looking to capture genuine intent/behaviour, even with screeners the data skews more positively than onsite survey, makes me question the quality of survey respondents.

Incentivized

• Westin and Sidhi were proactive in preparing for test runs
• Westin was quick to reschedule calls, provide constant updates on our progress, and helped us get rollover hours
• Sidhi ensured testing was thorough with her commitment to creating high-quality test scripts with screenshots and details information

• Product Manager who follows up on your UserTesting usage and gives advice/support when you need it.
• UserTesting University is a great platform to learn how to use UT and general information about research.
• UserTesting can find participants quickly, so you won't need to wait long before you can start the analysis.

Incentivized

• Sometimes testers don't put correct information in bugs.

• Quality of participant pool - many are career testers, and many are untruthful. Since sessions are auto-scheduled if the screener is past, you often don't know until they've completed the test. Allow double screening or be more stringent in removing users from the platform.
• Unfinished products - focus on making one product the best it can be before moving on to a new one. Unmoderated testing is still missing features (randomization of 3 or more prototypes, etc.)

Incentivized

I'm very happy with my experience of the product and the level of service and learning resources they provide. If the service becomes more expensive than it currently is then we might not be able to justify additional cost - but this is theoretical. I would recommend UserTesting and would ideally renew our contract.

Incentivized

It can be difficult to organize our tests and go back and find information. I think the AI tools are helping and will help with this, but for now it is time consuming to sort through all of the tests and information and then synthesize it and share it with others. It just takes a lot of time.

Incentivized

Never encountered any problems

Incentivized

Perfectly fine. Never had any problems.

Incentivized

I have contacted UserTesting's customer service online, by email, or by phone a few times, and each time, I have encountered the same professionalism and expertise. Even in person during a work event, they were there, and it was the same experience.

Incentivized

From a technical perspective, the implementation was extremely smooth. Most of the change management / implementation hurdles were clearing use of the tool through our various security, legal, and information privacy teams. Once these concerns were addressed (UserTesting.com was very helpful in providing all the needed documentation), the implementation process was very simple and we were able to get going right away.

Incentivized

When comparing Testlio against other vendors, several key factors set it apart and made it the preferred choice for us. Testlio's singular focus on testing services we thought would include a depth of expertise and quality that generalist dev shops can't match. Secondly, Testlio's flexible engagement models stood out significantly. Unlike other vendors that might offer more rigid, one-size-fits-all solutions, Testlio provides customizable testing services that can be scaled up or down based on project needs.

Incentivized

The quality of the participants: they usually have good feedback and act like "professional" users. Which is good when we want a few insights in a short amount of time. Also, the interface is good. I miss having more features, like a good transcription tool like we have in Condens

Incentivized

The package we have limits the number of people who can set up tests. This prevents us from scaling the use of the platform.

Incentivized

• Making sure we don't have a "buggy" website helps legitimize our company and build our reputation as a contender in the web3 space

• Content is key to the sign up journey and UserTesting helps me improve that.
• UserTesting has helped me improve the Cashier on our site, making it easier for users to deposit money.
• UserTesting is helping me iterate all our content decisions, helping us improve the UX across all platforms.

Incentivized