TrustRadius: an HG Insights company

QA Wolf

Score9.1 out of 10

8 Reviews and Ratings

What is QA Wolf?

QA Wolf provides managed QA assurance and testing services for startups and other industries. QA Wolf is a hybrid platform and service that helps software teams ship better software faster by taking QA completely off their plate.

Categories & Use Cases

QA Wolf really understands automated testing!

Use Cases and Deployment Scope

QA Wolf provides automated testing as a service, both in a platform and in a team that works closely with our business to solve our testing needs. We have a variety of complex test cases that QA Wolf has been able to support and maintain to relieve our team from having to resource and build ourselves. These tests are fully integrated into the CI/CD pipeline and release process, ensuring a high level of quality and preventing regressions. QA Wolf makes it simple to get additional test cases built out and they work very autonomously to get things done without any nudging.

Pros

  • QA Wolf builds reliable tests and maintains them even when we slightly change the behavior of the product.
  • QA Wolf understands our business and product and goes the extra mile to improve the quality of the tests that they write.
  • The QA Wolf team is always positive and solutions oriented, working closely with us to make sure our business needs are achieved.

Cons

  • QA Wolf could provide a better feedback loop for when tests are completed in order for us to have even higher confidence they are built and working as intended.
  • QA Wolf could do a better job of ensuring that failing test cases are resolved in a timeline manner.

Return on Investment

  • QA Wolf saves us from having to build a QA automation team. We implemented QA Wolf early so our team never needed to build a motion around automated regression testing outside of QA Wolf.
  • QA Wolf is capable enough to figure out how our product works without much guidance, so when delivering test cases, we're able to send a video of the behavior without much training, and they're able to build the test cases with very little additional guidance.

Usability

Other Software Used

Slack, Linear App, Notion

We have been blown away by the performance of the QA Wolf team

Use Cases and Deployment Scope

We use QA Wolf for automated end to end (E2) testing.

Regressions errors are a huge problem in software delivery and E2E testing addresses a lot of concerns in this area.

We had several problems implementing E2E testing. It is not a core competency of our existing engineering staff so writing tests was often a slow process. Once we had a test built, running the tests could take a long time, causing an engineer to either have to wait a long period to see if the tests pass, or context switching when they receive an alert that tests failed. To make the tests run faster would require significant investment in infrastructure and an ongoing hosting cost.

QA Wolf addresses all of the above concerns in a cost- and time-efficient manner.

Pros

  • Eliminates the need to have and manage in-house QA Engineers
  • Handles all the infrastructure for testing
  • Runs tests in parallel so Engineers get fast feedback on whether they have introduced a regression error.
  • Reduce costs associated with E2E testing
  • Amazing customer service
  • Excellent integration with our existing workflows

Cons

  • Costs are coming down everywhere in the automation space as AI takes on more jobs. I'd like to see QA Wolf costs scale down as they automate more processes.

Return on Investment

  • Our Engineers deliver with more confidence and that has had a positive impact on feature throughput.
  • QA wolf has a large team of QA Engineers and they can easily handle a surge of new coverage requests, where an in house resource would be flooded and cause a bottleneck.
  • We continue to focus our in-house engineering efforts on product improvements rather than diluting our delivery-first culture with a QA mindset.

Usability

Alternatives Considered

ProdPerfect and MuukTest

QA Wolf provides peace of mind upon software releases and updates :)

Use Cases and Deployment Scope

Automated test coverage and regression testing. We frequently release code changes to our software, so having automated regression testing is extremely helpful for us to revert changes before it gets to clients. QA Wolf also helps us around automated test coverage for new features. It is nearly impossible to manually QA everything in our platform, and QA Wolf helps us release new features with higher confidence.

Pros

  • Identifying bugs in our software before clients do.
  • Provides an easy way to monitor our test coverage, and reported bugs every week.
  • Customer support is extremely responsive and nice to work with.
  • Their team is very capable of adapting to complex software.
  • Integrates well with our apps such as Slack and JIRA.

Cons

  • I think their bug reporting in the app is great, but the JIRA integration doesn't always include the level of detail that their app does. Having those two match would be great.
  • Some functions in their app when re-organizing tests.

Return on Investment

  • Preventing mission-critical bugs resulted in less client frustration and thus less client churn.
  • QA Wolf has allowed us to be true to our mantra of being an innovative platform with high confidence.

Usability

The decision to use QA Wolf was an amazing choice

Use Cases and Deployment Scope

QA wolf is used by our company for Automated Testing and Bug tracking. It helps us by saving us the overhead cost of having to create our own automation platform for QA as well as the cost of maintaining our own QA team. QA Wolf platform and the helpful staff will do their best to make it work for you and your business' needs.

Pros

  • Creates new tests as requested fairly quickly.
  • Listening and available at all times.
  • Automated testing and the ease of creating tests on their platform with 0 coding experience.

Cons

  • Test creations could be more automated but mankind would need something like AI to solve for it. Give QA wolf a few years and we should get there.
  • Tests have to be super specific sometimes.
  • Bug found can cause the tests to be paused. Recommend tracking associated bug tickets on Jira and resuming the tests when the bug is resolved.

Return on Investment

  • Lower cost of QA team.
  • Being able to maintain 3 actively developed systems with a lean team.
  • Better ROI.

Usability

Alternatives Considered

SoftwareTesting.AI

The most cost effective QA you’ll ever have

Use Cases and Deployment Scope

We use QA Wolf to get our end-to-end tests written quickly and easily. These tests help us ensure that new and existing features continue to work as we expect without breaking current functionality or introducing regressions/new bugs. This allows us to iterate and deploy quickly and confidently so our engineers can focus on code instead of tests.

Pros

  • Writing tests
  • Hosting test infrastrucure
  • Identifying new bugs
  • Integrating with existing development pipelines

Cons

  • Some more advanced integrations with existing products
  • Ability to scope issues to specific projects/products

Return on Investment

  • We're still too young to be able to evaluate an ROI

Usability

Other Software Used

Linear App, Vercel, React