AWS Device Farm vs. QAComplete

As long as you have the right scenarios in mind where you can use AWS Device Farm, you will be very happy. It's a cloud platform for testing automation support, where you can use real devices in multiple configs to validate your Android or iOS use cases. It does easily integrate with your CI pipeline, but reporting and UI are not perfect. A pain point is also the JUnit4 implementation, which could be more mature.

Incentivized

Very well suited to requirements management, test suite creation and defect management. Not suited to project/task management.

Incentivized

• Easy testing on many different devices
• Great integration with development workflow
• Customizable selection of testing framework

Incentivized

• Allows us to create individual tests then group them into comprehensive test plans.
• Allows me to specify custom fields that match our product features to categorize both tests and defects.
• Allows me to create a series of requirements then match tests against them for validation.

Incentivized

• Interface (CLI) not very easy. Competition has better options.
• Integration with IDE for test case coding.
• Reporting for the test scripts executed.

Incentivized

• The user interface can be somewhat perplexing and difficult to navigate at times.
• Naming conventions aren't always succinct and additional training is needed by those who have more experience using the program.
• A modern refresh of the UI would help keep the product from looking dated.

Incentivized

I gave QAComplete this rating because though I do feel that it is a powerful tool, it's definitely not designed for the everyday user. Obviously the target demographic is QA specialists who should be team members that are very technical and methodical in their approaches. However, for the rest of the team, it can often time prove difficult to navigate. Also, the UI is in need of a serious refresh.

Incentivized

We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.

Incentivized

I have not had to work with their customer service directly yet. Our client has been utilizing this tool for years, so I would assume that the support they have received would be good enough to keep them wanting to continue to use the product.

Incentivized

We haven't used anything like AWS Device Farm before. I am familiar with Amazon Web Services and when we had our MVP ready to test, we turned to AWS for a solution. AWS Device Farm was exactly what we were looking for as we have a really small team and limit resources.

Incentivized

We had used FogBugz and Freshdesk for quite some time. I hadn't been exposed to QAComplete until recently during a project with one of our clients, but we are already starting to see the superior benefits of this product. Once you wrap your head around the interface and navigate to the bug reports, it becomes a very powerful tool.

Incentivized

• It impact more and more. Not in terms of ROI but in time as well

Incentivized

• From our side, it's been very easy to pick up on bugs reported by our clients. It's a great ROI for the cost as they are fairly minimal in comparison to other QA software.
• I think a negative impact can be the administration of QA items. It definitely feels a bit bogged down.
• My last negative would be that I don't believe it syncs in any way with the Atlassian software suite. I could be wrong on this but manual entry from system to system can be daunting at times.

Incentivized