AWS Device Farm is a mobile application performance testing application that provides real-time automated testing and reproduction of issues, simulating and testing issues that may occur on a variety of platforms (e.g. iPhone or Samsung mobile device, or multiple operations systems, etc).
$0.01
per instance minute
Perforce ALM
Score 8.3 out of 10
N/A
Helix ALM (formerly TestTrack) is an application performance testing and application requirements management suite.
As long as you have the right scenarios in mind where you can use AWS Device Farm, you will be very happy. It's a cloud platform for testing automation support, where you can use real devices in multiple configs to validate your Android or iOS use cases. It does easily integrate with your CI pipeline, but reporting and UI are not perfect. A pain point is also the JUnit4 implementation, which could be more mature.
Helix ALM is very well suited for maintaining traceability between user needs, requirements and tests for medical device design controls. It allows users to customize the reports to create a traceability matrix or any other reports that are needed. It is also a good program for tracking issues and bugs and for storing/linking verification and validation test protocols and reports.
We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.
The support from Perforce has been extensive and allowed us to customize the setup of Helix ALM specific to our needs. They also hosted training sessions for our users and administrators and provided us with troubleshooting help during initial setup.
We haven't used anything like AWS Device Farm before. I am familiar with Amazon Web Services and when we had our MVP ready to test, we turned to AWS for a solution. AWS Device Farm was exactly what we were looking for as we have a really small team and limit resources.
The other tools that we evaluated did not have all of the capabilities and customization that Helix ALM had to offer and therefore we decided to select Helix ALM.
