AWS Device Farm is a mobile application performance testing application that provides real-time automated testing and reproduction of issues, simulating and testing issues that may occur on a variety of platforms (e.g. iPhone or Samsung mobile device, or multiple operations systems, etc).
$0.01
per instance minute
BrowserStack
Score 8.6 out of 10
N/A
BrowserStack is a test platform built for developers and QAs to expand test coverage, scale and optimize testing with cross-browser, real device cloud, accessibility, visual testing, test management, and test observability. BrowserStack states it currently powers over a billion tests a year for customers who include Amazon, Paypal, Well Fargo Bank, Nvidia, MongoDB, Pfizer, GE, Discovery, React JS, Apache, JQuery and several others rely on BrowserStack to test their web and mobile apps.
$0
per month Unlimited users and 5000 free screenshots
Pricing
AWS Device Farm
BrowserStack
Editions & Modules
Pay as You Go - Desktop Browsers
$0.005
per instance minute
Pay-As-You-Go
$0.17
per device minute
Private Devices
$200.00
per month
Unlimited Testing
$250.00
per month
Percy - Free
$0
per month Unlimited users and 5000 free screenshots
App Percy - Free
$0
per month 5000 free screenshots and 100 minutes of infrastructure
As long as you have the right scenarios in mind where you can use AWS Device Farm, you will be very happy. It's a cloud platform for testing automation support, where you can use real devices in multiple configs to validate your Android or iOS use cases. It does easily integrate with your CI pipeline, but reporting and UI are not perfect. A pain point is also the JUnit4 implementation, which could be more mature.
Multiple real devices available for testing across different OS, platform and browsers for both website and mobile application testing. Automate help to integrate existing project and testing suite to run across different devices. This reduce testing timeline and allow us to quickly release new features to users. Also provide automated accessibility report.
UI testing on different Devices like iOS, Android, MacOS, and Windows OS.
Automation testing with the help of Cypress gives automation access to different OS and devices.
Comparison with two devices how UI will look a like.
Bug Capture tool: Using this tool, a user can capture a bug while live recording it, and the tool captures action as well. This helps developers identify and fix the bug more easily.
I wish it didn't time out so quickly. I often move back and forth between my native Mac OS system and browsers to BrowserStack for Windows browsers and it often times out so I have to start over.
I am not sure why, but when I've been testing in BrowserStack for a long period of time - maybe over a couple of hours, it sometimes gets buggy and unresponsive or slow to respond. It makes it hard to tell if I'm experiencing an issue with the site I'm testing or if it's an issue with BrowserStack.
If I'm wishing for the moon and stars, I'd ask for the ability to use BrowserStack to also test with JAWS screen reader. But I'm happy having NVDA.
It's simply a must-have tool. As a designer, I have to ensure my work is at least functional in older browsers. I also have to ensure that, when I design for mobile devices, any differences between platforms aren't problematic. BrowserStack allows me to test my work in a fraction of the time, with a whole lot more accuracy.
It integrates directly in internal networks and local development. The point and click interface of choosing your device, pick the browser/version and you have a working emulation of that exact environment. What else could you ask for? I've set our least computer savvy users up with BrowserStack for testing in minutes. It feels like it's just part of your local environemnt.
I rated BrowserStack's availability a 10 because it is consistently reliable, with minimal to no downtime or unplanned outages. The platform is accessible whenever needed, ensuring uninterrupted testing. Its robust infrastructure and proactive monitoring ensure a seamless experience, allowing us to meet deadlines without delays caused by availability issues and all
The tests are fast considering the fact that they're Appium tests. I've seen tests reliably pass or fail when they're supposed to, with next to zero issues on the BrowserStack side of things. Tests launch only seconds after I kick off them off from my CLI.
We had the enterprise support with AWS, so overall support experience was good with great engineers on the back providing answers. As you may know, overall AWS support is different and this is not different. Responses through the regular web support channel came easily, fast and accurate. We had questions/issues which were solved fast. Documentation is good as well, especially around the test automation pieces.
I'm saying a 10 for support for BrowserStack only based on feedback from the development team. I myself have never had to reach out to support for any questions or issues, but others in the company have. From my conversations with them, the support was fantastic and had been a pleasure working with the BrowserStack team.
Yes, it was online training on meet, and trainer looks like skilled and technical strong, he has covered end to end all the features and he has answers all the queries. because of this trainings we are able to implement it by our own in the organization, thank you for support and training.
It was a quick training from the support of browserstack, it was nice and easy to understand, thanks again for the support given by the team. and regularly I used to receive mails for training from support for any new feature they launch, I was able to spread same training to all my team and dev.
I rated the implementation satisfaction an 8 because while it went smoothly overall, there were some challenges during the initial learning phase and integration with existing tools. Key insights include the importance of providing sufficient training upfront and ensuring seamless integration with other systems to minimize disruptions and improve adoption speed.
We haven't used anything like AWS Device Farm before. I am familiar with Amazon Web Services and when we had our MVP ready to test, we turned to AWS for a solution. AWS Device Farm was exactly what we were looking for as we have a really small team and limit resources.
N/A - BrowserStack was the first software I've tried to address these requirements. Previously we've been limited to testing on a handful of devices and browser combinations that our team has physical access to. We're also evaluating Litmus as a complementary service to BrowserStack for analysing our email templates and deliverability.
I may not be the best person to answer this as I am only using it for 1 department and at 1 site but will still try my best As far as Scalability for Devices for Mobile Automation is concerned, it gets a Solid 10, as the users can run cases on upto 10 device parallel and also have the best choices of devices to choose
