Apache JMeter vs. BrowserStack

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
JMeter
Score 9.3 out of 10
N/A
JMeter, from Apache, is a load and performance testing tool.N/A
BrowserStack
Score 8.6 out of 10
N/A
BrowserStack is a test platform built for developers and QAs to expand test coverage, scale and optimize testing with cross-browser, real device cloud, accessibility, visual testing, test management, and test observability. BrowserStack states it currently powers over a billion tests a year for customers who include Amazon, Paypal, Well Fargo Bank, Nvidia, MongoDB, Pfizer, GE, Discovery, React JS, Apache, JQuery and several others rely on BrowserStack to test their web and mobile apps.
$0
per month Unlimited users and 5000 free screenshots
Pricing
Apache JMeterBrowserStack
Editions & Modules
No answers on this topic
Percy - Free
$0
per month Unlimited users and 5000 free screenshots
App Percy - Free
$0
per month 5000 free screenshots and 100 minutes of infrastructure
Test Observability - Unlimited Free
$0
Accessibility Testing - Free
$0
Test Observability - Observability Pro
$0.01
per month per test execution
Percy - Desktop
$0.02
per month per screenshot
App Percy - Visual Core
$0.02
per month per screenshot
Percy - Desktop & Mobile
$0.02
per month per screenshot
App Percy - Visual Cloud
$0.03
per month per screenshot
Live - Desktop
$29
per month per user
Live - Desktop & Mobile
$39
per month per user
App Live - Individual
$39
per month per user
Automate - Desktop
$129
per month 1 parallel test
Live - Team
$150
per month 5 users
App Live - Team
$150
per month 5 users
Automate - Desktop & Mobile
$199
per month 1 parallel test
App Automate - Device Cloud
$199
per month 1 parallel test
App Live - Team Pro
$199
per month 5 users
Accessibility Testing - Team
$199
per month 5 users
App Automate - Device Cloud Pro
$249
per month 1 parallel test
Automate - Enterprise
Contact sales team
Percy - Enterprise
Contact Sales
App Automate - Enterprise
Contact Sales
App Live - Enterprise
Contact sales team
Live - Enterprise
Contact sales team
App Automate - Device Cloud Pro + Visual Cloud
Contact Sales
App Percy - Enterprise
Contact Sales
Test Observability - Enterprise
Contact Sales
Accessibility Testing - Enterprise
Contact Sales
Offerings
Pricing Offerings
JMeterBrowserStack
Free Trial
NoYes
Free/Freemium Version
YesNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
Apache JMeterBrowserStack
Features
Apache JMeterBrowserStack
Load Testing
Comparison of Load Testing features of Product A and Product B
Apache JMeter
7.5
Ratings
11% below category average
BrowserStack
-
Ratings
End to end performance management9.00 Ratings00 Ratings
Integrated performance data8.90 Ratings00 Ratings
Deployment model flexibility6.30 Ratings00 Ratings
Real time monitoring8.90 Ratings00 Ratings
Automated anomaly detection4.40 Ratings00 Ratings
Best Alternatives
Apache JMeterBrowserStack
Small Businesses

No answers on this topic

TestComplete
TestComplete
Score 8.0 out of 10
Medium-sized Companies
ReadyAPI
ReadyAPI
Score 7.0 out of 10
ReadyAPI
ReadyAPI
Score 7.0 out of 10
Enterprises
ReadyAPI
ReadyAPI
Score 7.0 out of 10
ignio AIOps
ignio AIOps
Score 8.1 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
Apache JMeterBrowserStack
Likelihood to Recommend
8.1
(0 ratings)
9.0
(0 ratings)
Likelihood to Renew
8.6
(0 ratings)
9.4
(0 ratings)
Usability
9.0
(0 ratings)
5.6
(0 ratings)
Availability
1.0
(0 ratings)
9.8
(0 ratings)
Performance
8.0
(0 ratings)
2.3
(0 ratings)
Support Rating
10.0
(0 ratings)
6.1
(0 ratings)
In-Person Training
-
(0 ratings)
7.3
(0 ratings)
Online Training
1.0
(0 ratings)
4.1
(0 ratings)
Implementation Rating
-
(0 ratings)
8.1
(0 ratings)
Configurability
-
(0 ratings)
7.5
(0 ratings)
Ease of integration
-
(0 ratings)
9.1
(0 ratings)
Product Scalability
-
(0 ratings)
9.7
(0 ratings)
Vendor post-sale
-
(0 ratings)
9.1
(0 ratings)
Vendor pre-sale
-
(0 ratings)
9.1
(0 ratings)
User Testimonials
Apache JMeterBrowserStack
Likelihood to Recommend
The key questions I would pose are: how high of a concurrent load do you need to generate against the system? How technically skilled are your personnel that will perform the load testing? How much programmable/scripting/code based control do you desire from the tool? Do you prefer more of a GUI based tool or a programmatic code/scripting based tool? JMeter will be for those that want a GUI, moderate to low scripting/code based control/programmability, moderate to low load generation, and for users experienced in the novice to expert range.
Read full review
Multiple real devices available for testing across different OS, platform and browsers for both website and mobile application testing. Automate help to integrate existing project and testing suite to run across different devices. This reduce testing timeline and allow us to quickly release new features to users. Also provide automated accessibility report.
Read full review
Pros
  • Easy to construct Webservices script - You just need to add a sampler with the endpoint, payload and header information. And boom you can run a load test on the service with varying load and capture the response time and throughput. In a commercial tool like Loadrunner or Silkperformer, this process would take at least couple of hours, while with Jmeter we can do this in 10 minutes or less.
  • Modularizing the scripts - Jmeter has a very good way of organizing the scripts and the reusability of the existing script (transactions) is also as easy as copy pasting the script.
  • Jmeter tests can be run from anywhere, so you can run it from the idle webserver itself if you have some firewall restrictions to test it from your local or other environment.
  • Jmeter distributed tests can be spawn from the AWS and results collated to see the performance from different regions in the world.
Read full review
  • UI testing on different Devices like iOS, Android, MacOS, and Windows OS.
  • Automation testing with the help of Cypress gives automation access to different OS and devices.
  • Comparison with two devices how UI will look a like.
  • Bug Capture tool: Using this tool, a user can capture a bug while live recording it, and the tool captures action as well. This helps developers identify and fix the bug more easily.
Read full review
Cons
  • Even though it has very easy installation, you can run into issues easily. I was ab;e to trigger a test at browser level but couldn't stop the tests. I had to kill it from task manager and then had to reinstall from begining.
  • There are so many things in JMeter you can do especially with the sampler for selenium for UI tests. More documentation/webinars etc.. would help the community better.
  • The jmx files should have an easy way to be integrated with ci/cd tools and cloud.
Read full review
  • I wish it didn't time out so quickly. I often move back and forth between my native Mac OS system and browsers to BrowserStack for Windows browsers and it often times out so I have to start over.
  • I am not sure why, but when I've been testing in BrowserStack for a long period of time - maybe over a couple of hours, it sometimes gets buggy and unresponsive or slow to respond. It makes it hard to tell if I'm experiencing an issue with the site I'm testing or if it's an issue with BrowserStack.
  • If I'm wishing for the moon and stars, I'd ask for the ability to use BrowserStack to also test with JAWS screen reader. But I'm happy having NVDA.
Read full review
Likelihood to Renew
Price, Wiki and user sharing. Having access to the information provided by the developers and other open source providers is key for me. The ability to share information and get answers directly is very important to success in software testing. And the price of this product currently is amazing. Too many companies charge way too much money for products that are far behind in their value and pertinence
Read full review
It's simply a must-have tool. As a designer, I have to ensure my work is at least functional in older browsers. I also have to ensure that, when I design for mobile devices, any differences between platforms aren't problematic. BrowserStack allows me to test my work in a fraction of the time, with a whole lot more accuracy.
Read full review
Usability
I can jump right into a new test plan and start building from scratch. The natural progression from test plan to thread group and then designing the basic format of the process is very streamlined and smooth. With only slight modifications I can build out a very complex model from a very basic beginning.
Read full review
It integrates directly in internal networks and local development. The point and click interface of choosing your device, pick the browser/version and you have a working emulation of that exact environment. What else could you ask for? I've set our least computer savvy users up with BrowserStack for testing in minutes. It feels like it's just part of your local environemnt.
Read full review
Reliability and Availability
No answers on this topic
I rated BrowserStack's availability a 10 because it is consistently reliable, with minimal to no downtime or unplanned outages. The platform is accessible whenever needed, ensuring uninterrupted testing. Its robust infrastructure and proactive monitoring ensure a seamless experience, allowing us to meet deadlines without delays caused by availability issues and all
Read full review
Performance
No answers on this topic
The tests are fast considering the fact that they're Appium tests. I've seen tests reliably pass or fail when they're supposed to, with next to zero issues on the BrowserStack side of things. Tests launch only seconds after I kick off them off from my CLI.
Read full review
Support Rating
I have been using JMeter for the last year. By using this tool, you can make sure the system will work under varied loads. It helps us to simulate real time scenarios by creating required virtual users and make sure the application will work under load. Perform load, stress, and stability testing using JMeter.
Read full review
I'm saying a 10 for support for BrowserStack only based on feedback from the development team. I myself have never had to reach out to support for any questions or issues, but others in the company have. From my conversations with them, the support was fantastic and had been a pleasure working with the BrowserStack team.
Read full review
In-Person Training
No answers on this topic
Yes, it was online training on meet, and trainer looks like skilled and technical strong, he has covered end to end all the features and he has answers all the queries. because of this trainings we are able to implement it by our own in the organization, thank you for support and training.
Read full review
Online Training
No answers on this topic
It was a quick training from the support of browserstack, it was nice and easy to understand, thanks again for the support given by the team. and regularly I used to receive mails for training from support for any new feature they launch, I was able to spread same training to all my team and dev.
Read full review
Implementation Rating
No answers on this topic
I rated the implementation satisfaction an 8 because while it went smoothly overall, there were some challenges during the initial learning phase and integration with existing tools. Key insights include the importance of providing sufficient training upfront and ensuring seamless integration with other systems to minimize disruptions and improve adoption speed.
Read full review
Alternatives Considered
I have evaluated LOADUI (web free version) and it was a very unstable tool and I could not rely on those results completely as I was not sure how the tool was performing. It only generated the top 10 less transaction times and when Jmeter was in use, it was very effective in using plugins to accommodate more outputs.
Read full review
N/A - BrowserStack was the first software I've tried to address these requirements. Previously we've been limited to testing on a handful of devices and browser combinations that our team has physical access to. We're also evaluating Litmus as a complementary service to BrowserStack for analysing our email templates and deliverability.
Read full review
Scalability
No answers on this topic
I may not be the best person to answer this as I am only using it for 1 department and at 1 site but will still try my best As far as Scalability for Devices for Mobile Automation is concerned, it gets a Solid 10, as the users can run cases on upto 10 device parallel and also have the best choices of devices to choose
Read full review
Return on Investment
  • It helped to estimate resources required for a particular client requirement. For example if the client wants the application to be used by 500 users for 1 hour, based on the load test we perform for 500 users and 1 hour we recommend resources and their capabilities.
  • Jmeter was used to identify bottleneck. This would lead to better performance.
  • Jmeter was used to identify failures as well.
Read full review
  • It reduced the cost of buying multiple devices as we have multiple devices access in it
  • Easily accessible from anywhere due to it cloud availability
  • Introducing this to our client also helped us in building trust as well as winning their confidence during deliverables
Read full review
ScreenShots

BrowserStack Screenshots

Screenshot of Screenshot of Screenshot of Screenshot of Screenshot of Screenshot of