Apache JMeter vs. LoadComplete

The key questions I would pose are: how high of a concurrent load do you need to generate against the system? How technically skilled are your personnel that will perform the load testing? How much programmable/scripting/code based control do you desire from the tool? Do you prefer more of a GUI based tool or a programmatic code/scripting based tool? JMeter will be for those that want a GUI, moderate to low scripting/code based control/programmability, moderate to low load generation, and for users experienced in the novice to expert range.

If we already use TestComplete for test automation and there is an urgent need to perform load testing, then it is easy to start with LoadComplete but the tool itself has to improve a lot and support customization to suit our needs. I would say if load testing is the main criteria to use this tool, then there are other open-source tools like JMeter that can support better than this. Of course, as it is an enterprise tool it has very good reporting and record and playback options that I see as an advantage for basic users.

Incentivized

• Easy to construct Webservices script - You just need to add a sampler with the endpoint, payload and header information. And boom you can run a load test on the service with varying load and capture the response time and throughput. In a commercial tool like Loadrunner or Silkperformer, this process would take at least couple of hours, while with Jmeter we can do this in 10 minutes or less.
• Modularizing the scripts - Jmeter has a very good way of organizing the scripts and the reusability of the existing script (transactions) is also as easy as copy pasting the script.
• Jmeter tests can be run from anywhere, so you can run it from the idle webserver itself if you have some firewall restrictions to test it from your local or other environment.
• Jmeter distributed tests can be spawn from the AWS and results collated to see the performance from different regions in the world.

• Smart built-in data correlation. Automatically helps to correlate different dynamic parameters like user session ids, authorization tokens, db-identifiers and so on. Works very fast and save your time for test development.
• Record & Play feature - LoadComplete can record application servers' metrics like CPU and memory usage.

Incentivized

• Even though it has very easy installation, you can run into issues easily. I was ab;e to trigger a test at browser level but couldn't stop the tests. I had to kill it from task manager and then had to reinstall from begining.
• There are so many things in JMeter you can do especially with the sampler for selenium for UI tests. More documentation/webinars etc.. would help the community better.
• The jmx files should have an easy way to be integrated with ci/cd tools and cloud.

Incentivized

• Some of the cons of LoadComplete are that it gets slow when the size of the test increases. Also, the coding is not possible with LoadComplete.
• Moreover, it needs to support flexibility for a framework that can be customized based on the needs. Also, some graphs remain empty which is confusing for me as a user and I would like a description of why a certain graph cannot gather data.

Incentivized

Price, Wiki and user sharing. Having access to the information provided by the developers and other open source providers is key for me. The ability to share information and get answers directly is very important to success in software testing. And the price of this product currently is amazing. Too many companies charge way too much money for products that are far behind in their value and pertinence

I can jump right into a new test plan and start building from scratch. The natural progression from test plan to thread group and then designing the basic format of the process is very streamlined and smooth. With only slight modifications I can build out a very complex model from a very basic beginning.

Usability is really good because being an enterprise tool that might be an easy option to convince users to try this tool. It has a lot of easy-to-use, cool options.

Incentivized

I have been using JMeter for the last year. By using this tool, you can make sure the system will work under varied loads. It helps us to simulate real time scenarios by creating required virtual users and make sure the application will work under load. Perform load, stress, and stability testing using JMeter.

Incentivized

Customer support is good. If any concerns are raised, they are usually resolved soon, but when questioned about a feature LoadComplete does not support, it usually takes more time to resolve.

Incentivized

I have evaluated LOADUI (web free version) and it was a very unstable tool and I could not rely on those results completely as I was not sure how the tool was performing. It only generated the top 10 less transaction times and when Jmeter was in use, it was very effective in using plugins to accommodate more outputs.

Incentivized

It is one of the best platforms. LoadComplete is all over a jack of many traits. It provides us a detailed report to our system analytics as well as developers. Moreover, there is also a smart built-in data correlation in LoadComplete which helps to correlate different parameters like user session IDs, authorization tokens, and so on. Other than that, LoadComplete also has the ability to run tests in the cloud.

Incentivized

• It helped to estimate resources required for a particular client requirement. For example if the client wants the application to be used by 500 users for 1 hour, based on the load test we perform for 500 users and 1 hour we recommend resources and their capabilities.
• Jmeter was used to identify bottleneck. This would lead to better performance.
• Jmeter was used to identify failures as well.

• Negative: Licensing fees are too expensive.
• Positive: Able to generate and present reports, Able to show developers where bottleneck shows up.
• Positive: Easy to understand software to train new users.

Incentivized