blackfire.io vs. OpenText LoadRunner Professional

blackfire.io is best suited for any company that has a development team managing code releases into different environments. This tool is crucial in cases where there are codebase changes or upgrades and it really helps in load testing and code validity. With every new codebase release there could be a risk of how it affects the infrastructure supporting it so blackfire.io helps report on those metrics.

Incentivized

Micro Focus LoadRunner is good for scripting and running a load test, but should be providing better customer service in case of user facing any issues.

Incentivized

• Provide details on processes eating up valuable server resources
• Alert against bottlenecks and find bottlenecks
• Performs load tests in code before moving to production environments

Incentivized

• Support of multiple protocols like HTTP, RDP, Citrix, SAP, Oracle Database 12c, AJAX Tru Client, SOAP-based calls and others which is why it is used widely in our organization as we are using various applications in an industry for different usage.
• Supporting the mobile agents which means it is not only used for web applications but also for mobile applications.
• Latest version of HP LoadRunner makes the scripting easy by replacing dynamic changes in the script using correlation parameters. This means less coding and we can focus on major issues if needed.
• Controller enhancements by specifying the cloud provider like Digital Ocean. We can provision our load generators with Amazon EC2, DigitalOcean and others.
• Analysis provides a nice HTML report on the test executed with all the necessary metrics. We can simply put more analysis if needed and it will be automatically embedded in an HTML report.

Incentivized

• They count same API endpoint AND same method (e.g. POST, OPTIONS, GET etc) as different profiles
• Customer service needs a lot of improvement
• The documentation can be a bit more detailed to remove any scope of doubts

Incentivized

• Monitoring tools like SiteScope, AppDynamics should be used apart from HP Performance Center. Would be great if the tool can give good monitoring on app and db servers.
• As the load goes high, the cost increases. In the open source world, it's not a bad idea to consider the licensing cost.

Incentivized

Customer service is not that great. It's difficult to get hold of someone if an issue is supposed to be addressed on an urgent basis. No online chat service readily available.

Incentivized

The pricing offered by blackfire.io was highly competitive and customisable as we opted for pay per use pricing model. Initial setup was very easy. The support team provided us with the detailed demo of the product and helped with the initial integration and setup. We already had tried our free version as well and the results looked good. So opted for blackfire.io

Incentivized

Micro Focus LoadRunner fit well into our portfolio of tools with its long track record, ability to test near any application technology we adopt and allow for a single / cohesive toolset to drive our performance testing needs.

Incentivized

• Reduce in bugs by 50%, more happy customers
• 2x decrease in load time for the website
• 100% performance validation before production release

Incentivized

• It has a positive impact as we know how PE testing is (performance).
• It helps with integrating data from various data streams and includes anomaly testing.
• It does a good job with the accuracy of results. The results are very accurate.

Incentivized