TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    IBM DevOps Test Performance

    Score8 out of 10
    N/AIBM DevOps Test Performance helps software testing teams test earlier and more frequently by shifting testing left. IBM DevOps Test Performance validates the scalability of web and server applications, identifies the presence and cause of system performance bottlenecks and reduces load testing. Software testing teams can execute performance tests that analyze the impact of load on applications.N/A

    Tricentis NeoLoad

    Score9.3 out of 10
    N/ATricentis NeoLoad is a solution for continuous performance testing software to automate API and application load testing. It was developed by the French company Neotys and acquired by Tricentis, along with the company, in March 2021.

    $20,000

    per year with 300 virtual users

    Pricing
    IBM DevOps Test PerformanceTricentis NeoLoad
    Editions & Modules
    No answers on this topic
    No answers on this topic
    Offerings
    Pricing Offerings
    IBM DevOps Test PerformanceTricentis NeoLoad
    Free Trial
    NoYes
    Free/Freemium Version
    NoNo
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeOptional
    Additional Details——
    More Pricing Information
    Community Pulse
    IBM DevOps Test PerformanceTricentis NeoLoad
    Considered Both Products
    IBM
    No answer on this topic
    Tricentis
    Chose Tricentis NeoLoad
    in upper middle field
    Incentivized
    Key User Insights
    Would buy again
    No answers on this topic
    96%
    Would buy again
    22 Answers
    Delivers good value for the price
    No answers on this topic
    100%
    Delivers good value for the price
    22 Answers
    Happy with the feature set
    No answers on this topic
    91%
    Happy with the feature set
    21 Answers
    Lived up to sales and marketing promises
    No answers on this topic
    94%
    Lived up to sales and marketing promises
    17 Answers
    Implementation went as expected
    No answers on this topic
    95%
    Implementation went as expected
    20 Answers
    Best Alternatives
    IBM DevOps Test PerformanceTricentis NeoLoad
    Small Businesses
    No answers on this topic
    No answers on this topic
    Medium-sized Companies
    No answers on this topic
    No answers on this topic
    Enterprises
    Tricentis NeoLoad
    Score9.3 out of 10
    No answers on this topic
    All AlternativesView all alternativesView all alternatives
    User Ratings
    IBM DevOps Test PerformanceTricentis NeoLoad
    Likelihood to Recommend
    8.0
    (2 ratings)
    7.6
    (24 ratings)
    Likelihood to Renew
    -
    (0 ratings)
    7.3
    (1 ratings)
    Usability
    -
    (0 ratings)
    7.3
    (3 ratings)
    Support Rating
    -
    (0 ratings)
    3.6
    (3 ratings)
    Implementation Rating
    -
    (0 ratings)
    6.4
    (1 ratings)
    User Testimonials
    IBM DevOps Test PerformanceTricentis NeoLoad
    Likelihood to Recommend
    IBM
    Go for IBM RPT if: 1. You're testing a Java-based Web application with HTTP protocol 2. You wanted to distribute the load across machines easily 3. Your team is in learning phase/not really introduced to a wide range of performance testing tools Do not go for IBM RPT if: 1. You wanted to test REST or any other advanced protocols 2. Your system under test demands a very high user load 3. Your application is written in .NET or any other platform except Java.
    Incentivized
    Read full review
    Tricentis
    While Tricentis NeoLoad supports SAP GUI protocols, recording and maintaining test scripts for complex SAP transactions (like those in the OTC module) can be cumbersome.


    For instance, we had challenges recording a VA01 (Sales Order Creation) transaction because of the dynamic nature of SAP screen fields and session handling. NeoLoad sometimes struggles to properly correlate or handle SAP’s SAPGUI Dynpro fields automatically.
    Incentivized
    Read full review
    Pros
    IBM
    • Data Parameterisation/ Data Correlation is made simpler compared to its competitors
    • Distributed Load Testing is easier to set up
    • Performance metric gathering while a test is in progress
    • Th look and Feel really helps a beginner to understand and work with.
    Incentivized
    Read full review
    Tricentis
    • With Tricentis NeoLoad, we have control on the test dynamically. One can alter user count/volume even when test is in progress. This makes it a very cool tool as you can avoid running multiple tests eventually saves a lot of time.
    • Tricentis NeoLoad user paths are very well structured. End points can be identified and tweaked easily especially when a large list of endpoints are part of the neoload project.
    • Tricentis NeoLoad results comparison is one of the cool options. We can compare previous tests against the current one to see the exact delta between transaction metrics. This helps in gauging the application behaviour with changes deployed
    Incentivized
    Read full review
    Cons
    IBM
    • Memory utilization could have been improved.(Eats up system's RAM)! It may crash if a test is conducted with the heavy load if adequate RAM is not available in the VM/host machine.
    • Licensing could have been made simpler. IBM's licensing method is difficult to follow.
    • Support for protocols other than HTTP. Not really up to the current trend.
    Incentivized
    Read full review
    Tricentis
    • Ease of use: Some users find certain features or aspects of the interface to be confusing or hard to use. Improving the overall usability of the tool could make it more accessible and easier for users to get up and running with it.
    • Integration with other tools: Tricentis NeoLoad does not have many integrations with other tools. Adding more integrations with popular tools and platforms could make it easier for users to work with Tricentis NeoLoad as part of their overall workflow.
    • Mobile testing: Some users wish that Tricentis NeoLoad had more robust support for testing the performance of mobile applications. This could include the ability to simulate different mobile devices and networks, as well as the ability to test the performance of native mobile apps.
    • Cloud support: Tricentis NeoLoad does not have as much support for cloud-based applications and infrastructure. Adding more support for testing the performance of applications hosted in the cloud could be a useful feature for some users.
    • Advanced scripting capabilities: While Tricentis NeoLoad does offer some scripting capabilities, it would be nice to have more advanced options for customizing and automating load testing scenarios. Adding more advanced scripting capabilities could make it easier for users to create complex load testing scenarios.
    Incentivized
    Read full review
    Likelihood to Renew
    IBM
    No answers on this topic
    Tricentis
    We find NeoLoad easy to use compared to their competitors. It requires minimal coding knowledge, also it is easy to train newcomers with NeoLoad. It also offers good integration and automation capability where with less code you can automate your testing process
    Incentivized
    Read full review
    Usability
    IBM
    No answers on this topic
    Tricentis
    In being flexible to meet all needs, it is very bare bones by design, but this could be a considered a feature and not a bug.
    Read full review
    Support Rating
    IBM
    No answers on this topic
    Tricentis
    This is the only area where we strongly feel Tricentis needs to improve. Their support process is inadequate, representatives are not so capable of providing solutions at one shot without consulting their internal engineering teams. Most importantly, the time they take to resolve simple issues is huge and at many times hampered our work.
    Incentivized
    Read full review
    Implementation Rating
    IBM
    No answers on this topic
    Tricentis
    1. Their documentation is scattered over many places like GitHub read me files, their internal website etc;
    2. Support team takes huge time just to acknowledge our ticket
    3. No support to automatically migrate scripts from competetor tool into
    Incentivized
    Read full review
    Alternatives Considered
    IBM
    Cost/Licensing: While JMeter is an opensource testing tool from Apache, compared to IBM RPT and HP LoadRunner, RPT is much cheaper than Loadrunner. Functionality: JMeter provides basic functionalities which are adequate for performance testing, however advanced features are not available (such as load testing with GUI, reporting is very basic etc.). But when it comes to Loadrunner, it offers very broad features and supports a variety of protocols. So in this category, Loadrunner is a winner, but RPT is better than JMeter. Ease of operating: JMeter is easy compared to LoadRunner, but it has old GUI and look and feel is not that great to understand. Also, most of the things are to be done in a command line, non-GUI mode. While LoadRunner is very advanced with many options, which also confusing sometimes. But RPT, on the other hand, maintains a balance between simplicity and offering of different features. So winner: RPT.
    Incentivized
    Read full review
    Tricentis
    When we used Apache JMeter we faced some problems like less documentation is available for integrating tools, and some integrations have not yet been deployed. Very few plugin updates are made. Since customer support is an open source tool, it is a major problem. While Tricentis Neoload provides better documentations and customer services.
    Incentivized
    Read full review
    Return on Investment
    IBM
    • Accuracy in metrics, thus improving system's performance
    • Costs less compared to competitor like HP LoadRunner
    • Helped the team of beginners learn things quickly
    Incentivized
    Read full review
    Tricentis
    • Performance testing is like an insurance. An online store which is not available causes a loss of sales. Without a performance test you do not know if it might happen. The invest into performance tests reduces the risk of loosing sales. The flexible license model of NeoLoad allows or customers to choose reasonable and suiteable rate.
    Incentivized
    Read full review
    ScreenShots

    Tricentis NeoLoad Screenshots

    Screenshot of Code-less design — loops, conditions, and other drag and drop controls simplify test design creation, and JavaScript can still be used for extremely advanced cases.Screenshot of CI/CD integrations — collaborate across dev, QA, operations, and business teams to create a standardized performance testing approach throughout the enterprise.Screenshot of Real-time test results — analyze test results live to react to an anomaly before the test is over. And leverage in-depth test reporting when the test is completed.Screenshot of Collaborate on test result as the test is runningScreenshot of Configure SaaS-based performance testScreenshot of Dashboard for team analysis