TrustRadius: an HG Insights company

Azure DevOps Services vs. OpenText LoadRunner Professional

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    Azure DevOps Services

    Score7.7 out of 10
    N/AAzure DevOps (formerly VSTS, Microsoft Visual Studio Team System) is an agile development product that is an extension of the Microsoft Visual Studio architecture. Azure DevOps includes software development, collaboration, and reporting capabilities.

    $2

    per GB (first 2GB free)

    LoadRunner Professional

    Score8.9 out of 10
    N/AA solution simplifies performance load testing for colocated teams. With project-based capabilities, so teams can quickly identify abnormal application behavior.N/A
    Pricing
    Azure DevOps ServicesLoadRunner Professional
    Editions & Modules
    Azure Artifacts
    $2
    per GB (first 2GB free)
    Basic Plan
    $6
    per user per month (first 5 users free)
    Azure Pipelines - Self-Hosted
    $15
    per extra parallel job (1 free parallel job with unlimited minutes)
    Azure Pipelines - Microsoft Hosted
    $40
    per parallel job (1,800 minutes free with 1 free parallel job)
    Basic + Test Plan
    $52
    per user per month
    No answers on this topic
    Offerings
    Pricing Offerings
    Azure DevOps ServicesLoadRunner Professional
    Free Trial
    NoNo
    Free/Freemium Version
    NoNo
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeNo setup fee
    Additional Details
    More Pricing Information
    Community Pulse
    Azure DevOps ServicesLoadRunner Professional
    Considered Both Products
    Microsoft
    No answer on this topic
    OpenText
    No answer on this topic
    Key User Insights
    Would buy again
    97%
    Would buy again
    33 Answers
    No answers on this topic
    Delivers good value for the price
    100%
    Delivers good value for the price
    32 Answers
    No answers on this topic
    Happy with the feature set
    100%
    Happy with the feature set
    34 Answers
    No answers on this topic
    Lived up to sales and marketing promises
    95%
    Lived up to sales and marketing promises
    20 Answers
    No answers on this topic
    Implementation went as expected
    100%
    Implementation went as expected
    28 Answers
    No answers on this topic
    Features
    Azure DevOps ServicesLoadRunner Professional
    Load Testing
    Comparison of Load Testing features of Azure DevOps Services and OpenText LoadRunner Professional
    Feature
    Azure DevOps Services
    -
    Ratings
    OpenText LoadRunner Professional
    8.4
    6 Ratings
    0% below category average
    End to end performance management00 Ratings9.06 Ratings
    Integrated performance data00 Ratings10.06 Ratings
    Deployment model flexibility00 Ratings9.06 Ratings
    Real time monitoring00 Ratings6.15 Ratings
    Automated anomaly detection00 Ratings8.05 Ratings
    Best Alternatives
    Azure DevOps ServicesLoadRunner Professional
    Small Businesses
    No answers on this topic
    No answers on this topic
    Medium-sized Companies
    Azure DevOps Server
    Score8.2 out of 10
    JMeter
    Score9.4 out of 10
    Enterprises
    Azure DevOps Server
    Score8.2 out of 10
    JMeter
    Score9.4 out of 10
    All AlternativesView all alternativesView all alternatives
    User Ratings
    Azure DevOps ServicesLoadRunner Professional
    Likelihood to Recommend
    8.1
    (68 ratings)
    9.0
    (7 ratings)
    Likelihood to Renew
    10.0
    (3 ratings)
    -
    (0 ratings)
    Usability
    6.6
    (7 ratings)
    -
    (0 ratings)
    Support Rating
    8.1
    (11 ratings)
    3.0
    (1 ratings)
    Implementation Rating
    10.0
    (1 ratings)
    -
    (0 ratings)
    User Testimonials
    Azure DevOps ServicesLoadRunner Professional
    Likelihood to Recommend
    Microsoft
    DevOps is much more user friendly than Git itself. There is a more GUI-centric interface, tighter integration with the Azure / Entra architecture. For those of use in the Microsoft-sphere, it really is excellent for code-centric project management. I rate this as an 8 because it does not seem quite as well suited for fully functional / non-code project aspects in implementation. Nor does it have customer / end-user portal / front end for easy reporting and insight.
    Incentivized
    Read full review
    OpenText
    Micro Focus LoadRunner and its suite of tools, specifically VuGen works wonderfully for us for all web, http/https and web service calls. We've been able to build tests for near any scenario we need with relative ease. As long as we have crafted up requirements for our scenarios / scripts to managed scope, we've had high success working with scripting and data driving. Our main tests are web service calls - typically chained together to form a full scenario with transactions measuring the journey or a similar (measure along the way) journey through a browser. For web services we will use VuGen and browser we've shifted to Tru Client I have had little-to-no experience scripting against a thick client where a ui-driven test would be required. I know its possible but quite costly due to the need to run the actual desktop client to drive tests. We've been fortunate enough to leverage http calls to represent client traffic.
    Incentivized
    Read full review
    Pros
    Microsoft
    • Flexible Requirements Hierarchy Management: AZDO makes it easy to track items such as features or epics as a flat list, or as a hierarchy in which you can track the parent-child relationship.
    • Fast Data Entry: AZDO was designed to facilitate quick data entry to capture work items quickly, while still enabling detailed capture of acceptance criteria and item properties.
    • Excel Integration: AZDO stands out for its integration with MS Excel, which enables quick updates for bulk items.
    Incentivized
    Read full review
    OpenText
    • It can simulate multiple users at the same time and help understand the performance.
    • It can generate excellent reports and give insights into application performance.
    • It is a fast tool and does not take time to perform its functions.
    Incentivized
    Read full review
    Cons
    Microsoft
    • I did mention it has good visibility in terms of linking, but sometimes items do get lost, so if there was a better way to manage that, that would be great.
    • The wiki is not the prettiest thing to look at, so it could have refinements there.
    • It could improve the search slightly better.
    Read full review
    OpenText
    • HP LoadRunner with new patches and releases sometimes makes no longer support older version of various protocols like Citrix, which makes the task time-consuming when using older versions of LoadRunner for some of the cases. So it should support older version as well while upgrading.
    • Configuring HP LoadRunner over the firewall involves lots of configuration and may be troublesome. So, there should be a script (power shell script for Windows or shell script for Linux users) to make it easy to use and with less pain.
    • I would like to see the RunTime Viewer of Vugen in HPLoadRunner based on the browser I selected in the run-time configuration to make it feel more realistic as a real user.
    • Licensing cost is very high when we need to perform a test on application for a specific group of users.
    Incentivized
    Read full review
    Likelihood to Renew
    Microsoft
    I don't think our organization will stray from using VSTS/TFS as we are now looking to upgrade to the 2012 version. Since our business is software development and we want to meet the requirements of CMMI to deliver consistent and high quality software, this SDLC management tool is here to stay. In addition, our company uses a lot of Microsoft products, such as Office 365, Asp.net, etc, and since VSTS/TFS has proved itself invaluable to our own processes and is within the Microsoft family of products, we will continue to use VSTS/TFS for a long, long time.
    Incentivized
    Read full review
    OpenText
    No answers on this topic
    Usability
    Microsoft
    Azure DevOps is a powerful, complex cloud application. As such there are a number of things it does great and something where there is room for improvement. One of those areas would be in usability. In my opinion it relies too much on search. There is no easy way to view all projects or to group them in a logical way. You need to search for everything.
    Incentivized
    Read full review
    OpenText
    No answers on this topic
    Support Rating
    Microsoft
    When we've had issues, both Microsoft support and the user community have been very responsive. DevOps has an active developer community and frankly, you can find most of your questions already asked and answered there. Microsoft also does a better job than most software vendors I've worked with creating detailed and frequently updated documentation.
    Incentivized
    Read full review
    OpenText
    Customer service is not that great. It's difficult to get hold of someone if an issue is supposed to be addressed on an urgent basis. No online chat service readily available.
    Incentivized
    Read full review
    Implementation Rating
    Microsoft
    Was not part of the process.
    Incentivized
    Read full review
    OpenText
    No answers on this topic
    Alternatives Considered
    Microsoft
    Microsoft Planner is used by project managers and IT service managers across our organization for task tracking and running their team meetings. Azure DevOps works better than Planner for software development teams but might possibly be too complex for non-software teams or more business-focused projects. We also use ServiceNow for IT service management and this tool provides better analysis and tracking of IT incidents, as Azure DevOps is more suited to development and project work for dev teams.
    Incentivized
    Read full review
    OpenText
    HP performance center stacks up very well for front end applications. Need more improvements for API performance testing.
    Incentivized
    Read full review
    Return on Investment
    Microsoft
    • We have saved a ton of time not calculating metrics by hand.
    • We no longer spend time writing out cards during planning, it goes straight to the board.
    • We no longer track separate documents to track overall department goals. We were able to create customized icons at the department level that lets us track each team's progress against our dept goals.
    Incentivized
    Read full review
    OpenText
    • The scripts created with traditional web/http protocol are not robust thus re-scripting is required after most every code drop. Troubleshooting and fixing the issue takes more time therefore in most cases we do re-scripting to keep it simple and save time.
    • In ideal world you would rather spend more time doing testing than scripting in that case mostly you could use an Ajax TruClient protocol. This type of script will only fail when an object in the application is removed or changed completely. This way of scripting will save you more time and helps you maintain the scripts with less re-work effort on a release basis. On the long run you will have a better ROI when you use Ajax TruClient protocol for scripting.
    Incentivized
    Read full review
    ScreenShots