IBM DevOps Test Performance vs. Visual Studio Test Professional

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
IBM DevOps Test Performance
Score 8.0 out of 10
N/A
IBM DevOps Test Performance helps software testing teams test earlier and more frequently by shifting testing left. IBM DevOps Test Performance validates the scalability of web and server applications, identifies the presence and cause of system performance bottlenecks and reduces load testing. Software testing teams can execute performance tests that analyze the impact of load on applications.N/A
Visual Studio Test Professional
Score 7.0 out of 10
N/A
Microsoft's Visual Studio Test Professional is a performance testing solution.N/A
Pricing
IBM DevOps Test PerformanceVisual Studio Test Professional
Editions & Modules
No answers on this topic
No answers on this topic
Offerings
Pricing Offerings
IBM DevOps Test PerformanceVisual Studio Test Professional
Free Trial
NoNo
Free/Freemium Version
NoNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
IBM DevOps Test PerformanceVisual Studio Test Professional
User Ratings
IBM DevOps Test PerformanceVisual Studio Test Professional
Likelihood to Recommend
8.0
(0 ratings)
7.0
(0 ratings)
Usability
-
(0 ratings)
7.0
(0 ratings)
Support Rating
-
(0 ratings)
8.5
(0 ratings)
User Testimonials
IBM DevOps Test PerformanceVisual Studio Test Professional
Likelihood to Recommend
Go for IBM RPT if: 1. You're testing a Java-based Web application with HTTP protocol 2. You wanted to distribute the load across machines easily 3. Your team is in learning phase/not really introduced to a wide range of performance testing tools Do not go for IBM RPT if: 1. You wanted to test REST or any other advanced protocols 2. Your system under test demands a very high user load 3. Your application is written in .NET or any other platform except Java.
Read full review
Visual Studio Test Professional is best for .NET and C# based development, which is what 90% of our developers and projects do. It is an integral part of the CI/CD pipeline for our custom made Enterprise resource planning tool. It also works very well with Azure providing seamless integration to way more functionality.
Read full review
Pros
  • Data Parameterisation/ Data Correlation is made simpler compared to its competitors
  • Distributed Load Testing is easier to set up
  • Performance metric gathering while a test is in progress
  • Th look and Feel really helps a beginner to understand and work with.
Read full review
  • Test scenarios in the SDLC process can be easily applied to the Visual Studio Test tool.
  • It works compatible with Microsoft Windows Server and database.
  • The debug screen of the Visual Studio Test product is quite successful. It allows you to quickly access the details of the error received.
Read full review
Cons
  • Memory utilization could have been improved.(Eats up system's RAM)! It may crash if a test is conducted with the heavy load if adequate RAM is not available in the VM/host machine.
  • Licensing could have been made simpler. IBM's licensing method is difficult to follow.
  • Support for protocols other than HTTP. Not really up to the current trend.
Read full review
  • The solution needs more reports and more dashboards, as well as more details for each originated spare test case or best guess in test cases.
  • The service right now is far too expensive. You need to pay per user.
  • The tools for unit testing can be improved, giving a better ability to manage tests.
Read full review
Usability
No answers on this topic
Visual Studio Test Professional's overall usability is extremely high quality. It is extremely functional and like all Microsoft products has a user interface that is well designed and is extremely user friendly. Any functionality which I looked for, I was able to either understand immediately or find a user guide online.
Read full review
Support Rating
No answers on this topic
My team has always been able to troubleshoot with the help of customer support (and even schedule a virtual meeting!) in a timely manner. The support is provided immediately and with the necessary knowledge to answer/solve any questions/problems I or my team experience.
Read full review
Alternatives Considered
Cost/Licensing: While JMeter is an opensource testing tool from Apache, compared to IBM RPT and HP LoadRunner, RPT is much cheaper than Loadrunner. Functionality: JMeter provides basic functionalities which are adequate for performance testing, however advanced features are not available (such as load testing with GUI, reporting is very basic etc.). But when it comes to Loadrunner, it offers very broad features and supports a variety of protocols. So in this category, Loadrunner is a winner, but RPT is better than JMeter. Ease of operating: JMeter is easy compared to LoadRunner, but it has old GUI and look and feel is not that great to understand. Also, most of the things are to be done in a command line, non-GUI mode. While LoadRunner is very advanced with many options, which also confusing sometimes. But RPT, on the other hand, maintains a balance between simplicity and offering of different features. So winner: RPT.
Read full review
When using Azure Devops, it only has a basic test plan while using the extension, and it is better suited if you only use Azure Devops, but VS test professional provides comprehended test execution and management as most of the developers and testers use Visual Studio to develop their apps and publish their builds.
Read full review
Return on Investment
  • Accuracy in metrics, thus improving system's performance
  • Costs less compared to competitor like HP LoadRunner
  • Helped the team of beginners learn things quickly
Read full review
  • Visual Studio Test professional fits right in with the other Microsoft Lifecycle Management tools.
  • End to end, Development, Test, Deployment and Delivery assures the pipeline is continuous. Visual Studio Test Professional is an integral part of that pipeline.
  • Familiarity with Microsoft Tools makes usability intuitive, makes it easy to ramp up our Testers.
Read full review
ScreenShots