TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    Azure Test Plans

    Score9.1 out of 10
    N/AAzure Test Plans is an exploratory test toolkit available from Microsoft's Azure suite of services. It enables manual testing for users, so that they can plan, execute, and track scripted tests with actionable defects and end-to-end traceability. Assess quality throughout the development lifecycle by testing your desktop or web applications. It is available with Azure DevOps Services.N/A

    QMetry

    Score9 out of 10
    N/AQMetry is a test management tool that offers test case authoring, reusable test cases, test execution, 140+ reports including deep traceability and test case coverage reports with customization options, and integrations with Jira, CI/CD tools like Bamboo/Jenkins, and Automation frameworks.N/A
    Pricing
    Azure Test PlansQMetry
    Editions & Modules
    No answers on this topic
    No answers on this topic
    Offerings
    Pricing Offerings
    Azure Test PlansQMetry
    Free Trial
    NoNo
    Free/Freemium Version
    NoNo
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeNo setup fee
    Additional Details——
    More Pricing Information
    Community Pulse
    Azure Test PlansQMetry
    Considered Both Products
    Microsoft
    Chose Azure Test Plans
    Since we were using Azure DevOps, Test Plans were built-in on the Azure ecosystem the same that we were using to reduce the adoption time and we don't have to install an external tool for this purpose.
    Incentivized
    SmartBear
    No answer on this topic
    Key User Insights
    Would buy again
    100%
    Would buy again
    6 Answers
    No answers on this topic
    Delivers good value for the price
    100%
    Delivers good value for the price
    6 Answers
    No answers on this topic
    Happy with the feature set
    100%
    Happy with the feature set
    6 Answers
    No answers on this topic
    Lived up to sales and marketing promises
    No answers on this topic
    No answers on this topic
    Implementation went as expected
    No answers on this topic
    No answers on this topic
    Features
    Azure Test PlansQMetry
    Test Management
    Comparison of Test Management features of Azure Test Plans and QMetry
    Feature
    Azure Test Plans
    8.4
    6 Ratings
    4% above category average
    QMetry
    9.0
    1 Ratings
    11% above category average
    Centralized test management8.86 Ratings9.01 Ratings
    Manage test hosts and schedules8.26 Ratings8.01 Ratings
    Map tests to user stories8.56 Ratings10.01 Ratings
    Test execution reporting9.36 Ratings9.01 Ratings
    Defect management7.46 Ratings9.01 Ratings
    User Ratings
    Azure Test PlansQMetry
    Likelihood to Recommend
    9.0
    (6 ratings)
    9.0
    (1 ratings)
    User Testimonials
    Azure Test PlansQMetry
    Likelihood to Recommend
    Microsoft
    It works well for express test case implementation with a short duration. You can define the tests for two weeks and run the activities documenting the software errors and fixes to control the effectiveness of DevOps. The graphic reports give the idea of the backlog phases advances and errors detected. It needs improvement if you have a large test project and need to design financial budgets and control over costs of the test plan.
    Incentivized
    Read full review
    SmartBear
    QMetry, like any new-gen test management tool, works well with any type of development methodologies, be it agile, waterfall or hybrid. It is positioned to be a tool for enterprises of any size. QMetry also provides easy migration of existing test artifacts from a legacy test management tool to QMetry without loss of any information. The one thing that I see as an opportunity for improvement is trying to provide out-of-box integration with all major test automation tools. Another area could be to expand the offering to include it as a product suite with accessibility testing, security testing, performance testing, and test automation which is what the trend is.
    Incentivized
    Read full review
    Pros
    Microsoft
    • Multi test plan access
    • Well structured and easy to use
    • Integrates with other azure features to work seamlessly ,connecting the data flow
    Incentivized
    Read full review
    SmartBear
    • Works well with all dev methodologies.
    • Real-time integration with Jira.
    • Out of box reports.
    • Integration with test automation tools.
    Incentivized
    Read full review
    Cons
    Microsoft
    • Graphic definition of the the Work Break Down Structure
    • Gantt Chart to check the activity dependance and flow of the process
    • Basic cost module to design test budgets.
    Incentivized
    Read full review
    SmartBear
    • Provision to report on custom fields.
    • Integration with other agile management tools.
    • API limit consumption.
    Incentivized
    Read full review
    Alternatives Considered
    Microsoft
    We're doing a full continuous integration (CI), continuous delivery (CD), continuous testing (CT), security, delivery, and monitoring. They have been lately adding features to the services on a regular basis. Every two weeks, they add functionality to Azure DevOps Services to match it with what Azure DevOps Server or on-prem would offer. So, we continue to get more robust functionality. My favorite right now is that they are starting to open up the API availability within Azure DevOps Services.
    Incentivized
    Read full review
    SmartBear
    QMetry provides an easy path for migration from the legacy test management tool. The migration utility is free compared to other vendors. We have received great customer support from day one of the engagement starting with POC, implementation, and ongoing support. Overall, pricing and licensing model are affordable and attractive.
    Incentivized
    Read full review
    Return on Investment
    Microsoft
    • Pros: One stop solution for end to end traceability
    • Pros: Exploratory testing used
    • Pros: maximum coverage on multiple browsers, operating system combinations
    • Cons: Integration with Non-Microsoft tools can be improved
    Incentivized
    Read full review
    SmartBear
    • Helped with overall adoption to the new dev model.
    • Fits well with Devops framework.
    • Overall licensing model is affordable and accommodates many users.
    Incentivized
    Read full review
    ScreenShots