TrustRadius: an HG Insights company

Save this comparison

Save this comparison

Add Product

Recommended Comparisons

    Overview
    ProductRatingMost Used ByProduct SummaryStarting Price

    Azure DevOps Server

    Score8.2 out of 10
    N/AAzureDevOps Server (formerly Team Foundation Server, or TFS) is a test management and application lifecycle management tool, from Microsoft's Visual Studio offerings. To license Azure DevOps Server an Azure DevOps license and a Windows operating system license (e.g. Windows Server) for each machine running Azure DevOps Server.N/A

    TestRail

    Score6.6 out of 10
    N/ATestRail by Gurock, an IDERA company, is presented as a complete web-based test case management solution to manage, track, and organize your software testing efforts.

    $35

    per month billed annually

    Pricing
    Azure DevOps ServerTestRail
    Editions & Modules
    No answers on this topic
    Professional Cloud
    $35
    per month billed annually per user
    Professional Cloud
    $38
    per month per user
    Enterprise Cloud
    $71
    per month billed annually per user
    Offerings
    Pricing Offerings
    Azure DevOps ServerTestRail
    Free Trial
    NoYes
    Free/Freemium Version
    NoNo
    Premium Consulting/Integration Services
    NoNo
    Entry-level Setup FeeNo setup feeNo setup fee
    Additional Details——
    More Pricing Information
    Community Pulse
    Azure DevOps ServerTestRail
    Considered Both Products
    Microsoft
    No answer on this topic
    IDERA (an Idera, Inc. company)
    No answer on this topic
    Key User Insights
    Would buy again
    91%
    Would buy again
    20 Answers
    No answers on this topic
    Delivers good value for the price
    100%
    Delivers good value for the price
    18 Answers
    No answers on this topic
    Happy with the feature set
    91%
    Happy with the feature set
    20 Answers
    No answers on this topic
    Lived up to sales and marketing promises
    100%
    Lived up to sales and marketing promises
    13 Answers
    No answers on this topic
    Implementation went as expected
    100%
    Implementation went as expected
    15 Answers
    No answers on this topic
    Features
    Azure DevOps ServerTestRail
    Test Management
    Comparison of Test Management features of Azure DevOps Server and TestRail
    Feature
    Azure DevOps Server
    -
    Ratings
    TestRail
    7.5
    3 Ratings
    7% below category average
    Centralized test management00 Ratings7.73 Ratings
    Manage test hosts and schedules00 Ratings7.02 Ratings
    Map tests to user stories00 Ratings7.73 Ratings
    Test execution reporting00 Ratings8.13 Ratings
    Defect management00 Ratings7.02 Ratings
    Best Alternatives
    Azure DevOps ServerTestRail
    Small Businesses
    No answers on this topic
    No answers on this topic
    Medium-sized Companies
    Azure DevOps Services
    Score7.7 out of 10
    No answers on this topic
    Enterprises
    Azure DevOps Services
    Score7.7 out of 10
    No answers on this topic
    All AlternativesView all alternativesView all alternatives
    User Ratings
    Azure DevOps ServerTestRail
    Likelihood to Recommend
    9.0
    (48 ratings)
    7.6
    (3 ratings)
    Likelihood to Renew
    10.0
    (1 ratings)
    -
    (0 ratings)
    Usability
    6.0
    (4 ratings)
    7.0
    (1 ratings)
    Support Rating
    8.4
    (10 ratings)
    -
    (0 ratings)
    Implementation Rating
    8.0
    (1 ratings)
    -
    (0 ratings)
    Ease of integration
    9.0
    (2 ratings)
    -
    (0 ratings)
    User Testimonials
    Azure DevOps ServerTestRail
    Likelihood to Recommend
    Microsoft
    Azure DevOps is good to use if you are all-in on the Microsoft Azure stack. It's fully integrated across Azure so it is a point-and-click for most of what you will need to achieve. If you are new to Azure make sure you get some outside experience to help you otherwise it is very easy to overcomplicate things and go down the wrong track, or for you to manually create things that come out of the box.
    Incentivized
    Read full review
    IDERA (an Idera, Inc. company)
    The integration with other tools, and their user friendly layout and design. It's very comfortable to use and is way better than other tools with the Automation Testing tools, thanks to the great API that is included. Sometimes the integration with Jira is a little faulty, but the links to that tool usually work well. It could be cool if it had a better following for the bug items that were registered on other tools.
    Incentivized
    Read full review
    Pros
    Microsoft
    • Reporting Integration- Azure boards provides Kanban and other dashboard, their templates for easy management of project.
    • Project Pipeline- easy integration and development of CI/CD pipelines, helped in testing, releasing project artifacts.
    • Version Control- Integration with Git and code IDE made it easy to share, review our code, fix bugs and do testing.
    Incentivized
    Read full review
    IDERA (an Idera, Inc. company)
    • Managing test plans and test cases
    • Generation of test results
    • Modularised way of storing tests
    Incentivized
    Read full review
    Cons
    Microsoft
    • Can add more build templates for specific technology requirements
    • Can have more features in dashboards which can help dev teams stream line their tasks and priorities
    • Can have raise alarm feature in case of any sort of failure in devops pipeline execution
    Incentivized
    Read full review
    IDERA (an Idera, Inc. company)
    • Outstanding user bugs
    • UI is clunky
    • Things are not where you think they would be
    Incentivized
    Read full review
    Likelihood to Renew
    Microsoft
    Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.
    Incentivized
    Read full review
    IDERA (an Idera, Inc. company)
    No answers on this topic
    Usability
    Microsoft
    For standard users the interface is friendly. but if you are a manager some tools are a little confusing to use, like the query system that you always need to create from scratch. Templates should be more helpful for queries and for standard procedures that you need to duplicate PBIs over time. The search history of Work Items is a little painful to use.
    Incentivized
    Read full review
    IDERA (an Idera, Inc. company)
    As I am a tester, for me I found this tool to be new in terms of everything like the management of tests, plans, releases, reporting,etc. It is overall a good tool for test reporting and can be used for reference in the future. I liked several features of on the go placement of screenshots. Also I feel like the UI , the font, the color combination can be improved
    Incentivized
    Read full review
    Support Rating
    Microsoft
    I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus
    Incentivized
    Read full review
    IDERA (an Idera, Inc. company)
    No answers on this topic
    Implementation Rating
    Microsoft
    Do research beforehand and, if possible, do a trial run before implementing into production environment.
    Incentivized
    Read full review
    IDERA (an Idera, Inc. company)
    No answers on this topic
    Alternatives Considered
    Microsoft
    In my opinion, DevOps covers the development process end to end way better than Jira or GitHub. Both competitors are nice in their specific fields but DevOps provides a more comprehensive package in my opinion. It is still crazy to see that the whole suite can be used for free. The productivity increase we realized with DevOps is worth real money!
    Incentivized
    Read full review
    IDERA (an Idera, Inc. company)
    TestRail definitely saves times. I work in a company that consists of several development teams, all of which have different processes. Some of the teams leverage test cases, some do not. I've noticed that the turn around time it takes for me to pick up a ticket, QA it, and then pass/fail/send feedback is much faster when there is a test case created as I'm not reading through ticket description/comments to figure out what needs to be QA'd.
    Incentivized
    Read full review
    Return on Investment
    Microsoft
    • It has streamlined the pipeline and project management for our agile effort.
    • It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise.
    • The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization.
    Incentivized
    Read full review
    IDERA (an Idera, Inc. company)
    • We are able to easily pull reports any time management would like to see them
    • Jira integration makes it easy to attach to stories/defects and save time
    • A quick overview at the system's health as a whole is easy to see from TestRail
    Incentivized
    Read full review
    ScreenShots