AutomationNG vs. Azure DevOps Server

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
AutomationNG
Score 7.9 out of 10
N/A
Indecomm Global Services headquartered in New Jersey offers AutomationNG, a test automation and test management platform.N/A
Azure DevOps Server
Score 8.2 out of 10
N/A
AzureDevOps Server (formerly Team Foundation Server, or TFS) is a test management and application lifecycle management tool, from Microsoft's Visual Studio offerings. To license Azure DevOps Server an Azure DevOps license and a Windows operating system license (e.g. Windows Server) for each machine running Azure DevOps Server.N/A
Pricing
AutomationNGAzure DevOps Server
Editions & Modules
No answers on this topic
No answers on this topic
Offerings
Pricing Offerings
AutomationNGAzure DevOps Server
Free Trial
NoNo
Free/Freemium Version
NoNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeNo setup feeNo setup fee
Additional Details
More Pricing Information
Community Pulse
AutomationNGAzure DevOps Server
Features
AutomationNGAzure DevOps Server
Test Management
Comparison of Test Management features of Product A and Product B
AutomationNG
7.4
Ratings
8% below category average
Azure DevOps Server
-
Ratings
Centralized test management8.00 Ratings00 Ratings
Manage test hosts and schedules7.00 Ratings00 Ratings
Map tests to user stories9.00 Ratings00 Ratings
Test execution reporting5.00 Ratings00 Ratings
Defect management8.00 Ratings00 Ratings
Best Alternatives
AutomationNGAzure DevOps Server
Small Businesses
BrowserStack
BrowserStack
Score 8.6 out of 10
GitHub
GitHub
Score 9.0 out of 10
Medium-sized Companies
OpenText ALM/Quality Center
OpenText ALM/Quality Center
Score 8.0 out of 10
GitHub
GitHub
Score 9.0 out of 10
Enterprises
OpenText ALM/Quality Center
OpenText ALM/Quality Center
Score 8.0 out of 10
Perforce P4
Perforce P4
Score 7.7 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
AutomationNGAzure DevOps Server
Likelihood to Recommend
8.0
(0 ratings)
9.0
(0 ratings)
Likelihood to Renew
-
(0 ratings)
10.0
(0 ratings)
Usability
-
(0 ratings)
6.0
(0 ratings)
Support Rating
-
(0 ratings)
8.4
(0 ratings)
Implementation Rating
-
(0 ratings)
8.0
(0 ratings)
Ease of integration
-
(0 ratings)
9.0
(0 ratings)
User Testimonials
AutomationNGAzure DevOps Server
Likelihood to Recommend
AutomationNG is best suited for people with no programming language at all. It is easy to write tests and execute. Cross browser testing feature is the best part of this app. Cross browser testing can be tricky in other tools, but this app handles it very graciously. However, the tests are executed slowly compared to other tools like selenium but that requires programming knowledge
Read full review
In our case it was best suited when we started working remotely, we were able to track everything in out projects easily, able to share our codes, give reviews for the codes and also create integration and deployment CI/CD plans for the release and testing. It helped our team members with the productivity, early prototyping and release. Create summarised reports of different aspect of our projects. Even in other scenarios it is one of the best tools to use for collaboration and project management. I haven't found any specific scenario where it is not appropriate
Read full review
Pros
  • Doesnt require any programming knowledge
  • Test cases are written in simple English-like
  • Cross browser testing is supported and is easy to perform
  • Integration with Jira
  • Takes significantly less time to write test scripts
Read full review
  • Vast range of Template for Automated Build and Release Pipeline with option to have conditional triggers
  • Code repository mechanism is aligned with GIT which is a well known public repository system
  • Bug Management is also an integral feature of this tool
  • Dashboard creation option of Build and Release pipeline is also available
Read full review
Cons
  • UI is pretty outdated and needs major revamp
  • Test results UI can be improved
  • Speed of automation can be improved
Read full review
  • Searching through code can be somewhat cumbersome. It would be nice if there was a way to do general searches in certain areas of the system.
  • Without proper training, the system can be confusing to navigate. This issue can be prevented with good training but it is something to be aware of.
  • Navigation can be clunky at times depending on where you are in the system. For power users, this is not a huge deal but it is a tad bit annoying.
Read full review
Likelihood to Renew
No answers on this topic
Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.
Read full review
Usability
No answers on this topic
For standard users the interface is friendly. but if you are a manager some tools are a little confusing to use, like the query system that you always need to create from scratch. Templates should be more helpful for queries and for standard procedures that you need to duplicate PBIs over time. The search history of Work Items is a little painful to use.
Read full review
Support Rating
No answers on this topic
I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus
Read full review
Implementation Rating
No answers on this topic
Do research beforehand and, if possible, do a trial run before implementing into production environment.
Read full review
Alternatives Considered
No answers on this topic
Azure DevOps is a fully integrated solution that solves all of the problems that our separate tools did in a much easier-to-use way. Before we implemented DevOps we had three different solutions that we had to integrate with each other and required a lot of manual intervention to make sure they worked correctly.
Read full review
Return on Investment
  • Easy to write the test cases hence saves lot of time.
  • Helps us to manage the tests and identify bugs quite early
  • Cross browser testing is a major feature
Read full review
  • It has streamlined the pipeline and project management for our agile effort.
  • It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise.
  • The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization.
Read full review
ScreenShots