Azure DevOps Server vs. CucumberStudio, from SmartBear

In our case it was best suited when we started working remotely, we were able to track everything in out projects easily, able to share our codes, give reviews for the codes and also create integration and deployment CI/CD plans for the release and testing. It helped our team members with the productivity, early prototyping and release. Create summarised reports of different aspect of our projects. Even in other scenarios it is one of the best tools to use for collaboration and project management. I haven't found any specific scenario where it is not appropriate

Incentivized

HipTest is good and helpful to create and run functional regressions but it is more complicated to use this tool to create and run API testing scenarios (it does not mean it can not be done). This tool is definitively not appropriate for running performance testing scenarios.

Incentivized

• Vast range of Template for Automated Build and Release Pipeline with option to have conditional triggers
• Code repository mechanism is aligned with GIT which is a well known public repository system
• Bug Management is also an integral feature of this tool
• Dashboard creation option of Build and Release pipeline is also available

Incentivized

• Good integration with Jira
• Includes integration with different tools for different porpuses
• You can build your own framework to automate scenarios and make it work with Hiptest

Incentivized

• Searching through code can be somewhat cumbersome. It would be nice if there was a way to do general searches in certain areas of the system.
• Without proper training, the system can be confusing to navigate. This issue can be prevented with good training but it is something to be aware of.
• Navigation can be clunky at times depending on where you are in the system. For power users, this is not a huge deal but it is a tad bit annoying.

Incentivized

• UX is not too obvious and easy (like generating a data table in a scenario or including a scenario in a test run) but you can get used to it relatively easy by playing around with the options, also the documentation is helpful.
• To get extra functionalities you have to pay for them separately.

Incentivized

Because we are a Microsoft Gold Partner we utilize most of their software and we have so much invested in Team Foundation Server now it would take a catastrophic amount of time and resources to switch to a different product.

Incentivized

For standard users the interface is friendly. but if you are a manager some tools are a little confusing to use, like the query system that you always need to create from scratch. Templates should be more helpful for queries and for standard procedures that you need to duplicate PBIs over time. The search history of Work Items is a little painful to use.

Incentivized

I have not had to use the support for Azure DevOps Server. There have never been any issues where I was not able to figure it out or quickly resolve. Our Scrum Master has used support before though, and the service has always been prompt and clear with a customer-focus

Incentivized

The tool includes a basic but complete documentation that can be very helpful to get started using the tool. The UX sometimes does not feel very easy to understand but after some use you can get familiar without reading the documentation. The webinars are not very useful for using the tool, I have seen a couple of them and they are actually focused on promoting their HipTest product to new users instead of being useful and educational for current users.

Incentivized

Do research beforehand and, if possible, do a trial run before implementing into production environment.

Incentivized

Azure DevOps is a fully integrated solution that solves all of the problems that our separate tools did in a much easier-to-use way. Before we implemented DevOps we had three different solutions that we had to integrate with each other and required a lot of manual intervention to make sure they worked correctly.

Incentivized

• It has streamlined the pipeline and project management for our agile effort.
• It has helped our agile team get organized since that is a new methodology being leveraged within the Enterprise.
• The calendar has improved visibility into different OOOs across the project team since we all come from different departments across the larger organization.

Incentivized

• It helps to have organization in our scenarios.
• It helps to get regressions done faster than doing it manually
• It helps to graphically see the progress and results of executions.

Incentivized