GitLab vs. CucumberStudio, from SmartBear

Overview
ProductRatingMost Used ByProduct SummaryStarting Price
GitLab
Score 8.7 out of 10
N/A
GitLab DevSecOps platform enables software innovation by aiming to empower development, security, and operations teams to build better software, faster. With GitLab, teams can create, deliver, and manage code quickly and continuously instead of managing disparate tools and scripts. GitLab helps teams across the complete DevSecOps lifecycle, from developing, securing, and deploying software. Differentiators, as described by Gitlab: Simplicity: With GitLab, DevSecOps can…
$0
per month per user
CucumberStudio
Score 4.9 out of 10
N/A
CucumberStudio, now a SmartBear product since the 2019 acquisition, is a continuous testing platform replacing the former HipTest, supporting agile development with manual and automated code testing, reusable steps, feature history with living documentation, among other features.N/A
Pricing
GitLabCucumberStudio, from SmartBear
Editions & Modules
GitLab Essential
$0
per month per user
GitLab Premium
$29
per month per user
GitLab Ultimate
$99
per month per user
No answers on this topic
Offerings
Pricing Offerings
GitLabCucumberStudio
Free Trial
YesNo
Free/Freemium Version
YesNo
Premium Consulting/Integration Services
NoNo
Entry-level Setup FeeOptionalNo setup fee
Additional Details
More Pricing Information
Community Pulse
GitLabCucumberStudio, from SmartBear
Best Alternatives
GitLabCucumberStudio, from SmartBear
Small Businesses

No answers on this topic

GitLab
GitLab
Score 8.7 out of 10
Medium-sized Companies
Veracode
Veracode
Score 8.7 out of 10
Planview AgilePlace
Planview AgilePlace
Score 9.9 out of 10
Enterprises
Veracode
Veracode
Score 8.7 out of 10
Planview AgilePlace
Planview AgilePlace
Score 9.9 out of 10
All AlternativesView all alternativesView all alternatives
User Ratings
GitLabCucumberStudio, from SmartBear
Likelihood to Recommend
8.8
(0 ratings)
9.0
(0 ratings)
Likelihood to Renew
9.9
(0 ratings)
-
(0 ratings)
Usability
9.0
(0 ratings)
-
(0 ratings)
Support Rating
9.1
(0 ratings)
9.0
(0 ratings)
User Testimonials
GitLabCucumberStudio, from SmartBear
Likelihood to Recommend
It is well-suited for any project that needs VCS. It's an excellent choice for teams that might be remote or have to collaborate across teams. Plenty of features allow for async working. With its dashboards and reporting features, it is also suitable for nontechnical PMs or stakeholders. It allows for very bespoke customization and can most often do much more than you need it to.
Read full review
HipTest is good and helpful to create and run functional regressions but it is more complicated to use this tool to create and run API testing scenarios (it does not mean it can not be done). This tool is definitively not appropriate for running performance testing scenarios.
Read full review
Pros
  • GitLab excels in managing code versions, allowing easy tracking of changes, branch management, and merging contributions.
  • It helps maintain code stability and reliability, saving time and effort in the development or research workflow.
  • Powerful code review features, enabling collaboration and feedback among team members.
  • Robust project management features, including issue tracking, kanban boards, and milestones.
Read full review
  • Good integration with Jira
  • Includes integration with different tools for different porpuses
  • You can build your own framework to automate scenarios and make it work with Hiptest
Read full review
Cons
  • CI variables management is sometimes hard to use, for example, with File type variables. The scope of each variable is also hard to guess.
  • Access Token: there are too many types (Personal, Project, global..), and it is hard to identify the scope and where it comes from once created.
  • Runners: auto-scaled runners are for the moment hard to put in place, and monitoring is not easy.
Read full review
  • UX is not too obvious and easy (like generating a data table in a scenario or including a scenario in a test run) but you can get used to it relatively easy by playing around with the options, also the documentation is helpful.
  • To get extra functionalities you have to pay for them separately.
Read full review
Likelihood to Renew
I really feel the platform has matured quite faster than others, and it is always at the top of its game compared to the different vendors like GitHub, Azure pipelines, CircleCI, Travis, Jenkins. Since it provides, agents, CI/CD, repository hosting, Secrets management, user management, and Single Sign on; among other features
Read full review
No answers on this topic
Usability
I find it easy to use, I haven't had to do the integration work, so that's why it is a 9/10, cause I can't speak to how easy that part was or the initial set up, but day to day use is great!
Read full review
No answers on this topic
Reliability and Availability
I've never had experienced outages from GItlab itself, but regarding the code I have deployed to Gitlab, the history helps a lot to trace the cause of the issue or performing a rollback to go back to a working version
Read full review
No answers on this topic
Performance
GItlab reponsiveness is amazing, has never left me IDLE. I've never had issues even with complex projects. I have not experienced any issues when integrating it with agents for example or SSO
Read full review
No answers on this topic
Support Rating
At this point, I do not have much experience with Gitlab support as I have never had to engage them. They have documentation that is helpful, not quite as extensive as other documentation, but helpful nonetheless. They also seem to be relatively responsive on social media platforms (twitter) and really thrived when GitHub was acquired by Microsoft
Read full review
The tool includes a basic but complete documentation that can be very helpful to get started using the tool. The UX sometimes does not feel very easy to understand but after some use you can get familiar without reading the documentation. The webinars are not very useful for using the tool, I have seen a couple of them and they are actually focused on promoting their HipTest product to new users instead of being useful and educational for current users.
Read full review
Alternatives Considered
GitHub is an inferior product from most points of view. We had to use it and the teams finds no positives about it. Everything is a downgrade from our previous GitLab solution. GitLab CI\CD is vastly superior to workflows, for example doing a manual node is just "when : manual" in GitLab while you have to do clickops in GitHub to achieve the same. No overview of code in branches is a minus when we tried to figure out what our colleagues are trying to merge as it looked off.
Read full review
No answers on this topic
Scalability
I think is very well designed, and like any VCS it works as intended
Read full review
No answers on this topic
Return on Investment
  • GitLab cut down our spent on container, package and infrastructure registry
  • Best thing is we can now have everything in single platform which cost effective too
  • Quality of support is really good and they do have emergency support team as well which is great
Read full review
  • It helps to have organization in our scenarios.
  • It helps to get regressions done faster than doing it manually
  • It helps to graphically see the progress and results of executions.
Read full review
ScreenShots

GitLab Screenshots

Screenshot of GitLab, a comprehensive DevSecOps platform.Screenshot of Security DashboardScreenshot of Merge Request

CucumberStudio Screenshots

Screenshot of CucumberStudio empowers the whole team to read and refine executable specifications without needing technical tools. Business and technology teams can collaborate on acceptance criteria and bridge their gap.