Katalon vs. Ranorex Studio

Free trial version is fine but you don't get the adequate support and VFM for the licensed version. Customer service needs to be improved a lot and any QA's with less technical background or less time to troubleshoot issues in the software on their own would find it difficult to use.

Although the first year with Ranorex was fine and increased our productivity overall, the first problem that appeared after the standard support period expired gave the whole cooperation a bad taste. Apart from the fact that if you don't buy support continuously and the problem appears after a year and a half, for example, you have to buy support for the whole past period just to get someone to talk to you, after buying support and reporting the problem it took them half a year to even get to the problem analysis during which we were without a working application. Several times we had to tediously report the same problem over and over again as we were shuffled around by support teams who had no continuity for our support case. And when our support expired again for a period during which we could not use the program, Ranorex referred us to another support purchase, still without a working solution. This is totally unacceptable and definitely not a pro-customer approach.

• Easy to setup and quick to get started: As Katalon comes with built-in features a new automation tester can automate easily. Script creation time is quick.
• Test Analytics: Katalon also provides analytics which tells you the pattern of your automated tests at a different instance of time.
• Third Party Integration: Katalon provides amazing integration with 3rd party tools like JIRA, ALM, GIT, JENKINS, etc.
• Image-based testing: Katalon also provides inbuilt image based test automation.

Incentivized

• Initial setup.
• User guide.
• Getting money from customers.

• Katalon Studio supports only grovvy language for now. It will be nice to see support for other scripting languages.
• Performance issues; sudden crash of the tool.
• Debug button is provided only to licensed owner since Katalon 7+ version.
• New tool, few resources available to learn. So there is a mild learning curve here.

Incentivized

• Language support is limited, c# and Vb.net only if i remember correctly compared to other tools which allow many more. This addition would certainly be appreciated if added on in a company like mine with a variety of differently skilled individuals
• Paid license. This is not always preferred. A free version without a limited trial but maybe limited features would be appreciated.

Incentivized

Due to the slowness, there is an intermediate timeout. There is no other problem.

Incentivized

I love the support. They have provided answers and solutions for most of our questions or doubts that could come up. They also have provided basic tutorials on how to get familiarized with the program.

Incentivized

I suppose my experience is sort of mixed. Help documents are substantially helpful. I personally have not got the quickest responses from Ranorex support but at the same time, they are pretty good with updating their users frequently with info about their product/s and features. The community is really where I find support and I suppose that could look to be an extension of the product itself.

Incentivized

Initially, our oragnization had to integrate Katalon tests with the Jenkins to schedule the test runs. The reports were stored in company local database. To identify test flakiness or product issue one had to dig deep into the reports. This issue was all solved by Katalon TestOps. Katalon TestOps provides report history in one place and also helps in easy triage of the report by pointing out script flakiness

Incentivized

We have used Selenium as well. This has picked up more steam than Ranorex if i have to be honest.

Incentivized

• Support can be better: As mentioned before, katlon community is still growing but is currently a small community. If you are stuck, its hard to find help in the community and one has to reach out to the support for help. This takes a while before you can get solution to your problem.
• Result upload takes little longer time: It is been observed that uploading tests results takes little longer.
• Sometimes it gets hard to integrate: Since this is fairly a new tool, requires lot of learning curve to get the job done effectively.

Incentivized

• Reducing testing time is directly saving money if time is considered money.
• Allowing less skilled users the ability to automate testing from the get-go because of Ranorex's ease of use and G.U.I. This of course positively affects a project and assists with user upskilling passively at least.

Incentivized