Katalon Studio is provided by the vendor as a free and robust automation solution for API, Web and Mobile testing. It is designed to eliminate the complexities of building an automation framework by integrating all necessary test components with built-in keywords and project templates. Katalon Studio includes a full feature set for a complete test automation process covering multiple platforms and testing types. New users can get started with test automation using its easy-to-use…
$69
per month
Sauce Labs
Score 6.3 out of 10
N/A
Sauce Labs is a cloud-based platform
for automated testing of desktop and mobile applications. It is designed to be instantly scalable, since it is optimized for continuous
integration workflows. (The vendor says that when tests are automated and run in parallel on
multiple virtual machines across many different browser, platform and device
combinations, testing time is reduced and developer time is freed up from
managing infrastructure.) The Sauce Labs testing cloud is intended to be paired…
$19
per month
Pricing
Katalon
Sauce Labs
Editions & Modules
Node Locked License
$69.00
per month
Floating License
$1,529.00
per year
Live Testing
$19.00
per month
Virtual Cloud
$149.00
per month
Offerings
Pricing Offerings
Katalon
Sauce Labs
Free Trial
Yes
Yes
Free/Freemium Version
Yes
Yes
Premium Consulting/Integration Services
No
No
Entry-level Setup Fee
No setup fee
Optional
Additional Details
Katalon Studio was originated from KMS Technology R&D. It has been a successful solution for numerous automation projects ranging from small team to enterprise client.
Katalon Studio is free for use, product development is funded by the testing services provided by KMS Technology. To support future releases, please consider subscribing to our business support services.
Free trial version is fine but you don't get the adequate support and VFM for the licensed version. Customer service needs to be improved a lot and any QA's with less technical background or less time to troubleshoot issues in the software on their own would find it difficult to use.
Access to specific devices is good, as well as access to a specific browser/platform. We are not able to connect our dev environments to Sauce Labs because the devices are put in our VPC. Some versions are not available like iPhone with iOS 12.1. With iOS, there is limited/no support for push notifications without real devices due to Apple's provisioning profiles.
Easy to setup and quick to get started: As Katalon comes with built-in features a new automation tester can automate easily. Script creation time is quick.
Test Analytics: Katalon also provides analytics which tells you the pattern of your automated tests at a different instance of time.
Third Party Integration: Katalon provides amazing integration with 3rd party tools like JIRA, ALM, GIT, JENKINS, etc.
Image-based testing: Katalon also provides inbuilt image based test automation.
Cost: it's a little bit pricey, but I don't pay the bill so I'm not complaining too much there. Overall, I'd say the price isn't ridiculous but it's not inexpensive.
Logs: I don't find their logs very useful for front-end web tests, I usually refer to my own logs if I have a bug/issue/error that needs investigation.
I love how it's super easy to use. Not only that but it ensures security and it always has great updates to ensure that it continues to be awesome. Also, I love how nice the people there are too. Their support tea is amazing. Anytime, I have a question, they are super speedy to answer.
I think Sauce Labs is great and I've been using them since late 2014. With that said, I'm very used to how their interface works and how to get what I need. I think if a brand new user would come in and use it, it would still be easy, but maybe not as easy as it is for me. That's why I rate this area a 9 instead of a 10. Still great though!
Yes, Sauce labs is always there, and it is easy to troubleshoot when you are having any connectivity issue, they always keep you informed when they plan to perform any type of maintenance window on their side in advance, so you can plan and will not affect your current work. I do not recall any outage.
The time where they acquired TestObject and were trying to integrate their services would probably be the most annoying time. Annoying as features were in two separate places (websites) for example. But since the introduction of their unified platform, we haven't run into any issues as of yet and we've used them for at least 5-6 years now.
I love the support. They have provided answers and solutions for most of our questions or doubts that could come up. They also have provided basic tutorials on how to get familiarized with the program.
The support is good for Sauce Labs. It is hard to get an initial response but the support has cleared our issues with Sauce Labs. Sometimes we have to follow up and it's hard to get a hold of the team initially. Once we get a hold of the team, the issues are always resolved.
I am not sure if it's my company that makes getting Sauce Labs integrated into the team difficult or is it Sauce Labs. The process for getting Sauce Labs for a project is quite a tedious process and the information for using Sauce Labs initially is quite lacking. There is little support for getting started
Initially, our oragnization had to integrate Katalon tests with the Jenkins to schedule the test runs. The reports were stored in company local database. To identify test flakiness or product issue one had to dig deep into the reports. This issue was all solved by Katalon TestOps. Katalon TestOps provides report history in one place and also helps in easy triage of the report by pointing out script flakiness
Firebase is pay per use and so was difficult to work out the true costings, it also felt more developer focussed whereas Sauce Labs had better Appium support for our Automation team. AWS Device Farm appeared to require either Android or iOS and we wanted both, so that wasn't a great fit. It was also not possible to run Cucumber tests on Android in AWS but this may no longer be the case, but it was another unknown for us and not worth the risk. Sauce Labs explicitly mentioned Cucumber support.
With private devices, you have full reign over usage of them, so no complaints there. Public devices are available if no one else is using it, which is understandable. Browser VMs are based on number of open sessions and Saucelabs give you a certain number depending on what you need. If you need more, then you pay for more. It is as simple as that. You need more devices, then you can pay for more private ones too. A workaround for public devices is to pick the first available one and not be too picky, that's if you are able to of course.
Support can be better: As mentioned before, katlon community is still growing but is currently a small community. If you are stuck, its hard to find help in the community and one has to reach out to the support for help. This takes a while before you can get solution to your problem.
Result upload takes little longer time: It is been observed that uploading tests results takes little longer.
Sometimes it gets hard to integrate: Since this is fairly a new tool, requires lot of learning curve to get the job done effectively.
Provided an ability for us to run 55,000+ tests/month across all browsers.
Gave us an opportunity to showcase the great things we have done in quality using Sauce Labs. This was through a white paper and an opportunity to speak at Sauce Con. People in our company have a far better appreciation for the what we do and how far we have progressed in the quality space.
