Go back to blog listing

The Top 10 New Web UI Testing Tools Everyone's Talking About

Blog Graphicsv5-33
At least a dozen brand new UI test automation tools have surfaced in the last few years. Since every tool has its own focus and strategy, it can be hard to know where to start. Looking for more guidance? Check out the top new UI testing tools below.

As any UI tester could contest, UI testing is relatively straightforward, as long as nothing in your GUI changes, but the problem is... things change all the time. Depending on the solution you’ve chosen for UI testing, changing conditions can either be a revolutionary experience with self-healing and AI locators, or an abysmal failure of convoluted manual workflows.

In an effort to achieve the former vs the latter, I've reviewed the top 10 new (or newish) UI testing tools that you should look at. (I also shared over here some great questions to ask yourself when evaluating UI testing tools, to make sure you end up with a tool that's the right fit and that can achieve what you need.)

Whichever tool you choose, all of these UI testing tools have great usability features and have put the user experience at the forefront.

1. Parasoft SelenicParasoft Selenic

Designed for: Existing Selenium users who are wasting too much

Pricing: Annual Subscription for Project and/or Teams

Pros:

  • Smart recorder makes it easy to create Selenium tests that use the page object model
  • Can execute self-healing on existing Selenium tests and recommends smart locators on existing Selenium tests
  • Integrates directly into your CI/CD pipeline by leveraging your existing Selenium scripts or creating new Selenium scripts
  • Provides test impact analysis technology to automatically identify which Selenium tests need to be executed in the CI/CD pipeline to validate new code changes
  • Provides customer support at every level (not just enterprise)

Cons:

  • No free version (just a free trial)
  • Product is still relatively new and the current version only supports Java, JUnit 4 and Eclipse (Cucumber, JUnit 5, TestNG, and IntelliJ on the roadmap for 2019 & 2020)

Key takeaways: AI-powered recommendations for your existing selenium tests make it easy to add this solution to your existing Selenium practice right away. As evidenced in Gartner Peer Insights, one of the best benefits of the solution is Parasoft’s world-class customer support, which has been recognized countless times and has supported over 30 years of software testing product innovation.

2. Katalon

Katalon

Designed for: Users looking for a middle ground between codeand codeless testing tools.

For a free tool, Katalon does a lot, and is used heavily by system integrators for UI testing. Its recorder plugs into the Chrome browser so you can generate test cases, and then the tool builds them in the Katalon IDE using the page object model, so they are highly maintainable. At any point you can execute your tests directly in their IDE, or export them to many different types of test scripts.

Pricing: Free for the basic Katalon Studio (with paid plugins available as subscriptions through the marketplace). Enterprise support is available (but can get quite expensive)

Pros:

  • Recommends smart locators
  • Uses the page object model (but only for the tests generated and managed within the IDE)
  • Has a self-healing capability (via a paid plug-in)
  • Ability to export to many different types of test scripts

Cons:

  • Although you can export your tests as Selenium and other test scripts, once you’ve exported you lose all the usability of Katalon and the export doesn’t include the page object model, which means the tests become hard to reuse and maintain
  • Their customer support is only available at the enterprise level, and is very expensive
  • Doesn’t directly integrate into your existing execution framework (uses a proprietary framework, with CI integrations available as plugins)

Key takeaways: Users can start using Katalon without having any technical knowledge, creating test cases quickly thanks to the keywords in the program. It’s free to get going with Katalon Studio, but to get the benefit of some of those exciting innovative technologies, you’ll have to upgrade or purchase paid plugins.

3. Selenium IDE

Selenium IDE

Designed for: Users that are looking for a UI driven record-and-playback tool.

Selenium IDE is an open-source project that harnesses the power of Selenium into a Chrome plug-in, and makes it available for free. Getting started with Selenium IDE requires no additional setup other than installing the extension on your browser, aligning with the project’s driving philosophy of providing a tool that’s easy to use and gives instant feedback.

Pricing: Free

Pros:

  • Users can export any created test into a script, making it an incredibly powerful tool for UI test creation
  • Offers multiple locator strategies for each element it records
  • Has a self-healing feature (but doesn’t work on Selenium scripts outside of the Selenium IDE, and isn’t as reliable as self-healing features from other solutions)

Cons:

  • Does not fit directly into your CI/CD process
  • Buggy and a blackbox (when something doesn’t get recorded you are pretty much stuck and have to export out into code to figure out what’s going on)
  • Doesn’t use the page object model when building tests
  • While you can export your tests in many different languages, there’s no ability to import at this time
  • While they offer CI integrations, it is not directly integrated into your existing framework

Key takeaways: Selenium IDE is simple to use, giving users the ability to rapidly create tests against their Web UIs. It is very Selenium friendly and will feel natural for those accustomed to the framework.

4. mabl

MablDesigned for: Teams who aren't interested in writing tests and don’t want to establish a UI testing practice, meaning that you hand over the majority of the work to mabl.

mabl has a very different approach to UI testing – it’s less about tests and more about journeys. You log into their website, define a journey through your application, and then that’s it. They don’t really give you a test case or anything to really work on. From that point, they will allow you to periodically run that test and receive results about its successful execution.

Pricing: Tiered pricing based on number of journeys executed

Pros:

  • Recommends smart locators (but it’s a bit obscured from the user)
  • Self-healing feature works very well
  • SaaS solution; easy to access and get started
  • Scalable pricing model

Cons:

  • Doesn’t use the page object model when recording journeys
  • Uses its own framework, and there is no import and export of the test scripts
  • While CI integrations exist, you can’t directly integrate the solution into your existing framework
  • If something doesn’t work the way you intended, it’s really difficult to get access to "code" to configure or manipulate
  • The focus on "journeys" makes the creation of "functional validation" (i.e. test with assertions) feel awkward
  • SaaS-only solution; no on-premise deployment and no ability to access an application not available in the public internet

Key takeaways: mabl helps users improve the speed and quality of their release pipeline, with sophisticated auto-healing that keeps automation stable, regardless of changes to the application’s UI. mabl does what it does and the human takes a back seat to its prescribed analytics, so essentially you hand over your journeys to mabl and hope for the best. For some, that is great, but for others, that might be handing off too much control.

5. TestIM

testimDesigned for: Organizations looking for an out-of-the-box solution for UI testing that focuses on execution paths for complex workflows.

TestIM is a SaaS application, created by developers who realized that while they were spending time and energy maintaining automated testing environments, they were still anxious about how a simple bug fix might break another part of the application. So they created this incredibly easy-to-use solution for UI testing.

Pricing: Annual subscription based of number of tests executed

Pros:

  • Tests are incredibly easy to create, with an intuitive user interface
  • Recommends smart locators, along with a great strategy for maintaining them
  • Has an impressive self-healing capability as part of their Smart Locator technology

Cons:

  • Doesn’t use the page object model in their tests
  • Lacks ability to import/export test scripts
  • Users can’t get access to code or take tests out of TestIM
  • Vendor-locked framework -- scripts are in the TestIM framework

Key takeaways: It’s very easy to get access to the TestIM technology, and very easy to create a test case that works right, out-of-the-box. The sleek user experience makes self-healing look like magic (If I want a solution to improve my own user experience, I can probably trust a solution with a great user experience, itself, right?), but the main challenge with TestIM is that there’s no way to get access to the tests. Since all of the tests are in the TestIM framework, you’re at the mercy of their infrastructure, business model, and whatever happens with the company in the future.

6. Functionize

functionizeDesigned for: Manual testers or non-technical testers who are getting into BDD (they call it “ALP”) as a function of UI testing.

Functionize provides all the features you would expect from a full web UI testing tool, but with some additional advancements around locator strategy, including an autonomous testing pitch where tests can be created by simply using the application. This is all accomplished in their proprietary framework.

Pricing: No pricing information publicly available

Pros:

  • Excellent visual display of test flow
  • Recommends multiple locators for elements
  • Has a self-healing capability

Cons:

  • Doesn’t use the page object model
  • Vendor-locked framework
  • No import/export of test scripts

Key takeaways: Functionize’s AI seems to be capable of delivering on the organization’s promise to remove test churn, increasing the accuracy and efficiency of testers. But beware of vendor-lock here, as you consider how you might bring it into the flow.

7. Perfecto

PerfectoDesigned for: Users looking for a one-stop-shop for UI and mobile testing. Because it's scriptless, it is best suited for those looking to not write code.

Perfecto has been around for a while, and they’ve heavily focused on mobile testing, but they have a nice UI testing ecosystem that enables creation, maintenance, cloud execution, and reporting.

Price: Between $99 and $3588+ for an annual subscription

Pros:

  • Uses the page object model (but only in their generated tests)

  • Provides multiple locators for recorded web elements

  • Recently introduced self-healing (although it’s a little unclear what it does or how well it performs, and therefore how useful it is)

Cons:

  • Test scripts are in a proprietary TCL-based language
  • You can’t import your own Selenium scripts
  • While they offer CI integrations, it is not directly integrated into your existing framework

Key takeaways: Perfecto provides solutions around maintaining and writing test scripts, managing and validating tests, and debugging defects. Perfecto’s UI testing solution gives users the option of scripted or scriptless creation, and they have recently added new features around maintenance and self-healing.

8. Test Craft

TestCraftDesigned for: Users who do not want to write code and are looking for advanced analytics to continuously validate their tests.

TestCraft is a codeless Selenium test automation platform, with AI technology and unique visual modeling claiming to enable faster test creation and execution while eliminating test maintenance overhead.

Pricing: No pricing information publicly available

Pros:

  • Uses the page object model (but only in their generated tests)
  • Recommends smart locators, called “smart bindings”
  • Self-healing is a part of their smart binding technology
  • A built-in scheduler allows users to execute test flows periodically over time

Cons:

  • Uses a proprietary framework
  • You can’t import/export test scripts
  • Doesn’t directly integrate into your existing framework (CI integrations are available as plugins)

Key takeaways: TestCraft is a powerful SaaS application that enables testers to create fully automated test scenarios without coding. Users record their test cases on the UI and from that, TestCraft will create a model for every test flow, with a visual indication of the different paths that your test will execute. This makes it approachable for users that have complex usage patterns.

9. Ranorex Webtestit

webtestitDesigned for: Coders who are looking for assistance with creating Selenium scripts. They are familiar with the code, and want to build more structured scripts, but don’t want to spend time building the scaffolding themselves.

Webtestit is a brand new offering from Ranorex (released July 2019), a company known for their desktop automation tools. It’s code, pure code, and Ranorex has taken a “design first” approach rather than record-and-playback. You can interact with your user interface and build your scripts through helper actions in their proprietary IDE. It's still a little unclear where Ranorex Studio stops and Webtestit begins, but this should become clearer over time.

Pricing: $40/month subscription

Pros:

  • Uses the page object model for test creation
  • Recommends locators through their Selocity Chrome plugin which is available for free (but you might want to also check out TruePath). You can import your Selenium scripts (Selenium IDE import coming soon)
  • Great helper actions during test creation within the IDE

Cons:

  • No record-and-playback functionality (record and playback isn’t perfect but it’s a critical component to get started)
  • Proprietary IDE - meaning developers have to ditch their IDE of choice (i.e. Eclipse or IntelliJ)
  • Uses a proprietary execution framework so it needs their plugin for execution as part of CI
  • Just a solution for test creation -- no analysis at runtime, or self-healing capabilities

Key takeaways: Organizations looking to have an assistive tool for code creation will likely find this solution useful. Without record-and-playback, users are encouraged to build from the bottom-up rather than top-down. In combination with their Selocity Chrome plug-in, users can draw out pages as objects and import them into the webtestit tool, making it very friendly for those looking to use the page object model.

10. AutonomIQ

autonomiqDesigned for: Users looking for an interesting hybrid between code and codeless solutions. (There’s code, but it’s aided by natural language processing.)

AutonomIQ has a powerful message around AI and machine learning, but what does it do? The tool provides a three-step process for UI test automation. It begins by discovering your application through its AI, and then building test cases from that discovery process. The third step is using their analytics engine to monitor and maintain the test cases.

Pricing: No pricing information publicly available

Pros:

  • Strong NLP, AI and ML
  • Uses the page object model (but only in their generated tests)
  • Recommends smart locators, through their Chrome Plug-in
  • Self-healing in their execution

Cons:

  • Uses a proprietary framework
  • You can’t import test scripts
  • Doesn’t directly integrate into your existing framework (CI integrations are available as plugins)
  • Not entirely proven technology

Key takeaways: It seems like this technology has it all and does it all. So why is it at the very bottom of my list? Because I haven’t been able to find a customer of theirs with any real case studies or usage. But if their solution can get to the potential results, it could be quite disruptive.

 

New call-to-action

Stay up to date