awesome-regression-testing

Regression testing toolbox

A curated collection of resources and tools for verifying software changes have not introduced new faults.

🕶️ A curated list of resources around the topic: visual regression testing

GitHub
2k stars
71 watching
172 forks
last commit: 5 months ago
Linked from 3 awesome lists

awesomeawesome-listhacktoberfestphantomcssphantomjsregression-testsseleniumvisual-regression

Awesome Visual Regression Testing / General information
Wikipedia: Regression testing
Survey of screenshot-based CSS testing tools

Awesome Visual Regression Testing / Browser automation
Selenium 30,751 6 days ago Browser automation framework and ecosystem
SlimerJS 3,003 over 1 year ago Scriptable browser like PhantomJS, based on Firefox
Webdriver.io 9,074 6 days ago Node.js bindings implementation for the W3C WebDriver protocol
Cypress.io An automation framework that runs in-browser

Awesome Visual Regression Testing / Tools and frameworks
OSnap 151 about 2 months ago The speedy and easy to use Snapshot Testing tool for your project (1200 snapshots will run in under 3 minutes)
basset Open source platform for generating and reviewing visual differences. Supports multiple browsers, integrations for github and slack
AyeSpy 206 6 months ago 44 image comparisons in 90 seconds
Wraith 4,837 almost 2 years ago Easy to use ruby tool with docker support
BackstopJS 6,805 2 months ago Config-driven automated screenshot test framework
Galen 1,412 over 2 years ago Java framework based on
Creevey 387 3 days ago Cross-browser visual testing with magic. Feature-rich tool with UI Runner, Tests Hot Reloading, Docker and Storybook integration
CSSCritic 486 almost 2 years ago Lightweight CSS regression testing
Spectre 458 over 2 years ago Provides image comparison capabilities and an admin interface for managing screenshots
Shoov 38 almost 6 years ago UI regression and functional testing focused on Drupal 7 sites
qd_screenshottests CasperJS-based UI regression and functional testing focused on Drupal 8 sites
Look-alike 33 over 6 years ago Chrome Extension for taking and comparing screenshots
Hardy 323 over 9 years ago Selenium-driven, cucumber-powered CSS testing
TestCafe 9,822 9 days ago Automated browser testing for the modern web development stack
Needle 590 about 2 years ago Needle is a tool for testing visuals with Selenium and nose (Python)
gatling 55 over 11 years ago Integrated visual RSpec matcher which makes real visual testing easy (Ruby)
grunt-photobox 277 over 8 years ago Plugin to prevent your project of broken layout via screenshot photo sessions of your site
vrtest 14 over 7 years ago JavaScript library for running visual regression tests on your components cross browser via selenium
Happo 197 20 days ago Visual diffing in CI for user interfaces
reg-cli 354 8 days ago Visual regression test tool which output easy-to-read single file html report
Nightmare 19,548 7 months ago High-level browser automation library based on Electron
Puppeteer 88,848 7 days ago Headless Google Chrome Node API
Playwright 66,974 6 days ago Node library to automate Chromium, Firefox and WebKit with a single API
reg-suit 1,180 18 days ago Visual regression testing suite which compares images, stores snapshots, and notifies the difference to your GitHub repo
Chimp 798 about 1 year ago Develop acceptance tests & end-to-end tests with realtime feedback
Differencify 634 over 4 years ago A library for visual regression testing using
ResembleJS 4,514 10 months ago Analyse and compare images with Javascript and HTML5
Muppeteer 66 over 3 years ago Visual regression testing framework for Chrome using and
ember-visual-test 25 10 months ago Simple visual regression testing for
AET 146 10 months ago Scalable testing tool providing visual regression testing, accessibility and performance validation, markup analysis and more
Wendigo 149 9 months ago Test-oriented browser automation library based on Puppeteer
Loki 1,786 about 1 month ago Visual regression testing for Storybook using Chrome in docker et al
Zombie.js Insanely fast, headless full-stack testing using Node.js
CodeceptJS 4,114 6 days ago Modern Era Acceptance Testing Framework for NodeJS
FuncUnit 571 over 3 years ago A functional test suite based on jQuery
Nightwatch 11,837 10 days ago Automated testing and continuous integration framework based on Node.js and using the Webdriver protocol
Protractor 8,746 over 1 year ago E2E test framework for Angular apps
jest-puppeteer-react 71 29 days ago Visual regression testing with Jest and puppeteer for React components
jest-image-snapshot 3,839 4 months ago Jest matcher that performs image comparisons using
test-crawler 32 almost 3 years ago Visual regression testing, by crawling a website and providing snapshot comparison reports
wdio-visual-regression 3 about 1 year ago Visual regression tool for webdriver.io
Selenide 1,833 6 days ago Framework powered by Selenium WebDriver for writing easy-to-read and easy-to-maintain automated tests in Java
Karma A test runner by the AngularJS team, that fits all our needs
Touca 495 4 months ago Open source continuous regression testing without the hassle of managing snapshot files
Lost Pixel 1,355 7 days ago Holistic visual regression testing for full pages, components (via Storybook and Ladle integration), and custom shots (e.g. via Cypress)

Awesome Visual Regression Testing / Online services
Pixeleye Open-source, multi-browser visual review and testing platform with the option to self-host. It has first-class support for Storybook, Cypress, Playwright & Puppeteer
BrowserStack Free for Open Source. Supports
BugBug.io Lightweight test automation tool for web applications. Easy to learn and doesn't require coding. It's free, with unlimited tests. For an additional monthly fee, you also get cloud monitoring and CI/CD integration
HeadSpin HeadSpin's Regression testing gives you a powerful comparison tool for analysing degradation across new app builds, OS releases, feature additions, locations, and more
TestGrid Perform End to End test automation be it cross browser testing, mobile app testing, performance testing or API testing on cloud or on-premise
LambdaTest Perform Automated and Live Interactive Cross Browser Testing on 2000+ Real Browsers and Operating Systems Online
screener.io For React, looks open source
applitools Cloud base visual tests
percy.io Continuous visual reviews for web apps
screenster.io Cloud based automation testing platform for web and mobile UI
browserling LIVE interactive cross-browser testing
Browser Shots Screenshots only
Ghost Inspector See
CrossBrowserTesting Manual & exploratory testing on 1500+ real browsers and mobile devices
Argos-CI Automate visual regression testing
Diffy Cloud based visual regression tool. Uses puppeteer and proprietary comparison algorithm (detect layout shifts). Great scalability with AWS Lambda
Chromatic Visual testing and UI review for component libraries. Cloud-based
VisWiz.io Flexible visual regression testing service
Happo Cloud-based screenshot testing service with support for multiple browsers
Visual Knight Cloud-based visual testing platform with realtime results for testing tools
Axcept Testing for the whole team. Up to 100 tests in parallel. Endpoint Mocking. Code Coverage
Fluxguard Screenshot pixel and DOM change comparisons and regressions
Vidiff Cloud-based visual regression testing across stages
Reflect Visual regression testing and test automation tool
Visual Regression Tracker 604 4 months ago Open Source selfhosted service for visual regression testing
Micoo 191 over 1 year ago Open source service for all UI application visual regression solution
TestingBot Provides +3600 browsers to run automated visual tests. Free for Open Source
Preflight Easiest Visual regression testing and Automated Web Testing tool. (Limited) free use
Preflight: Cypress Recorder Create AI-powered Cypress Tests/POM models in your browser and automate Email & Visual testing for Cypress
Meticulous.ai Easily create frontend tests without writing code. Use Meticulous to record workflows on your web app. You can then replay those flows on new frontend code, and create a test by diffing two replays
testRigor E2E functional test automation tool for web, mobile, and desktop tests
VRTs - Visual Regression Tests – WordPress plugin auto-updating screenshots on content updates, preventing false positives
Testomat.io Reporter 125 3 days ago Allows to collect tests to a Test Case Management System (TCMS) like testomat.io and sync manual and automated tests in one place

Awesome Visual Regression Testing / Blog posts
Kevin Lamping: The 5 best visual regression testing tools Compares: Wraith, PhantomCSS, Gemini, WebdriverCSS and Spectre
Garris Shipon: Visual Regression Testing For Angular Applications Tutorial using BackstopJS
Angela Riggs: Visual Regression Testing with BackstopJS Tutorial using BackstopJS
Garris Shipon: Automating CSS Regression Testing Tutorial using BackstopJS
Phillip Gourley: Making visual regression useful Why you should use BackstopJS
Pavels Jelisejevs: Visual Regression Testing with PhantomCSS Introduction to PhantomCSS
Chromeless, Chrominator, Chromy, Navalia, Lambdium, GhostJS, AutoGCD Headless Chrome is shaking up traditional approaches to test automation
Visual regression testing using Jest, Chromeless and AWS Lambda 17 about 7 years ago Tutorial using Chromeless and jest-image-snapshot
Make visual regression testing easier Introduction to and how to use it
Visual Regression Testing with Puppeteer & Jest Tutorial to setup visual testing with Puppeteer, Jest and VisWiz.io
Keeping a React Design System consistent: using visual regression testing to save time and headaches Using percy, and jest puppeteer to visually test a React component library
Visual Regression Test with WebdriverIO & WebdriverCSS Tutorial using WebdriverIO and WebdriverCSS with Spec Reporter
Automated screenshot comparison tests with headless Chrome, Puppeteer and Pixelmatch, in Bitbucket pipeline
Automatic visual diffing with Puppeteer
theheadless.dev Blog with practical guides and runnable examples on Playwright and Puppeteer
Visual regression testing for Hugo with Github-CI and BackstopJS How to automate regression testing for Hugo with BackstopJS
UI Visual Regression Testing with Micoo Introduction about how to do visual regression testing with Micoo service
Poor man's visual regression testing Improved manual visual regression testing with the PerfectPixel chrome plugin
Everything you need to know about Visual Regression Testing in 2022 Intro to visual regression testing with tools updated as of 2022

Awesome Visual Regression Testing / Slideshows, talks and videos
CSS Regression Testing with Wraith Screencast: Basic introduction to wraith, a screenshot comparison tool
Visual Regression Testing with Shoov How to setup shoov and get your first test written
Visual Regression Testing with PhantomCSS Talk by Jon Bellah on how to use PhantomCSS during wordpress development
Visual Regression Testing: Sanity Checks With BackstopJS Screencast with code demo and best practices
Screenster Tutorial Tutorial on how to create visual automated tests with Screenster
Look-alike - visual regression testing tool Demo what the Look-alike Chrome extension is, how it works and how and why it was build
Screencast on CSS critic - a lightweight testing framework for CSS How to write your first CSS test with CSS critic, make it pass, break it, and make it pass again
Visual Regression Testing - from a tool to a process by Nikhil Verma - How the Mobile Web team in Badoo converted and integrated PhantomCSS into their workflow and connected it to their CI process
Cypress in 100 Seconds Introduction video by Fireship

Awesome Visual Regression Testing / Deprecated
PhantomJS 29,465 almost 2 years ago Scriptable Headless WebKit. No longer maintained since 2 June 2018
PhantomCSS Visual/CSS regression testing with PhantomJS or SlimerJS. No longer maintained since 22 Dec 2017
PhantomFlow Experimental approach to UI testing, based on Decision Trees
DalekJS 695 over 4 years ago Automated cross browser testing with JavaScript. No longer maintained since 4 Jun 2017
dpxdt 1,441 almost 8 years ago End-to-end testing with Python
Visual Review 275 almost 5 years ago A human-friendly tool for testing and reviewing visual regressions
Huxley 4,069 about 3 years ago Python framework based on
WebdriverCSS 615 over 7 years ago WebdriverCSS sits on top of and hooks into
Gemini 1,497 over 3 years ago Feature rich framework with support for and . Gemini is deprecated, use hermione instead
OcularJS 7 over 7 years ago uses
trifleJS 826 almost 5 years ago Headless automation for Internet Explorer. (last update 2016)
CasperJS 7,203 over 4 years ago Navigation scripting and testing utility for PhantomJS and SlimerJS. (archived 2018)
Navalia 961 over 6 years ago Browser Automation based on headless Chrome and GraphQL. (archived 2018)
Chromeless 13,246 about 6 years ago Chrome automation made simple. Runs locally or headless on AWS Lambda. (archived 2018)

Backlinks from these awesome lists:

More related projects: