Investigate Visual Regression Testing Setup for Rails with Headless Browser

[loftwah]

Explore the feasibility and effectiveness of implementing visual regression testing in the Rails environment using a headless browser. This approach will ensure that the visual appearance of the application remains consistent over time, automatically detecting unintended changes in the UI.

Key Objectives:

1. Research Available Tools:

   • Identify and evaluate tools compatible with Rails, such as capybara-screenshot-diff, applitools, or others.
   • Assess the active maintenance and community support for these tools.

2. Setup and Configuration:

   • Implement a basic configuration using a chosen tool, integrated with Capybara and RSpec.
   • Configure headless browser support (e.g., Chrome or Firefox) for running tests in both local and CI environments.

3. Baseline and Comparison:

   • Establish baseline images for critical pages or components.
   • Define comparison thresholds and color sensitivity to determine acceptable visual differences.

4. Integration with CI/CD:

   • Ensure the solution works seamlessly in the CI/CD pipeline, storing baseline images and reporting failures with visual diffs.
   • Evaluate the feasibility of automatically updating baseline images when necessary.

5. Evaluation and Recommendations:

   • Analyze the pros and cons of the selected approach.
   • Provide recommendations on whether to adopt visual regression testing and under what conditions.

Additional Information: The goal is to automate the detection of visual regressions and minimize manual UI review, improving test coverage and confidence in the visual integrity of the application.