BackstopJS: Components failing tests when mismatch percent is near zero.

Our mismatchThreshold is set as follows: "misMatchThreshold": 5, however when the tests run certain tests fail and say "isSameDimensions": false,.

Here’s an example of some screenshots where the tests should pass but don’t seem to.

prod_test_hillarys_styleguide_30_introbanner_2_desktop

prod_test_hillarys_styleguide_30_introbanner_2_desktop 1

Here’s the output result from the report:

Report: {
  "isSameDimensions": false,
  "dimensionDifference": {
    "width": 0,
    "height": -1
  },
  "misMatchPercentage": "0.48"
}
Threshold: 1

This happens on around 8-10 tests, intermittently. Are we missing something, or is there a way to turn off the isSameDimensions property? Is this expected?

Thanks in advance for your advice.

About this issue

  • Original URL
  • State: closed
  • Created 8 years ago
  • Comments: 22 (15 by maintainers)

Commits related to this issue

Most upvoted comments

Awesome! Please update the issue when you have made the PR.

Thank you 😃

I’ll try to PR my stuff from #306 soon, then you can at least see in the output that it fails because of different dimensions and not because of missmatch errors.