BackstopJS: Components failing tests when mismatch percent is near zero.
Our mismatchThreshold is set as follows: "misMatchThreshold": 5, however when the tests run certain tests fail and say "isSameDimensions": false,.
Here’s an example of some screenshots where the tests should pass but don’t seem to.


Here’s the output result from the report:
Report: {
"isSameDimensions": false,
"dimensionDifference": {
"width": 0,
"height": -1
},
"misMatchPercentage": "0.48"
}
Threshold: 1
This happens on around 8-10 tests, intermittently. Are we missing something, or is there a way to turn off the isSameDimensions property? Is this expected?
Thanks in advance for your advice.
About this issue
- Original URL
- State: closed
- Created 8 years ago
- Comments: 22 (15 by maintainers)
Commits related to this issue
- Squashed commit of the following: commit 73b55271c2ec21646788d75451912828990c597d Author: James Tudsbury <james@jtudsbury.com> Date: Fri Mar 24 21:47:42 2017 +0000 Make isSameDimensions option... — committed to garris/BackstopJS by garris 7 years ago
- Make isSameDimensions optional [Fixes #313] (#331) * Add isSamDimensions property to default config with true as default value * Set isSameDimensions to user config or to true. Though I'm not sure... — committed to mirzazeyrek/BackstopJS by jtuds 7 years ago
Awesome! Please update the issue when you have made the PR.
Thank you 😃
I’ll try to PR my stuff from #306 soon, then you can at least see in the output that it fails because of different dimensions and not because of missmatch errors.