cmssw: Comparison failed for tests of wf `39434.911`

In recent PRs test results there is a message saying:

comparisons for the following workflows were not done due to missing matrix map:
 - /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-cadc83/39434.911_TTbar_14TeV+2026D88_DD4hep+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal

But nonetheless the default comparison reports more than 50k differences for this wf. Some examples:

About this issue

Original URL
State: closed
Created 2 years ago
Comments: 23 (23 by maintainers)

Most upvoted comments

I believe the message
comparisons for the following workflows were not done due to missing matrix map:
 - /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-cadc83/39434.911_TTbar_14TeV+2026D88_DD4hep+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14+DigiTrigger+RecoGlobal+HARVESTGlobal
refers only to the “validateJR” / “reco comparisons”, and not to RelMon-based comparisons or DQM bin by bin.
There are however also quite a lot of differences in the bin by bin DQM comparisons for that workflow in the test outputs, as you can verify by opening any of the links to the PR tests listed in the issue description above.

Right, but the existence of the differences (whose cause should be identified) is a separate issue from one piece of comparisons infrastructure not recognizing this workflow.

makortel on Mar 23, 2022