cmssw: Assertion failure in TrackCollectionCloner::Producer::operator()

In CMSSW_12_3_X_2022-02-21-1100 workflow 23234.9 step 3 fails with

cmsRun: /pool/condor/dir_285643/jenkins/workspace/build-any-ib/w/tmp/BUILDROOT/299e6f2e63951755801bd8d1d3286a02/opt/cmssw/slc7_amd64_gcc10/cms/cmssw/CMSSW_12_3_X_2022-02-21-1100/src/RecoTracker/FinalTrackSelectors/src/TrackCollectionCloner.cc:49: void TrackCollectionCloner::Producer::operator()(const Tokens&, const std::vector<unsigned int>&): Assertion `selTrajs_->back().measurements().size() == trk.recHitsSize()' failed.

Thread 3 (Thread 0x2b9ae944e700 (LWP 6473) "cmsRun"):
#3  0x00002b9a9783956b in sig_dostack_then_abort () from /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc10/cms/cmssw/CMSSW_12_3_X_2022-02-21-1100/lib/slc7_amd64_gcc10/pluginFWCoreServicesPlugins.so
#4  <signal handler called>
#5  0x00002b9a9225c387 in raise () from /lib64/libc.so.6
#6  0x00002b9a9225da78 in abort () from /lib64/libc.so.6
#7  0x00002b9a922551a6 in __assert_fail_base () from /lib64/libc.so.6
#8  0x00002b9a92255252 in __assert_fail () from /lib64/libc.so.6
#9  0x00002b9ad61af81e in TrackCollectionCloner::Producer::operator()(TrackCollectionTokens const&, std::vector<unsigned int, std::allocator<unsigned int> > const&) () from /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc10/cms/cmssw/CMSSW_12_3_X_2022-02-21-1100/lib/slc7_amd64_gcc10/libRecoTrackerFinalTrackSelectors.so
#10 0x00002b9ad609f990 in (anonymous namespace)::DuplicateListMerger::produce(edm::StreamID, edm::Event&, edm::EventSetup const&) const () from /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc10/cms/cmssw/CMSSW_12_3_X_2022-02-21-1100/lib/slc7_amd64_gcc10/pluginRecoTrackerFinalTrackSelectorsPlugins.so
#11 0x00002b9a8fca1b73 in edm::global::EDProducerBase::doEvent(edm::EventTransitionInfo const&, edm::ActivityRegistry*, edm::ModuleCallingContext const*) () from /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc10/cms/cmssw/CMSSW_12_3_X_2022-02-21-1100/lib/slc7_amd64_gcc10/libFWCoreFramework.so
#12 0x00002b9a8fc9c7df in edm::WorkerT<edm::global::EDProducerBase>::implDo(edm::EventTransitionInfo const&, edm::ModuleCallingContext const*) () from /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc10/cms/cmssw/CMSSW_12_3_X_2022-02-21-1100/lib/slc7_amd64_gcc10/libFWCoreFramework.so
#13 0x00002b9a8fbf7f15 in decltype ({parm#1}()) edm::convertException::wrap<edm::Worker::runModule<edm::OccurrenceTraits<edm::EventPrincipal, (edm::BranchActionType)1> >(edm::OccurrenceTraits<edm::EventPrincipal, (edm::BranchActionType)1>::TransitionInfoType const&, edm::StreamID, edm::ParentContext const&, edm::OccurrenceTraits<edm::EventPrincipal, (edm::BranchActionType)1>::Context const*)::{lambda()#1}>(edm::Worker::runModule<edm::OccurrenceTraits<edm::EventPrincipal, (edm::BranchActionType)1> >(edm::OccurrenceTraits<edm::EventPrincipal, (edm::BranchActionType)1>::TransitionInfoType const&, edm::StreamID, edm::ParentContext const&, edm::OccurrenceTraits<edm::EventPrincipal, (edm::BranchActionType)1>::Context const*)::{lambda()#1}) () from /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc10/cms/cmssw/CMSSW_12_3_X_2022-02-21-1100/lib/slc7_amd64_gcc10/libFWCoreFramework.so
#14 0x00002b9a8fbf820b in std::__exception_ptr::exception_ptr edm::Worker::runModuleAfterAsyncPrefetch<edm::OccurrenceTraits<edm::EventPrincipal, (edm::BranchActionType)1> >(std::__exception_ptr::exception_ptr const*, edm::OccurrenceTraits<edm::EventPrincipal, (edm::BranchActionType)1>::TransitionInfoType const&, edm::StreamID, edm::ParentContext const&, edm::OccurrenceTraits<edm::EventPrincipal, (edm::BranchActionType)1>::Context const*) () from /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc10/cms/cmssw/CMSSW_12_3_X_2022-02-21-1100/lib/slc7_amd64_gcc10/libFWCoreFramework.so
#15 0x00002b9a8fbfa7f5 in edm::Worker::RunModuleTask<edm::OccurrenceTraits<edm::EventPrincipal, (edm::BranchActionType)1> >::execute() () from /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc10/cms/cmssw/CMSSW_12_3_X_2022-02-21-1100/lib/slc7_amd64_gcc10/libFWCoreFramework.so
#16 0x00002b9a8f9907d5 in tbb::detail::d1::function_task<edm::WaitingTaskList::announce()::{lambda()#1}>::execute(tbb::detail::d1::execution_data&) () from /cvmfs/cms-ib.cern.ch/week1/slc7_amd64_gcc10/cms/cmssw/CMSSW_12_3_X_2022-02-21-1100/lib/slc7_amd64_gcc10/libFWCoreConcurrency.so

https://cmssdt.cern.ch/SDT/cgi-bin/logreader/slc7_amd64_gcc10/CMSSW_12_3_X_2022-02-21-1100/pyRelValMatrixLogs/run/23234.9_TTbar_14TeV+2026D49_vectorHits+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14INPUT+DigiTrigger+RecoGlobal+HARVESTGlobal/step3_TTbar_14TeV+2026D49_vectorHits+TTbar_14TeV_TuneCP5_GenSimHLBeamSpot14INPUT+DigiTrigger+RecoGlobal+HARVESTGlobal.log#/

About this issue

  • Original URL
  • State: closed
  • Created 2 years ago
  • Comments: 23 (23 by maintainers)

Most upvoted comments

I have started to look into this now and can confirm that it only happens for tracks reconstructed by the pixelLess iteration that is added with the vectorHits modifier. Since the other tracking iterations are still using the vectorHits, the conclusion is that the hits themselves are fine and the issue is introduced in the code specific to the new iteration. IIRC the only piece of code that is unique to that iteration is the seed generator https://github.com/cms-sw/cmssw/blob/master/RecoTracker/TkSeedGenerator/plugins/SeedingOTEDProducer.cc, so I will start digging there.