[12_5_X] Update Run3 offline and offline_relval GTs #39824

francescobrivio · 2022-10-21T17:26:32Z

PR description:

Backport of #39823

This PR updates the offline GT (auto:run3_data) with the latest conditions to be used for the 2022ABCD re-reco (see this CMSTalk post). The offline relval GT (auto:run3_data_relval) is updated as well to be even with the offline GT.

GT differences:

Run 3 data (offline)
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/124X_dataRun3_v9/124X_dataRun3_v11
Run 3 data RelVals
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/125X_dataRun3_relval_v1/125X_dataRun3_relval_v4
Diff between new offline and new offline_relval GTs
https://cms-conddb.cern.ch/cmsDbBrowser/diff/Prod/gts/124X_dataRun3_v11/125X_dataRun3_relval_v4

PR validation:

Successfully ran:
runTheMatrix.py -l 139.001 --ibeos -j 4
which consumes the relval GT.

Backport:

Backport of #39823

cmsbuild · 2022-10-21T17:26:58Z

A new Pull Request was created by @francescobrivio for CMSSW_12_5_X.

It involves the following packages:

Configuration/AlCa (alca)

@malbouis, @yuanchao, @cmsbuild, @saumyaphor4252, @francescobrivio, @ChrisMisan, @tvami can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @missirol, @mmusich, @fabiocos, @tocheng this is something you requested to watch as well.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.

cms-bot commands are listed here

Backported from Update Run3 offline and offline_relval GTs #39823

francescobrivio · 2022-10-21T17:27:36Z

backport of #39823

francescobrivio · 2022-10-21T17:28:44Z

@cmsbuild please test

cmsbuild · 2022-10-21T21:01:46Z

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-b0e5db/28430/summary.html
COMMIT: 02fdfdb
CMSSW: CMSSW_12_5_X_2022-10-21-1100/el8_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/39824/28430/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found errors in the following unit tests:

---> test TestDQMOnlineClient-hlt_dqm_sourceclient had ERRORS
---> test TestDQMOnlineClient-es_dqm_sourceclient had ERRORS
---> test TestDQMOnlineClient-ctpps_dqm_sourceclient had ERRORS
---> test TestDQMOnlineClient-ecal_dqm_sourceclient had ERRORS
and more ...

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 131 differences found in the comparisons
DQMHistoTests: Total files compared: 51
DQMHistoTests: Total histograms compared: 3697216
DQMHistoTests: Total failures: 3149
DQMHistoTests: Total nulls: 1
DQMHistoTests: Total successes: 3694044
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: -0.004 KiB( 50 files compared)
DQMHistoSizes: changed ( 312.0 ): -0.004 KiB MessageLogger/Warnings
Checked 212 log files, 49 edm output root files, 51 DQM output files
TriggerResults: no differences found

cmsbuild · 2022-10-23T12:53:56Z

Pull request #39824 was updated. @malbouis, @yuanchao, @cmsbuild, @saumyaphor4252, @francescobrivio, @ChrisMisan, @tvami can you please check and sign again.

francescobrivio · 2022-10-24T07:48:33Z

please test with #39829

cmsbuild · 2022-10-24T11:28:06Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-b0e5db/28463/summary.html
COMMIT: e609225
CMSSW: CMSSW_12_5_X_2022-10-23-2300/el8_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/39824/28463/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 9 differences found in the comparisons
DQMHistoTests: Total files compared: 51
DQMHistoTests: Total histograms compared: 3697216
DQMHistoTests: Total failures: 1098
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3696096
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 50 files compared)
Checked 212 log files, 49 edm output root files, 51 DQM output files
TriggerResults: no differences found

francescobrivio · 2022-10-25T12:15:23Z

In the last run of tests we see differences in 11634.7 which is MC, so it should be completely unaffected by this PR which changes the offline data GT.

missirol · 2022-10-25T12:18:01Z

Another example of #39803.

malbouis · 2022-10-25T12:19:34Z

+alca

tests pass
Not really sure why 11634.7 is failing, it is MC and only the data GT was touched in this PR, as noted in [12_5_X] Update Run3 offline and offline_relval GTs #39824 (comment)

cmsbuild · 2022-10-25T12:19:59Z

This pull request is fully signed and it will be integrated in one of the next CMSSW_12_5_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_12_6_X is complete. This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

cmsbuild · 2022-11-01T16:02:24Z

Pull request #39824 was updated. @malbouis, @yuanchao, @cmsbuild, @saumyaphor4252, @francescobrivio, @ChrisMisan, @tvami can you please check and sign again.

tvami · 2022-11-01T20:13:32Z

@cmsbuild , please test

cmsbuild · 2022-11-01T23:42:23Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-b0e5db/28716/summary.html
COMMIT: 929f55d
CMSSW: CMSSW_12_5_X_2022-11-01-1100/el8_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/39824/28716/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 15 differences found in the comparisons
DQMHistoTests: Total files compared: 51
DQMHistoTests: Total histograms compared: 3734344
DQMHistoTests: Total failures: 1010
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3733312
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 50 files compared)
Checked 212 log files, 49 edm output root files, 51 DQM output files
TriggerResults: no differences found

tvami · 2022-11-11T14:48:26Z

+alca

master PR got merged yesterday

cmsbuild · 2022-11-11T14:48:53Z

This pull request is fully signed and it will be integrated in one of the next CMSSW_12_5_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_12_6_X is complete. This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

tvami · 2022-11-11T14:49:59Z

@cms-sw/orp-l2 I have some follow-up backport which will conflict with this PR, can you please merge this in today's 2300 IB so I can correctly make the next PR and avoid rebasing? thanks!

perrotta · 2022-11-11T15:24:04Z

+1

Update Run3 offline and offline_relval GTs

02fdfdb

cmsbuild added this to the CMSSW_12_5_X milestone Oct 21, 2022

cmsbuild added alca-pending orp-pending pending-signatures tests-pending labels Oct 21, 2022

cmsbuild added the backport label Oct 21, 2022

cmsbuild added tests-started and removed tests-pending labels Oct 21, 2022

cmsbuild added tests-rejected and removed tests-started labels Oct 21, 2022

fix snapshot of run3_data_relval GT to be identical to run3_data GT

e609225

cmsbuild added tests-pending and removed tests-rejected labels Oct 23, 2022

cmsbuild added requires-external tests-started and removed tests-pending labels Oct 24, 2022

cmsbuild added tests-approved and removed tests-started labels Oct 24, 2022

cmsbuild removed the alca-pending label Oct 25, 2022

Update JEC AK4PFPuppi tag in Run3 offline and offline_relval GTs

929f55d

cmsbuild added alca-pending pending-signatures tests-pending and removed alca-approved fully-signed tests-approved requires-external labels Nov 1, 2022

cmsbuild added tests-started and removed tests-pending labels Nov 1, 2022

cmsbuild added tests-approved and removed tests-started labels Nov 1, 2022

cmsbuild added backport-ok and removed backport labels Nov 10, 2022

cmsbuild added alca-approved fully-signed and removed alca-pending pending-signatures labels Nov 11, 2022

cmsbuild added orp-approved and removed orp-pending labels Nov 11, 2022

cmsbuild merged commit b70e59d into cms-sw:CMSSW_12_5_X Nov 11, 2022

francescobrivio deleted the alca-update_offline_GT_12_5_X branch November 14, 2022 17:42

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[12_5_X] Update Run3 offline and offline_relval GTs #39824

[12_5_X] Update Run3 offline and offline_relval GTs #39824

francescobrivio commented Oct 21, 2022 •

edited

Loading

cmsbuild commented Oct 21, 2022 •

edited

Loading

francescobrivio commented Oct 21, 2022

francescobrivio commented Oct 21, 2022

cmsbuild commented Oct 21, 2022

cmsbuild commented Oct 23, 2022

francescobrivio commented Oct 24, 2022

cmsbuild commented Oct 24, 2022

francescobrivio commented Oct 25, 2022

missirol commented Oct 25, 2022

malbouis commented Oct 25, 2022 •

edited

Loading

cmsbuild commented Oct 25, 2022

cmsbuild commented Nov 1, 2022

tvami commented Nov 1, 2022

cmsbuild commented Nov 1, 2022

tvami commented Nov 11, 2022

cmsbuild commented Nov 11, 2022

tvami commented Nov 11, 2022

perrotta commented Nov 11, 2022

[12_5_X] Update Run3 offline and offline_relval GTs #39824

[12_5_X] Update Run3 offline and offline_relval GTs #39824

Conversation

francescobrivio commented Oct 21, 2022 • edited Loading

PR description:

PR validation:

Backport:

cmsbuild commented Oct 21, 2022 • edited Loading

francescobrivio commented Oct 21, 2022

francescobrivio commented Oct 21, 2022

cmsbuild commented Oct 21, 2022

Unit Tests

Comparison Summary

cmsbuild commented Oct 23, 2022

francescobrivio commented Oct 24, 2022

cmsbuild commented Oct 24, 2022

Comparison Summary

francescobrivio commented Oct 25, 2022

missirol commented Oct 25, 2022

malbouis commented Oct 25, 2022 • edited Loading

cmsbuild commented Oct 25, 2022

cmsbuild commented Nov 1, 2022

tvami commented Nov 1, 2022

cmsbuild commented Nov 1, 2022

Comparison Summary

tvami commented Nov 11, 2022

cmsbuild commented Nov 11, 2022

tvami commented Nov 11, 2022

perrotta commented Nov 11, 2022

francescobrivio commented Oct 21, 2022 •

edited

Loading

cmsbuild commented Oct 21, 2022 •

edited

Loading

malbouis commented Oct 25, 2022 •

edited

Loading