New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

writing HI configuration file 2024 #4988

Open

LinaresToine wants to merge 12 commits into master from HITesting

+61 −21

Contributor

LinaresToine commented Sep 4, 2024

HI datataking is coming up and I attempt to create the HIReplayConfiguration.py file.

Questions remaining:

Global tags
Scenarios
HLTScout testing configuration
PDs configuration

Contributor

germanfgv commented Sep 4, 2024

It seems you are replacing HI replay config with the regular replay config. Please review the changes, as there are many parameters that are different from HI to pp configs.


2024 HI Replay config file based on HI Replay config file 2023

d290d89

LinaresToine force-pushed the HITesting branch from 27d816b to d290d89 Compare

September 4, 2024 15:25


Include 140X GTs for now

ba874cb

Contributor Author

LinaresToine commented Sep 4, 2024

Yes, I originally created the file based on current replay config. I now based it on last year's HI config.

I believe the file is ready to run a replay, the only thing we miss for now are 141X GTs.

Antonio Linares added 3 commits

September 4, 2024 14:45


Update run to use

64792a5


update GTs

11038f2


Testing with CMSSW_14_1_0

aabeab6

LinaresToine force-pushed the HITesting branch 4 times, most recently from a0740b5 to 2fca05e Compare

September 30, 2024 20:59


Include scenarios in DB

a766e4e

LinaresToine force-pushed the HITesting branch from 2fca05e to a766e4e Compare

September 30, 2024 23:14

mmusich mentioned this pull request

HI Testing - ppEra_Run3_2024_UPC scenario cms-sw/cmssw#46186

Closed

mmusich reviewed

View reviewed changes

etc/HIReplayOfflineConfiguration.py Outdated

expressGlobalTag = "132X_dataRun3_Express_v4"

promptrecoGlobalTag = "132X_dataRun3_Prompt_v4"

expressGlobalTag = "141X_dataRun3_Express_v2"

promptrecoGlobalTag = "141X_dataRun3_Prompt_v2"

Contributor

mmusich Oct 1, 2024

Suggested change

promptrecoGlobalTag = "141X_dataRun3_Prompt_v2"

promptrecoGlobalTag = "141X_dataRun3_Prompt_v3"

141X_dataRun3_Prompt_v3 has DeDxCalibrationRcd, see cms-sw/cmssw#46186


Update GTs to v3

2cd2da3

LinaresToine force-pushed the HITesting branch from d320d9e to 2cd2da3 Compare

October 1, 2024 18:46

mmusich reviewed

View reviewed changes

etc/HIReplayOfflineConfiguration.py Outdated

@@ @@ -1337,7 +1373,7 @@ @@
  write_dqm=True,
  alca_producers=["TkAlMinBias"],
  dqm_sequences=["@common"],
- scenario=hiTestppScenario)
+ scenario=hiLightEventsScenario)

Contributor

mmusich Oct 2, 2024

@LinaresToine I don't understand this choice (and also several others).
In 2023 this PD was processed with ppEra_Run3_pp_on_PbPb_2023. I think this should be hiHeavyEventsScenario (= "ppEra_Run3_pp_on_PbPb_2024") now.

mmusich reviewed

View reviewed changes

etc/HIReplayOfflineConfiguration.py Outdated

@@ @@ -1346,7 +1382,7 @@ @@
  do_reco=False,
  aod_to_disk=False,
  raw_to_disk=False,
- scenario=hiTestppScenario)
+ scenario=hiLightEventsScenario)

Contributor

mmusich Oct 2, 2024

@LinaresToine I don't understand this choice (and also several others).
In 2023 this PD was processed with ppEra_Run3_pp_on_PbPb_2023. I think this should be hiHeavyEventsScenario (= "ppEra_Run3_pp_on_PbPb_2024") now.

mmusich reviewed

View reviewed changes

etc/HIReplayOfflineConfiguration.py Outdated

@@ @@ -1357,7 +1393,7 @@ @@
  raw_to_disk=False,
  aod_to_disk=False,
  dqm_sequences=["@common"],
- scenario=hiTestppScenario)
+ scenario=hiLightEventsScenario)

Contributor

mmusich Oct 2, 2024

@LinaresToine I don't understand this choice (and also several others).
In 2023 this PD was processed with ppEra_Run3_pp_on_PbPb_2023. I think this should be hiHeavyEventsScenario (= "ppEra_Run3_pp_on_PbPb_2024") now.

mmusich reviewed

View reviewed changes

etc/HIReplayOfflineConfiguration.py Outdated

@@ @@ -1433,7 +1469,7 @@ @@
  timePerEvent=1,
  disk_node="T2_US_Vanderbilt",
  dqm_sequences=["@commonSiStripZeroBias"],
- scenario=hiTestppScenario)
+ scenario=hiLightEventsScenario)

Contributor

mmusich Oct 2, 2024

@LinaresToine I don't understand this choice (and also several others).
In 2023 this PD was processed with ppEra_Run3_pp_on_PbPb_2023. I think this should be hiHeavyEventsScenario (= "ppEra_Run3_pp_on_PbPb_2024") now.

Contributor Author

LinaresToine commented Oct 2, 2024

Thank you @mmusich . I originally understood that RawPrime goes with ppEra_Run3_pp_on_PbPb_approxSiStripClusters_2024, while everything else goes with UPC, except for express, which use ppEra_Run3_pp_on_PbPb_2024. I'll retry with:

RawPrime : ppEra_Run3_pp_on_PbPb_approxSiStripClusters_2024 --> hiRawPrimeScenario
Forward: ppEra_Run3_2024_UPC --> hiForwardScenario
Everything else: ppEra_Run3_pp_on_PbPb_2024 --> hiScenario


Settle scenarios to proper PDs

b48d2ed

Contributor

fabiocos commented Oct 8, 2024

@LinaresToine we should try a new replay test of this configuration using CMSSW_14_1_1, that should contain all the latest CMSSW updates discussed as a follow-up of the previous failure, in preparation for the forthcoming HI data taking (regular pp data taking is ending in one week from now)


Using CMSSW_14_1_1

58312e1

Contributor Author

LinaresToine commented Oct 8, 2024 •

edited

Loading

@fabiocos the replay with CMSSW_14_1_1 has ended, I did not update the PR, apologies. We have an error with DeDxEstimator module. I will create a GH issue for this

Contributor Author

LinaresToine commented Oct 8, 2024

For the record, previous issues with cmsssw were solved in this issue:

HI Testing - ppEra_Run3_2024_UPC scenario cms-sw/cmssw#46186
- Includes solution to problem with UPC scenario
- Includes solution related to outdated global tags
Preparation for HIRun2024A: DeDxEstimator Failure for HIForward cms-sw/cmssw#46307
- Reports current problem with DeDxEstimator module in HIForward job


Merge branch 'master' into HITesting

06b1cfd

Contributor

fabiocos commented Oct 11, 2024

https://github.com/cms-sw/cmssw/releases/tag/CMSSW_14_1_2 is now available with the known needed fixes. I suggest to update the branch above, and restart a replay before the week-end, so as we may have at the Joint Ops on Monday a clear view of the status in preparation of HI data taking

Contributor

germanfgv commented Oct 11, 2024

https://github.com/cms-sw/cmssw/releases/tag/CMSSW_14_1_2 is now available with the known needed fixes. I suggest to update the branch above, and restart a replay before the week-end, so as we may have at the Joint Ops on Monday a clear view of the status in preparation of HI data taking

We will trigger the replay again, now with this new version. It should be done by Monday.


Now testing with CMSSW_14_1_2

c33bff1

Contributor Author

LinaresToine commented Oct 11, 2024

The replay has started, it can be followed in

CMSSW_14_1_2 Replay

Contributor

fabiocos commented Oct 12, 2024

The replay is successfully finished, both according to Grafana dashboard and the testbed WMStats instance

Contributor Author

LinaresToine commented Oct 12, 2024 •

edited

Loading

Output data for replay can be found in DAS

LinaresToine mentioned this pull request

New scenarios #4989

Closed

LinaresToine force-pushed the HITesting branch 3 times, most recently from 9cc4001 to b2c02e3 Compare

October 17, 2024 19:36


Testing CMSSW_14_1_3

d296496

LinaresToine force-pushed the HITesting branch from b2c02e3 to d296496 Compare

October 17, 2024 20:50

LinaresToine added OpsPriority Do not merge yet labels

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment