calibration/test_caf.py
=== stdout of calibration/tests/test_caf.py ===
[INFO] Steering file: /data/b2soft/buildbot/development/releases/current/calibration/tests/test_caf.py
[INFO] Gathering files for 'raw_physics' from input_files.json
[INFO] Found 2 files in 'raw_physics'
[INFO] Gathering files for 'raw_cosmic' from input_files.json
[INFO] Found 2 files in 'raw_cosmic'
[INFO] Gathering files for 'raw_beam' from input_files.json
[INFO] Found 0 files in 'raw_beam'
[WARNING] 'raw_beam' has no files associated with it!
[INFO] Getting values for 'expert_config' from the prompt script.
[INFO] Total number of raw-data files used as input = 4
[INFO] Requested use of Local backend
[INFO] Starting up new Pool with 4 processes
[INFO] Default CAF backend_args: {}
[INFO] Applying prompt settings to Calibration(name=KLMChannelStatus)
[INFO] Applying prompt settings to Collection(name=default)
[INFO] This appears to be a default Collection with no input files.
[INFO] Settings will be applied but it will likely be removed prior to the CAF process beginning.
[INFO] Applying prompt settings to Collection(name=raw)
[INFO] Adding Calibration(name=raw) to CAF process
[INFO] Checking for any invalid Collections in Calibrations.
[WARNING] Removing invalid Collection 'default' from Calibration 'KLMChannelStatus'.
[INFO] Initial status of KLMChannelStatus found to be state=init, iteration=0
[INFO] Attempting collector submission for calibration KLMChannelStatus.
[INFO] No File to IoV mapping required.
[INFO] Creating Job(KLMChannelStatus_raw_Iteration_0).Subjob(0)
[INFO] Creating Job(KLMChannelStatus_raw_Iteration_0).Subjob(1)
[INFO] Creating Job(KLMChannelStatus_raw_Iteration_0).Subjob(2)
[INFO] Creating Job(KLMChannelStatus_raw_Iteration_0).Subjob(3)
[INFO] No ArgumentsGenerator assigned to the MaxSubjobsSplitter so subjobs of Job(KLMChannelStatus_raw_Iteration_0) won't automatically have arguments assigned.
[INFO] MaxSubjobsSplitter created 4 Subjobs for Job(KLMChannelStatus_raw_Iteration_0)
[INFO] Submitting SubJob(KLMChannelStatus_raw_Iteration_0_0)
[INFO] Setting KLMChannelStatus_raw_Iteration_0_0 status to submitted
[INFO] SubJob(KLMChannelStatus_raw_Iteration_0_0) submitted
[INFO] Starting Sub-process: KLMChannelStatus_raw_Iteration_0_0
[INFO] stdout/err for subprocess KLMChannelStatus_raw_Iteration_0_0 visible at:
/tmp/tmp1q8ma5zm/calibration_results/KLMChannelStatus/0/collector_output/raw/0/stdout
/tmp/tmp1q8ma5zm/calibration_results/KLMChannelStatus/0/collector_output/raw/0/stderr
[INFO] Submitting SubJob(KLMChannelStatus_raw_Iteration_0_1)
[INFO] Setting KLMChannelStatus_raw_Iteration_0_1 status to submitted
[INFO] SubJob(KLMChannelStatus_raw_Iteration_0_1) submitted
[INFO] Starting Sub-process: KLMChannelStatus_raw_Iteration_0_1
[INFO] stdout/err for subprocess KLMChannelStatus_raw_Iteration_0_1 visible at:
/tmp/tmp1q8ma5zm/calibration_results/KLMChannelStatus/0/collector_output/raw/1/stdout
/tmp/tmp1q8ma5zm/calibration_results/KLMChannelStatus/0/collector_output/raw/1/stderr
[INFO] Submitting SubJob(KLMChannelStatus_raw_Iteration_0_2)
[INFO] Setting KLMChannelStatus_raw_Iteration_0_2 status to submitted
[INFO] SubJob(KLMChannelStatus_raw_Iteration_0_2) submitted
[INFO] Starting Sub-process: KLMChannelStatus_raw_Iteration_0_2
[INFO] stdout/err for subprocess KLMChannelStatus_raw_Iteration_0_2 visible at:
/tmp/tmp1q8ma5zm/calibration_results/KLMChannelStatus/0/collector_output/raw/2/stdout
/tmp/tmp1q8ma5zm/calibration_results/KLMChannelStatus/0/collector_output/raw/2/stderr
[INFO] Submitting SubJob(KLMChannelStatus_raw_Iteration_0_3)
[INFO] Setting KLMChannelStatus_raw_Iteration_0_3 status to submitted
[INFO] SubJob(KLMChannelStatus_raw_Iteration_0_3) submitted
[INFO] All requested jobs submitted.
[INFO] Starting Sub-process: KLMChannelStatus_raw_Iteration_0_3
[INFO] stdout/err for subprocess KLMChannelStatus_raw_Iteration_0_3 visible at:
/tmp/tmp1q8ma5zm/calibration_results/KLMChannelStatus/0/collector_output/raw/3/stdout
/tmp/tmp1q8ma5zm/calibration_results/KLMChannelStatus/0/collector_output/raw/3/stderr
[INFO] Setting KLMChannelStatus_raw_Iteration_0 status to submitted
[INFO] Calibration Machine KLMChannelStatus moved to state running_collector.
[INFO] Subprocess KLMChannelStatus_raw_Iteration_0_0 finished.
[INFO] Subprocess KLMChannelStatus_raw_Iteration_0_3 finished.
[INFO] Updating full collector job statuses.
[INFO] Setting KLMChannelStatus_raw_Iteration_0_0 status to completed
[INFO] Setting KLMChannelStatus_raw_Iteration_0_3 status to completed
[INFO] 2/4 Collector SubJobs finished in Calibration KLMChannelStatus Job KLMChannelStatus_raw_Iteration_0.
[INFO] Subprocess KLMChannelStatus_raw_Iteration_0_2 finished.
[INFO] Subprocess KLMChannelStatus_raw_Iteration_0_1 finished.
[INFO] Updating full collector job statuses.
[INFO] Setting KLMChannelStatus_raw_Iteration_0_1 status to completed
[INFO] Setting KLMChannelStatus_raw_Iteration_0_2 status to completed
[INFO] Setting KLMChannelStatus_raw_Iteration_0 status to completed
[INFO] 4/4 Collector SubJobs finished in Calibration KLMChannelStatus Job KLMChannelStatus_raw_Iteration_0.
[INFO] Calibration Machine KLMChannelStatus moved to state collector_completed.
[INFO] Attempting to run algorithms for calibration KLMChannelStatus.
[INFO] Checking that Collector output exists for all collector jobs using KLMChannelStatus.output_patterns.
[INFO] Calibration Machine KLMChannelStatus moved to state running_algorithms.
[INFO] Output local database for KLMChannelStatus will be stored at /tmp/tmp1q8ma5zm/calibration_results/KLMChannelStatus/0/algorithm_output/outputdb.
[INFO] SequentialAlgorithmsRunner begun for Calibration KLMChannelStatus.
[INFO] Starting subprocess of AlgorithmStrategy for KLMChannelStatusAlgorithm.
[INFO] Logging will be diverted into algorithm output.
[INFO] Collecting results for KLMChannelStatusAlgorithm.
[INFO] Checking validity of current AlgorithmStrategy setup.
[INFO] Setting up KLMChannelStatus strategy for KLMChannelStatusAlgorithm
[INFO] Starting AlgorithmMachine of KLMChannelStatusAlgorithm
[INFO] Output log file at /tmp/tmp1q8ma5zm/calibration_results/KLMChannelStatus/0/algorithm_output/KLMChannelStatusAlgorithm_stdout.
Strategy for KLMChannelStatusAlgorithm exited subprocess but without a final state!
[INFO] Calibration Machine KLMChannelStatus moved to state failed.
[INFO] Printing summary of final CAF status.
===========================================================
Calibrations Table
===========================================================
name state checkpoint iteration
0 KLMChannelStatus failed collector_completed 0
===========================================================
[INFO] End of CAF processing.
[INFO] Checking for failures...
[INFO] The BELLE2 environment variables are:
BELLE2_ANALYSES_PROJECT=belle2/analyses
BELLE2_ARCH=Linux_x86_64
BELLE2_BACKGROUND_DIR=/belle2/bkg
BELLE2_BACKGROUND_MIXING_DIR=/belle2/bkg.mixing
BELLE2_CONFIG_DIR=/belle2/config
BELLE2_DOWNLOAD=--ca-certificate=/cvmfs/belle.cern.ch/tools/certchain.pem https://software.belle2.org/download
BELLE2_EXAMPLES_DATA_DIR=/belle2/examples-data
BELLE2_EXCLUDE_PACKAGES=daq
BELLE2_EXTERNALS_DIR=/cvmfs/belle.cern.ch/el9/externals/v02-04-00
BELLE2_EXTERNALS_OPTION=opt
BELLE2_EXTERNALS_REPOSITORY=git@gitlab.desy.de:belle2/software/externals.git
BELLE2_EXTERNALS_SUBDIR=Linux_x86_64/opt
BELLE2_EXTERNALS_TOPDIR=/cvmfs/belle.cern.ch/el9/externals
BELLE2_EXTERNALS_VERSION=v02-04-00
BELLE2_GIT_SERVER=git@gitlab.desy.de:
BELLE2_NO_TOOLS_CHECK=1
BELLE2_OPTION=opt
BELLE2_PREPARE_PATH=/tmp/tmpt2_mfxna
BELLE2_RELEASE=current
BELLE2_RELEASE_DIR=/data/b2soft/buildbot/development/releases/current
BELLE2_RUNDB_TOKEN=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJlbmRwb2ludHMiOlsicmVzdC92MS9ydW5zLyJdLCJuYW1lIjoiYmFzZjJfdW5pdHRlc3QifQ.QGfS2g5w0KwSCoL1BrLwyo-FwBzd6Gb60rbq036_as4
BELLE2_SOFTWARE_REPOSITORY=git@gitlab.desy.de:belle2/software/basf2.git
BELLE2_SUBDIR=Linux_x86_64/opt
BELLE2_TOOLS=/cvmfs/belle.cern.ch/tools
BELLE2_USER=b2soft
BELLE2_VALIDATION_DATA_DIR=/belle2/validation-data
BELLE2_VERSIONING_REPOSITORY=git@gitlab.desy.de:belle2/software/versioning.git
VO_BELLE2_SW_DIR=/data/b2soft/buildbot/development
[ERROR] Calibration failed, here is the submit.sh of the first collector job.
#!/bin/bash
# ---
# trap ctrl-c and call ctrl_c()
trap '(ctrl_c 130)' SIGINT
trap '(ctrl_c 143)' SIGTERM
function write_exit_code() {
echo "Writing $1 to exit status file"
echo "$1" > __BACKEND_CMD_EXIT_STATUS__
exit $1
}
function ctrl_c() {
trap '' SIGINT SIGTERM
echo "** Trapped Ctrl-C **"
echo "$1" > __BACKEND_CMD_EXIT_STATUS__
exit $1
}
# ---
if [ -z "${BELLE2_CONFIG_DIR}" ]; then
export BELLE2_CONFIG_DIR=/belle2/config
fi
if [ -z "${VO_BELLE2_SW_DIR}" ]; then
export VO_BELLE2_SW_DIR=/data/b2soft/buildbot/development
fi
if [ -z "${BELLE2_EXTERNALS_TOPDIR}" ]; then
export BELLE2_EXTERNALS_TOPDIR=/cvmfs/belle.cern.ch/el9/externals
fi
source /cvmfs/belle.cern.ch/tools/b2setup current
basf2 run_collector_path.py --job-information job_info.json
# ---
write_exit_code $?
[ERROR] Calibration failed, here is the stdout of the first collector job.
Belle II software tools set up at: /cvmfs/belle.cern.ch/tools
Info: HOME environment variable is not set, therefore can not set JUPYTER_CONFIG_DIR to $HOME/.jupyter.
Environment setup for release: current
Central release directory : /data/b2soft/buildbot/development/releases/current
Warning: The release current is not supported. Please update to release-09-00-14
[INFO] Steering file: run_collector_path.py
[INFO] Job information file: job_info.json
[INFO] Using Global Tag online.
[INFO] Using Global Tag validation_2026-03-26.
[INFO] Modules and parameter settings in the path:
1. RootInput
inputFileNames=['file:///belle2/validation-data/calibration/cdst_e0008_r3121_cosmicSkim/cdst_e0008_r3121_cosmicSkim.root']
2. HistoManager
histoFileName=CollectorOutput.root
3. Gearbox
4. Geometry
5. TTDUnpacker
6. KLMUnpacker
7. KLMChannelStatusCollector
[INFO] Starting event processing, random seed is set to 'bab47e4a11c02e0a08a2e982a5d27f2f5854383abd71cb32521441c2e174d'
[INFO] Added file file:///belle2/validation-data/calibration/cdst_e0008_r3121_cosmicSkim/cdst_e0008_r3121_cosmicSkim.root
[INFO] Global tag override is in effect: input globaltags and default globaltag will be ignored
[INFO] Conditions Database: found working metadata provider
provider = /cvmfs/belle.cern.ch/conditions/database.sqlite
[INFO] Conditions data: configured globaltags (highest priority first) are validation_2026-03-26, online
[WARNING] TOPGeometry: obsolete payload revision (before bugfix and update of optical properties) - please, check global tags { module: Geometry }
**************************************************************
Geant4 version Name: geant4-11-02-patch-01 (16-February-2024)
Copyright : Geant4 Collaboration
References : NIM A 506 (2003), 250-303
: IEEE-TNS 53 (2006), 270-278
: NIM A 835 (2016), 186-225
WWW : http://geant4.org/
**************************************************************
[WARNING] ARICH geometry: no data available for merger 1 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 2 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 3 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 4 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 5 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 6 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 7 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 8 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 9 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 10 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 11 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 12 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[INFO] RbTupleManager: initialized for single process.
[INFO] Saving output to TDirectory CollectorOutput.root:/KLMChannelStatusCollector
[INFO] ===Error Summary================================================================
[WARNING] ARICH geometry: no data available for merger 12 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 11 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 10 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 9 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 8 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 7 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 6 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 5 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 4 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 3 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 2 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] ARICH geometry: no data available for merger 1 cooling body geometry. Cooling body will not be placed. { module: Geometry }
[WARNING] TOPGeometry: obsolete payload revision (before bugfix and update of optical properties) - please, check global tags { module: Geometry }
[INFO] ================================================================================
[WARNING] in total, 13 warnings occurred during processing
Writing 0 to exit status file
[ERROR] Calibration failed, here is the stderr of the first collector job.
fatal: detected dubious ownership in repository at '/cvmfs/belle.cern.ch/tools'
To add an exception for this directory, call:
git config --global --add safe.directory /cvmfs/belle.cern.ch/tools
[FATAL] The test failed because an exception was raised (Command '['b2caf-prompt-run', 'Local', 'config.json', 'input_files.json', '--heartbeat', '20']' returned non-zero exit status 1.). Please re-run the run-tests stage if this failure happened in the GitLab pipeline. { function: }
[INFO] ===Error Summary================================================================
[FATAL] The test failed because an exception was raised (Command '['b2caf-prompt-run', 'Local', 'config.json', 'input_files.json', '--heartbeat', '20']' returned non-zero exit status 1.). Please re-run the run-tests stage if this failure happened in the GitLab pipeline.
[ERROR] Calibration failed, here is the stderr of the first collector job.
[ERROR] Calibration failed, here is the stdout of the first collector job.
[ERROR] Calibration failed, here is the submit.sh of the first collector job.
[INFO] ================================================================================
[ERROR] in total, 3 errors occurred during processing
=== stderr of calibration/tests/test_caf.py ===
Process ForkProcess-5:
Traceback (most recent call last):
File "/cvmfs/belle.cern.ch/el9/externals/v02-04-00/Linux_x86_64/common/lib/python3.12/multiprocessing/process.py", line 314, in _bootstrap
self.run()
File "/cvmfs/belle.cern.ch/el9/externals/v02-04-00/Linux_x86_64/common/lib/python3.12/multiprocessing/process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "/data/b2soft/buildbot/development/releases/current/lib/Linux_x86_64/opt/caf/runners.py", line 189, in _run_strategy
strategy.run(iov, iteration, queue)
File "/data/b2soft/buildbot/development/releases/current/lib/Linux_x86_64/opt/klm_channel_status.py", line 120, in run
self.process_experiment(run_list[0].exp, run_list, iteration,
File "/data/b2soft/buildbot/development/releases/current/lib/Linux_x86_64/opt/klm_channel_status.py", line 554, in process_experiment
write_result(run_data, i)
File "/data/b2soft/buildbot/development/releases/current/lib/Linux_x86_64/opt/klm_channel_status.py", line 476, in write_result
commit_payload(run_data[run])
File "/data/b2soft/buildbot/development/releases/current/lib/Linux_x86_64/opt/klm_channel_status.py", line 461, in commit_payload
self.machine.algorithm.algorithm.commit(run_data[5])
TypeError: none of the 2 overloaded methods succeeded. Full details:
static bool Belle2::CalibrationAlgorithm::commit(list payloads) =>
TypeError: takes at most 1 arguments (2 given)
bool Belle2::CalibrationAlgorithm::commit() =>
TypeError: takes at most 0 arguments (1 given)
Traceback (most recent call last):
File "/data/b2soft/buildbot/development/releases/current/bin/Linux_x86_64/opt/b2caf-prompt-run", line 363, in
sys.exit(main())
^^^^^^
File "/data/b2soft/buildbot/development/releases/current/bin/Linux_x86_64/opt/b2caf-prompt-run", line 357, in main
run_caf(cal_fw)
File "/data/b2soft/buildbot/development/releases/current/bin/Linux_x86_64/opt/b2caf-prompt-run", line 247, in run_caf
raise RuntimeError(f"{calibration.name} failed!")
RuntimeError: KLMChannelStatus failed!
=== end calibration/tests/test_caf.py ===