validation/test_full_stack.py

=== stdout of validation/tests/test_full_stack.py ===
[INFO] Steering file: /data/b2soft/buildbot/development/releases/current/validation/tests/test_full_stack.py
Executing command 'b2validation -p 4 --test --tag stack_test_1'
Creating /tmp/tmpe1txrv2z/results/stack_test_1

[0G[                                                  ]    0.0% (0/5)
Runtime: 1s
Running: validationTestColorScheme.py
         validationTestEmptyRootFile.py
         validationTestFail_runlast.py
         validationTestNTuple.py
         validationTestPlots.py
[2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [0G[                                                  ]    0.0% (0/5)
Runtime: 2s
Running: validationTestColorScheme.py
         validationTestEmptyRootFile.py
         validationTestFail_runlast.py
         validationTestNTuple.py
         validationTestPlots.py
[2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [0G[====================                              ]   40.0% (2/5)
Runtime: 3s
Running: validationTestColorScheme.py
         validationTestNTuple.py
         validationTestPlots.py
[2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [0G[==================================================]  100.0% (5/5)
Runtime: 4s
Running: -

================================================================================
Creating plots for the revision(s) reference, stack_test_1.
================================================================================
--------------------------------------------------------------------------------
Creating plots for package: validation-test
--------------------------------------------------------------------------------
Creating plots for file: validationTestColorScheme.root
Creating plots for file: validationTestNTuple.root
Creating plots for file: validationTestPlots.root
Creating plots for file: validationTestPlotsExpertOnly.root

Storing to /tmp/tmpe1txrv2z/html/plots/edd266ee78/comparison.json

================================================================================
Summary of plotting
================================================================================
Total number of plotuples considered: 23

A total of 19 warnings were issued.
* 'No reference object' was issued by 17 plotuples
* 'No description' was issued by 1 plotuples
* 'No Check' was issued by 1 plotuples
Success rate 26%. That's terrible!

Chi2 comparisons
* 'not_compared' was the result of 17 comparisons
* 'equal' was the result of 4 comparisons
* 'error' was the result of 2 comparisons
Weighted score:  72%. That still requires some work.

Success rate 80%. Way to go ;)
Command 'b2validation -p 4 --test --tag stack_test_1' exited with code 0
Executing command 'b2validation -p 4 --test --tag stack_test_2'
Creating /tmp/tmpe1txrv2z/results/stack_test_2

[0G[                                                  ]    0.0% (0/5)
Runtime: 1s
Running: validationTestColorScheme.py
         validationTestEmptyRootFile.py
         validationTestFail_runlast.py
         validationTestNTuple.py
         validationTestPlots.py
[2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [0G[                                                  ]    0.0% (0/5)
Runtime: 2s
Running: validationTestColorScheme.py
         validationTestEmptyRootFile.py
         validationTestFail_runlast.py
         validationTestNTuple.py
         validationTestPlots.py
[2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [0G[====================                              ]   40.0% (2/5)
Runtime: 3s
Running: validationTestColorScheme.py
         validationTestNTuple.py
         validationTestPlots.py
[2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [0G[==================================================]  100.0% (5/5)
Runtime: 4s
Running: -

================================================================================
Creating plots for the revision(s) reference, stack_test_1, stack_test_2.
================================================================================
--------------------------------------------------------------------------------
Creating plots for package: validation-test
--------------------------------------------------------------------------------
Creating plots for file: validationTestColorScheme.root
Creating plots for file: validationTestNTuple.root
Creating plots for file: validationTestPlots.root
Creating plots for file: validationTestPlotsExpertOnly.root

Storing to /tmp/tmpe1txrv2z/html/plots/3886c11076/comparison.json

================================================================================
Summary of plotting
================================================================================
Total number of plotuples considered: 23

A total of 19 warnings were issued.
* 'No reference object' was issued by 17 plotuples
* 'No description' was issued by 1 plotuples
* 'No Check' was issued by 1 plotuples
Success rate 26%. That's terrible!

Chi2 comparisons
* 'not_compared' was the result of 17 comparisons
* 'equal' was the result of 4 comparisons
* 'error' was the result of 2 comparisons
Weighted score:  72%. That still requires some work.

Success rate 80%. Way to go ;)
Command 'b2validation -p 4 --test --tag stack_test_2' exited with code 0
Executing command 'b2validation -p 4 --test --tag stack_test_3'
Creating /tmp/tmpe1txrv2z/results/stack_test_3

[0G[                                                  ]    0.0% (0/5)
Runtime: 1s
Running: validationTestColorScheme.py
         validationTestEmptyRootFile.py
         validationTestFail_runlast.py
         validationTestNTuple.py
         validationTestPlots.py
[2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [0G[                                                  ]    0.0% (0/5)
Runtime: 2s
Running: validationTestColorScheme.py
         validationTestEmptyRootFile.py
         validationTestFail_runlast.py
         validationTestNTuple.py
         validationTestPlots.py
[2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [2K [1A [0G[========================================          ]   80.0% (4/5)
Runtime: 3s
Running: validationTestPlots.py
[2K [1A [2K [1A [2K [1A [0G[==================================================]  100.0% (5/5)
Runtime: 4s
Running: -

================================================================================
Creating plots for the revision(s) reference, stack_test_1, stack_test_2, stack_test_3.
================================================================================
--------------------------------------------------------------------------------
Creating plots for package: validation-test
--------------------------------------------------------------------------------
Creating plots for file: validationTestColorScheme.root
Creating plots for file: validationTestNTuple.root
Creating plots for file: validationTestPlots.root
Creating plots for file: validationTestPlotsExpertOnly.root

Storing to /tmp/tmpe1txrv2z/html/plots/6d7ad4ca8d/comparison.json

================================================================================
Summary of plotting
================================================================================
Total number of plotuples considered: 23

A total of 19 warnings were issued.
* 'No reference object' was issued by 17 plotuples
* 'No description' was issued by 1 plotuples
* 'No Check' was issued by 1 plotuples
Success rate 26%. That's terrible!

Chi2 comparisons
* 'not_compared' was the result of 17 comparisons
* 'equal' was the result of 4 comparisons
* 'error' was the result of 2 comparisons
Weighted score:  72%. That still requires some work.

Success rate 80%. Way to go ;)
Command 'b2validation -p 4 --test --tag stack_test_3' exited with code 0
Removing 3886c11076:['reference', 'stack_test_1', 'stack_test_2']
Retaining 6d7ad4ca8d
Removing edd266ee78:['reference', 'stack_test_1']
Error 
Traceback (most recent call last):
  File "/data/b2soft/buildbot/development/releases/current/validation/tests/test_full_stack.py", line 221, in main
    success = success and check_for_content(
                          ^^^^^^^^^^^^^^^^^^
  File "/data/b2soft/buildbot/development/releases/current/validation/tests/test_full_stack.py", line 134, in check_for_content
    with splinter.Browser("firefox", headless=True) as browser:
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/cvmfs/belle.cern.ch/el9/externals/v02-03-03/Linux_x86_64/common/lib/python3.11/site-packages/splinter/browser.py", line 130, in Browser
    return get_driver(driver, retry_count=retry_count, config=config, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/cvmfs/belle.cern.ch/el9/externals/v02-03-03/Linux_x86_64/common/lib/python3.11/site-packages/splinter/browser.py", line 96, in get_driver
    raise err
  File "/cvmfs/belle.cern.ch/el9/externals/v02-03-03/Linux_x86_64/common/lib/python3.11/site-packages/splinter/browser.py", line 92, in get_driver
    return driver(config=config, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/cvmfs/belle.cern.ch/el9/externals/v02-03-03/Linux_x86_64/common/lib/python3.11/site-packages/splinter/driver/webdriver/firefox.py", line 83, in __init__
    driver = _setup_firefox(
             ^^^^^^^^^^^^^^^
  File "/cvmfs/belle.cern.ch/el9/externals/v02-03-03/Linux_x86_64/common/lib/python3.11/site-packages/splinter/driver/webdriver/setup.py", line 86, in _setup_firefox
    rv = driver_class(options=options, service=service, **kwargs)
         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/cvmfs/belle.cern.ch/el9/externals/v02-03-03/Linux_x86_64/common/lib/python3.11/site-packages/selenium/webdriver/firefox/webdriver.py", line 71, in __init__
    super().__init__(command_executor=executor, options=options)
  File "/cvmfs/belle.cern.ch/el9/externals/v02-03-03/Linux_x86_64/common/lib/python3.11/site-packages/selenium/webdriver/remote/webdriver.py", line 260, in __init__
    self.start_session(capabilities)
  File "/cvmfs/belle.cern.ch/el9/externals/v02-03-03/Linux_x86_64/common/lib/python3.11/site-packages/selenium/webdriver/remote/webdriver.py", line 357, in start_session
    response = self.execute(Command.NEW_SESSION, caps)["value"]
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/cvmfs/belle.cern.ch/el9/externals/v02-03-03/Linux_x86_64/common/lib/python3.11/site-packages/selenium/webdriver/remote/webdriver.py", line 448, in execute
    self.error_handler.check_response(response)
  File "/cvmfs/belle.cern.ch/el9/externals/v02-03-03/Linux_x86_64/common/lib/python3.11/site-packages/selenium/webdriver/remote/errorhandler.py", line 232, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.WebDriverException: Message: Process unexpectedly closed with status 255


=== stderr of validation/tests/test_full_stack.py ===
Starting validation...
Results will stored in a folder named "stack_test_1"...
The (full) log file(s) can be found at /tmp/tmpe1txrv2z/results/stack_test_1/b2validation.log
Please check these logs when encountering unexpected results, as most of the warnings and errors are not written to stdout/stderr.
Running in test mode
Release Folder: /data/b2soft/buildbot/development/releases/current
Local Folder: None
Collecting steering files...
Building headers for Script objects...
Building dependencies for Script objects...
Applying package selection for the following package(s): validation-test
Starting the validation...
Initializing local job control for plotting.
Local job control will use 4 parallel processes.
Selecting job control for all other jobs.
Controller: local (Multi-processing on the local machine)
Local job control will use 4 parallel processes.
Writing list of failed scripts to /tmp/tmpe1txrv2z/results/stack_test_1/list_of_failed_scripts.log.
Writing list of skipped scripts to /tmp/tmpe1txrv2z/results/stack_test_1/list_of_skipped_scripts.log.
Validation finished...
Start creating plots...
Plots have been created...

================================================================================
Summary of script execution
================================================================================
Total number of scripts: 5

No scripts were skipped. Nice!

1/5 scripts failed
* validation-test/validationTestFail_runlast_py

Validation finished! Total runtime: 5s
Starting validation...
Results will stored in a folder named "stack_test_2"...
The (full) log file(s) can be found at /tmp/tmpe1txrv2z/results/stack_test_2/b2validation.log
Please check these logs when encountering unexpected results, as most of the warnings and errors are not written to stdout/stderr.
Running in test mode
Release Folder: /data/b2soft/buildbot/development/releases/current
Local Folder: None
Collecting steering files...
Building headers for Script objects...
Building dependencies for Script objects...
Applying package selection for the following package(s): validation-test
Starting the validation...
Initializing local job control for plotting.
Local job control will use 4 parallel processes.
Selecting job control for all other jobs.
Controller: local (Multi-processing on the local machine)
Local job control will use 4 parallel processes.
Writing list of failed scripts to /tmp/tmpe1txrv2z/results/stack_test_2/list_of_failed_scripts.log.
Writing list of skipped scripts to /tmp/tmpe1txrv2z/results/stack_test_2/list_of_skipped_scripts.log.
Validation finished...
Start creating plots...
Plots have been created...

================================================================================
Summary of script execution
================================================================================
Total number of scripts: 5

No scripts were skipped. Nice!

1/5 scripts failed
* validation-test/validationTestFail_runlast_py

Validation finished! Total runtime: 5s
Starting validation...
Results will stored in a folder named "stack_test_3"...
The (full) log file(s) can be found at /tmp/tmpe1txrv2z/results/stack_test_3/b2validation.log
Please check these logs when encountering unexpected results, as most of the warnings and errors are not written to stdout/stderr.
Running in test mode
Release Folder: /data/b2soft/buildbot/development/releases/current
Local Folder: None
Collecting steering files...
Building headers for Script objects...
Building dependencies for Script objects...
Applying package selection for the following package(s): validation-test
Starting the validation...
Initializing local job control for plotting.
Local job control will use 4 parallel processes.
Selecting job control for all other jobs.
Controller: local (Multi-processing on the local machine)
Local job control will use 4 parallel processes.
Writing list of failed scripts to /tmp/tmpe1txrv2z/results/stack_test_3/list_of_failed_scripts.log.
Writing list of skipped scripts to /tmp/tmpe1txrv2z/results/stack_test_3/list_of_skipped_scripts.log.
Validation finished...
Start creating plots...
Plots have been created...

================================================================================
Summary of script execution
================================================================================
Total number of scripts: 5

No scripts were skipped. Nice!

1/5 scripts failed
* validation-test/validationTestFail_runlast_py

Validation finished! Total runtime: 5s
02:25:26 INFO     Serving static content from /data/b2soft/buildbot/development/releases/current/validation/html_static
02:25:26 INFO     Serving result content and plots from /tmp/tmpe1txrv2z
02:25:26 INFO     Removing old plots and unpopular combinations
02:25:26 INFO     Server: Starting HTTP server on :::8000
02:25:26 DEBUG    Starting new HTTPS connection (1): gitlab.desy.de:443
02:25:26 DEBUG    https://gitlab.desy.de:443 "GET /api/v4/user HTTP/11" 401 30
02:25:26 WARNING  Issue with authenticating GitLab. Please ensure access token is correct and valid. GitLab Integration will be disabled.
[13/Oct/2025:02:25:26] ENGINE Listening for SIGTERM.
02:25:26 INFO     [13/Oct/2025:02:25:26] ENGINE Listening for SIGTERM.
[13/Oct/2025:02:25:26] ENGINE Listening for SIGHUP.
02:25:26 INFO     [13/Oct/2025:02:25:26] ENGINE Listening for SIGHUP.
[13/Oct/2025:02:25:26] ENGINE Listening for SIGUSR1.
02:25:26 INFO     [13/Oct/2025:02:25:26] ENGINE Listening for SIGUSR1.
[13/Oct/2025:02:25:26] ENGINE Bus STARTING
02:25:26 INFO     [13/Oct/2025:02:25:26] ENGINE Bus STARTING
[13/Oct/2025:02:25:26] ENGINE Started monitor thread 'Autoreloader'.
02:25:26 INFO     [13/Oct/2025:02:25:26] ENGINE Started monitor thread 'Autoreloader'.
[13/Oct/2025:02:25:26] ENGINE Serving on http://:::8000
02:25:26 INFO     [13/Oct/2025:02:25:26] ENGINE Serving on http://:::8000
[13/Oct/2025:02:25:26] ENGINE Bus STARTED
02:25:26 INFO     [13/Oct/2025:02:25:26] ENGINE Bus STARTED
[13/Oct/2025:02:25:27] ENGINE Caught signal SIGTERM.
02:25:27 INFO     [13/Oct/2025:02:25:27] ENGINE Caught signal SIGTERM.
[13/Oct/2025:02:25:27] ENGINE Bus STOPPING
02:25:27 INFO     [13/Oct/2025:02:25:27] ENGINE Bus STOPPING
[13/Oct/2025:02:25:27] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 8000)) shut down
02:25:27 INFO     [13/Oct/2025:02:25:27] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 8000)) shut down
[13/Oct/2025:02:25:27] ENGINE Stopped thread 'Autoreloader'.
02:25:27 INFO     [13/Oct/2025:02:25:27] ENGINE Stopped thread 'Autoreloader'.
[13/Oct/2025:02:25:27] ENGINE Bus STOPPED
02:25:27 INFO     [13/Oct/2025:02:25:27] ENGINE Bus STOPPED
[13/Oct/2025:02:25:27] ENGINE Bus EXITING
02:25:27 INFO     [13/Oct/2025:02:25:27] ENGINE Bus EXITING
[13/Oct/2025:02:25:27] ENGINE Bus EXITED
02:25:27 INFO     [13/Oct/2025:02:25:27] ENGINE Bus EXITED
[13/Oct/2025:02:25:27] ENGINE Waiting for child threads to terminate...
02:25:27 INFO     [13/Oct/2025:02:25:27] ENGINE Waiting for child threads to terminate...
=== end validation/tests/test_full_stack.py ===