Belle II Software development
SplitNMergeSimTask Class Reference
Inheritance diagram for SplitNMergeSimTask:
LSFTask

Public Member Functions

 output_file_name (self, n_events=None, random_seed=None)
 Name of the ROOT output file with generated and simulated events.
 
 output (self)
 
 requires (self)
 
 process (self)
 
 on_success (self)
 
 remove_output (self)
 

Public Attributes

 job_name = self.task_id
 set the job name (inherited variable)
 

Static Public Attributes

 experiment_number = b2luigi.IntParameter()
 Experiment number of the conditions database, e.g.
 
 n_events = b2luigi.IntParameter()
 Number of events to generate.
 
 random_seed = b2luigi.Parameter()
 Random basf2 seed.
 
 bkgfiles_dir
 Directory with overlay background root files.
 
str batch_system = 'lsf'
 batch system
 
str queue = 's'
 queue
 

Detailed Description

Generate simulated Monte Carlo with background overlay.

Make sure to use different ``random_seed`` parameters for the training data
format the classifier trainings and for the test data for the respective
evaluation/validation tasks.

Definition at line 277 of file cdc_and_svd_ckf_merger_mva_training.py.

Member Function Documentation

◆ on_success()

on_success ( self)
On success method.

Definition at line 359 of file cdc_and_svd_ckf_merger_mva_training.py.

359 def on_success(self):
360 """
361 On success method.
362 """
363 print("Finished merging. Now remove the input files to save space.")
364 file_list = [f for f in self.get_all_input_file_names()]
365 for input_file in file_list:
366 try:
367 os.remove(input_file)
368 except FileNotFoundError:
369 pass
370

◆ output()

output ( self)
Generate list of output files that the task should produce.
The task is considered finished if and only if the outputs all exist.

Definition at line 315 of file cdc_and_svd_ckf_merger_mva_training.py.

315 def output(self):
316 """
317 Generate list of output files that the task should produce.
318 The task is considered finished if and only if the outputs all exist.
319 """
320 yield self.add_to_output(self.output_file_name())
321

◆ output_file_name()

output_file_name ( self,
n_events = None,
random_seed = None )

Name of the ROOT output file with generated and simulated events.

Create output file name depending on number of events and production
mode that is specified in the random_seed string.

:param n_events: Number of events to simulate.
:param random_seed: Random seed to use for the simulation to create independent samples.

Definition at line 301 of file cdc_and_svd_ckf_merger_mva_training.py.

301 def output_file_name(self, n_events=None, random_seed=None):
302 """
303 Create output file name depending on number of events and production
304 mode that is specified in the random_seed string.
305
306 :param n_events: Number of events to simulate.
307 :param random_seed: Random seed to use for the simulation to create independent samples.
308 """
309 if n_events is None:
310 n_events = self.n_events
311 if random_seed is None:
312 random_seed = self.random_seed
313 return "generated_mc_N" + str(n_events) + "_" + random_seed + ".root"
314

◆ process()

process ( self)
When all GenerateSimTasks finished, merge the output.

Definition at line 346 of file cdc_and_svd_ckf_merger_mva_training.py.

346 def process(self):
347 """
348 When all GenerateSimTasks finished, merge the output.
349 """
350 create_output_dirs(self)
351
352 file_list = [f for f in self.get_all_input_file_names()]
353 print("Merge the following files:")
354 print(file_list)
355 cmd = ["b2file-merge", "-f"]
356 args = cmd + [self.get_output_file_name(self.output_file_name())] + file_list
357 subprocess.check_call(args)
358

◆ remove_output()

remove_output ( self)
Default function from base b2luigi.Task class.

Definition at line 371 of file cdc_and_svd_ckf_merger_mva_training.py.

371 def remove_output(self):
372 """
373 Default function from base b2luigi.Task class.
374 """
375 self._remove_output()
376
377

◆ requires()

requires ( self)
This task requires several GenerateSimTask to be finished so that he required number of events is created.

Definition at line 322 of file cdc_and_svd_ckf_merger_mva_training.py.

322 def requires(self):
323 """
324 This task requires several GenerateSimTask to be finished so that he required number of events is created.
325 """
326 n_events_per_task = SummaryTask.n_events_per_task
327 quotient, remainder = divmod(self.n_events, n_events_per_task)
328 for i in range(quotient):
329 yield GenerateSimTask(
330 bkgfiles_dir=self.bkgfiles_dir,
331 num_processes=SummaryTask.num_processes,
332 random_seed=self.random_seed + '_' + str(i).zfill(3),
333 n_events=n_events_per_task,
334 experiment_number=self.experiment_number,
335 )
336 if remainder > 0:
337 yield GenerateSimTask(
338 bkgfiles_dir=self.bkgfiles_dir,
339 num_processes=SummaryTask.num_processes,
340 random_seed=self.random_seed + '_' + str(quotient).zfill(3),
341 n_events=remainder,
342 experiment_number=self.experiment_number,
343 )
344

Member Data Documentation

◆ batch_system

str batch_system = 'lsf'
staticinherited

batch system

Definition at line 177 of file cdc_and_svd_ckf_merger_mva_training.py.

◆ bkgfiles_dir

bkgfiles_dir
static
Initial value:
= b2luigi.Parameter(
)

Directory with overlay background root files.

Definition at line 294 of file cdc_and_svd_ckf_merger_mva_training.py.

◆ experiment_number

experiment_number = b2luigi.IntParameter()
static

Experiment number of the conditions database, e.g.

defines simulation geometry

Definition at line 287 of file cdc_and_svd_ckf_merger_mva_training.py.

◆ job_name

job_name = self.task_id
inherited

set the job name (inherited variable)

Definition at line 185 of file cdc_and_svd_ckf_merger_mva_training.py.

◆ n_events

n_events = b2luigi.IntParameter()
static

Number of events to generate.

Definition at line 289 of file cdc_and_svd_ckf_merger_mva_training.py.

◆ queue

str queue = 's'
staticinherited

queue

Definition at line 179 of file cdc_and_svd_ckf_merger_mva_training.py.

◆ random_seed

random_seed = b2luigi.Parameter()
static

Random basf2 seed.

It is further used to read of the production process to preserve clearness in the b2luigi output.

Definition at line 292 of file cdc_and_svd_ckf_merger_mva_training.py.


The documentation for this class was generated from the following file: