MCParticleHarvester Class Reference

Inheritance diagram for MCParticleHarvester:

Public Member Functions
	__init__ (self)
	pick (self, mc_particle)
	generate_cluster_dicts (self, charge_list, path_length_list, normalized_charge_list, name)
	peel (self, mc_particle)
	id (self)
	initialize (self)
	event (self)
	terminate (self)
	barn (self)
	gather (self)
	prepare (self)
	refine (self, crops)

Static Public Member Functions
	create_crop_part_collection ()
	iter_store_obj (store_obj)

Public Attributes
	foreach = foreach
	Name of the StoreArray or iterable StoreObjPtr that contains the objects to be harvested.
	output_file_name = output_file_name
	Name of the ROOT output file to be generated.
	title = title or self.name()
	Name of this harvest.
	contact = contact
	Contact email address to be displayed on the validation page.
int	expert_level = self.default_expert_level if expert_level is None else expert_level
	Integer expert level that controls to detail of plots to be generated.
list	refiners = []
	A list of additional refiner instances to be executed on top of the refiner methods that are members of this class.
	show_results = show_results
	Switch to show the result ROOT file in a TBrowser on terminate.
	stash = self.barn()
	stash of the harvested crops (start with those in the barn)
	crops
	the dictionaries from peel
	raw_crops = raw_crops
	the dictionaries from peel as a numpy.array of doubles

Static Public Attributes
	save_tree = refiners.SaveTreeRefiner()
	Refiners to be executed at the end of the harvesting / termination of the module Save a tree of all collected variables in a sub folder.
int	default_expert_level = 1
	The default value of expert_level if not specified explicitly by the caller.

Detailed Description

 A harvester to redo parts of the analysis in the Belle II Paper by Robert 

Definition at line 85 of file harvester.py.

Constructor & Destructor Documentation

__init__()

__init__

(

self

)

Constructor

Definition at line 89 of file harvester.py.

    def __init__(self):
        """Constructor"""
        HarvestingModule.__init__(self, foreach="MCParticles", output_file_name="mc_particle.root")
 

Member Function Documentation

barn()

barn ( self )

inherited

Coroutine that receives the dictionaries of names and values from peel and store them.

Reimplemented in PickleHarvestingModule.

Definition at line 287 of file harvesting.py.

    def barn(self):
        """Coroutine that receives the dictionaries of names and values from peel and store them."""
        crop = (yield)
        raw_crops = copy.copy(crop)
        crops = copy.copy(crop)
 
        if isinstance(crop, numbers.Number):
            raw_crops = self.create_crop_part_collection()
            try:
                while True:
                    raw_crops.append(crop)
                    # next crop
                    crop = (yield)
            except GeneratorExit:
                crops = np.array(raw_crops)
 
        elif isinstance(crop, collections.abc.MutableMapping):
            for part_name in crop:
                raw_crops[part_name] = self.create_crop_part_collection()
 
            try:
                while True:
                    for part_name, parts in list(raw_crops.items()):
                        if part_name in crop:
                            parts.append(crop[part_name])
                        else:
                            parts.append(np.NaN)
                    # next crop
                    crop = (yield)
            except GeneratorExit:
                for part_name, parts in list(raw_crops.items()):
                    crops[part_name] = np.array(parts)
 
        else:
            msg = f"Unrecognised crop {crop} of type {type(crop)}"
            raise ValueError(msg)
 
        
        self.raw_crops = raw_crops
        
        self.crops = crops
 

create_crop_part_collection()

create_crop_part_collection ( )

staticinherited

Create the storing objects for the crop values

Currently a numpy.array of doubles is used to store all values in memory.

Definition at line 279 of file harvesting.py.

    def create_crop_part_collection():
        """Create the storing objects for the crop values
 
        Currently a numpy.array of doubles is used to store all values in memory.
        """
        return array.array("d")
 

event()

event ( self )

inherited

Event method of the module

* Does invoke the prepare method before the iteration starts.
* In each event fetch the StoreArray / iterable StoreObjPtr,
* Iterate through all instances
* Feed each instance to the pick method to decide it the instance is relevant
* Forward it to the peel method that should generated a dictionary of values
* Store each dictionary of values

Definition at line 239 of file harvesting.py.

    def event(self):
        """Event method of the module
 
        * Does invoke the prepare method before the iteration starts.
        * In each event fetch the StoreArray / iterable StoreObjPtr,
        * Iterate through all instances
        * Feed each instance to the pick method to decide it the instance is relevant
        * Forward it to the peel method that should generated a dictionary of values
        * Store each dictionary of values
        """
        self.prepare()
        stash = self.stash.send
        pick = self.pick
        peel = self.peel
        for crop in self.gather():
            if pick(crop):
                crop = peel(crop)
                if isinstance(crop, types.GeneratorType):
                    many_crops = crop
                    for crop in many_crops:
                        stash(crop)
                else:
                    stash(crop)
 

gather()

gather ( self )

inherited

Iterator that yield the instances form the StoreArray / iterable StoreObj.

Yields
------
Object instances from the StoreArray, iterable StoreObj or the StoreObj itself
in case it is not iterable.

Definition at line 329 of file harvesting.py.

    def gather(self):
        """Iterator that yield the instances form the StoreArray / iterable StoreObj.
 
        Yields
        ------
        Object instances from the StoreArray, iterable StoreObj or the StoreObj itself
        in case it is not iterable.
        """
 
        registered_store_arrays = Belle2.PyStoreArray.list()
        registered_store_objs = Belle2.PyStoreObj.list()
 
        foreach = self.foreach
        foreach_is_store_obj = foreach in registered_store_objs
        foreach_is_store_array = foreach in registered_store_arrays
 
        if foreach is not None:
            if foreach_is_store_array:
                store_array = Belle2.PyStoreArray(self.foreach)
                yield from store_array
 
            elif foreach_is_store_obj:
                store_obj = Belle2.PyStoreObj(self.foreach)
                try:
                    yield from self.iter_store_obj(store_obj)
                except TypeError:
                    # Cannot iter the store object. Yield it instead.
                    yield store_obj.obj()
 
            else:
                msg = f"Name {self.foreach} does not refer to a valid object on the data store"
                raise KeyError(msg)
        else:
            yield None
 

generate_cluster_dicts()

generate_cluster_dicts	(		self,
			charge_list,
			path_length_list,
			normalized_charge_list,
			name )

Create a dictionary from the lists of charges, normalized charges, and path lengths of the
   clusters associated with an MCParticle

Definition at line 101 of file harvester.py.

    def generate_cluster_dicts(self, charge_list, path_length_list, normalized_charge_list, name):
        """Create a dictionary from the lists of charges, normalized charges, and path lengths of the
           clusters associated with an MCParticle"""
        result = dict()
 
        truncated, first4, first6 = VXDMomentumEnergyEstimator.generate_truncated(normalized_charge_list)
 
        result.update({f"sum_{name}_charges": sum(charge_list)})
        result.update({f"mean_{name}_charges": np.mean(charge_list)})
        result.update({f"sum_{name}_normalized_charges": sum(normalized_charge_list)})
        result.update({f"mean_{name}_normalized_charges": np.mean(normalized_charge_list)})
 
        result.update({f"sum_{name}_normalized_charges_truncated": sum(truncated)})
        result.update({f"mean_{name}_normalized_charges_truncated": np.mean(truncated)})
        result.update({f"sum_{name}_normalized_charges_first4": sum(first4)})
        result.update({f"mean_{name}_normalized_charges_first4": np.mean(first4)})
        result.update({f"sum_{name}_normalized_charges_first6": sum(first6)})
        result.update({f"mean_{name}_normalized_charges_first6": np.mean(first6)})
 
        return result
 

id()

id ( self )

inherited

Working around that name() is a method.

Exposing the name as a property using a different name

Definition at line 224 of file harvesting.py.

    def id(self):
        """Working around that name() is a method.
 
        Exposing the name as a property using a different name
        """
        return self.name()
 

initialize()

initialize ( self )

inherited

Initialisation method of the module.

Prepares the receiver stash of objects to be harvestered.

Reimplemented in ClusterFilterValidationModule, ElossHarvestingModule, LegendreBinningValidationModule, SegmentFitValidationModule, SegmentPairFitValidationModule, Saving1stMVAData, Saving2ndMVAData, SegmentPairCreationValidationModule, EventwiseTrackingValidationModule, MCSideTrackingValidationModule, and PRSideTrackingValidationModule.

Definition at line 231 of file harvesting.py.

    def initialize(self):
        """Initialisation method of the module.
 
        Prepares the receiver stash of objects to be harvestered.
        """
        
        self.stash = self.barn()
 

iter_store_obj()

iter_store_obj ( store_obj )

staticinherited

Obtain a iterator from a StoreObj

Repeatedly calls iter(store_obj) or store_obj.__iter__()
until the final iterator returns itself

Returns
-------
iterator of the StoreObj

Definition at line 443 of file harvesting.py.

    def iter_store_obj(store_obj):
        """Obtain a iterator from a StoreObj
 
        Repeatedly calls iter(store_obj) or store_obj.__iter__()
        until the final iterator returns itself
 
        Returns
        -------
        iterator of the StoreObj
        """
        iterable = store_obj.obj()
        last_iterable = None
        while iterable is not last_iterable:
            if hasattr(iterable, "__iter__"):
                iterable, last_iterable = iterable.__iter__(), iterable
            else:
                iterable, last_iterable = iter(iterable), iterable
        return iterable
 
 

peel()

peel	(		self,
			mc_particle )

Aggregate the PXD and SVD cluster information for an MCParticle

Reimplemented from HarvestingModule.

Definition at line 122 of file harvester.py.

    def peel(self, mc_particle):
        """Aggregate the PXD and SVD cluster information for an MCParticle"""
        result = dict()
 
        pxd_clusters = mc_particle.getRelationsFrom("PXDClusters")
        svd_clusters = mc_particle.getRelationsFrom("SVDClusters")
 
        pxd_results = VXDMomentumEnergyEstimator.calculate_charges_and_path_lengths_for_one_type(pxd_clusters, mc_particle)
        svd_results = VXDMomentumEnergyEstimator.calculate_charges_and_path_lengths_for_one_type(svd_clusters, mc_particle)
 
        pxd_cluster_dicts = self.generate_cluster_dicts(*pxd_results, name="pxd")
        pxd_charges, pxd_path_length, pxd_normalized_charges = pxd_results
 
        svd_charges, svd_path_length, svd_normalized_charges = svd_results
        svd_cluster_dicts = self.generate_cluster_dicts(*svd_results, name="svd")
 
        combined_cluster_dicts = self.generate_cluster_dicts(pxd_charges + svd_charges,
                                                             pxd_path_length + svd_path_length,
                                                             pxd_normalized_charges + svd_normalized_charges,
                                                             name="combined")
 
        result.update(pxd_cluster_dicts)
        result.update(svd_cluster_dicts)
        result.update(combined_cluster_dicts)
 
        return result
 

pick()

pick	(		self,
			mc_particle )

Select the MCParticle if it is a primary pion and has some PXD and/or SVD clusters

Reimplemented from HarvestingModule.

Definition at line 93 of file harvester.py.

    def pick(self, mc_particle):
        """Select the MCParticle if it is a primary pion and has some PXD and/or SVD clusters"""
        pxd_clusters = mc_particle.getRelationsFrom("PXDClusters")
        svd_clusters = mc_particle.getRelationsFrom("SVDClusters")
        return (mc_particle.hasStatus(Belle2.MCParticle.c_PrimaryParticle) and
                abs(mc_particle.getPDG()) == 211 and
                len(pxd_clusters) + len(svd_clusters) > 0)
 

prepare()

prepare ( self )

inherited

Default implementation of prepare.

Can be overridden by subclasses.

Reimplemented in ClusterFilterValidationModule, FitValidationModule, SegmentFakeRatesModule, ElossHarvestingModule, LegendreBinningValidationModule, SegmentFitValidationModule, SegmentPairFitValidationModule, Saving1stMVAData, Saving2ndMVAData, SegmentPairCreationValidationModule, MCSideTrackingValidationModule, and PRSideTrackingValidationModule.

Definition at line 364 of file harvesting.py.

    def prepare(self):
        """Default implementation of prepare.
 
        Can be overridden by subclasses.
        """
        return
 

refine()

refine ( self, crops )

inherited

Receive the gathered crops and forward them to the refiners.

Reimplemented in PickleHarvestingModule.

Definition at line 398 of file harvesting.py.

    def refine(self, crops):
        """Receive the gathered crops and forward them to the refiners."""
 
        kwds = {}
        if self.output_file_name:
            # Save everything to a ROOT file
            if isinstance(self.output_file_name, ROOT.TFile):
                output_tdirectory = self.output_file_name
            else:
                output_tfile = ROOT.TFile(self.output_file_name, 'recreate')
                output_tdirectory = output_tfile
 
        else:
            output_tdirectory = None
 
        try:
            with root_cd(output_tdirectory):
                for refiner in self.refiners:
                    refiner(self, crops, tdirectory=output_tdirectory, **kwds)
 
                # Get the methods marked as refiners from the class
                cls = type(self)
                for name in dir(cls):
                    if isinstance(getattr(cls, name), Refiner):
                        refiner = getattr(self, name)
                        # Getattr already binds self
                        refiner(crops, tdirectory=output_tdirectory, **kwds)
 
        finally:
            # If we opened the TFile ourself, close it again
            if self.output_file_name:
                if isinstance(self.output_file_name, str):
                    output_tfile.Close()
 
        if self.show_results and self.output_file_name:
            if isinstance(self.output_file_name, str):
                output_tfile = ROOT.TFile(self.output_file_name)
                root_browse(output_tfile)
                input("Press enter to close")
                output_tfile.Close()
            else:
                root_browse(self.output_file_name)
                input("Press enter to close")
 

terminate()

terminate ( self )

inherited

Termination method of the module.

Finalize the collected crops.
Start the refinement.

Reimplemented in ClusterFilterValidationModule.

Definition at line 263 of file harvesting.py.

    def terminate(self):
        """Termination method of the module.
 
        Finalize the collected crops.
        Start the refinement.
        """
 
        self.stash.close()
        del self.stash
 
        try:
            self.refine(self.crops)
        except AttributeError:
            pass
 

Member Data Documentation

contact

contact = contact

inherited

Contact email address to be displayed on the validation page.

Definition at line 211 of file harvesting.py.

crops

crops

inherited

the dictionaries from peel

Definition at line 274 of file harvesting.py.

default_expert_level

int default_expert_level = 1

staticinherited

The default value of expert_level if not specified explicitly by the caller.

Definition at line 156 of file harvesting.py.

expert_level

int expert_level = self.default_expert_level if expert_level is None else expert_level

inherited

Integer expert level that controls to detail of plots to be generated.

Definition at line 214 of file harvesting.py.

foreach

foreach = foreach

inherited

Name of the StoreArray or iterable StoreObjPtr that contains the objects to be harvested.

Definition at line 196 of file harvesting.py.

output_file_name

output_file_name = output_file_name

inherited

Name of the ROOT output file to be generated.

Definition at line 199 of file harvesting.py.

raw_crops

raw_crops = raw_crops

inherited

the dictionaries from peel as a numpy.array of doubles

Definition at line 325 of file harvesting.py.

refiners

list refiners = []

inherited

A list of additional refiner instances to be executed on top of the refiner methods that are members of this class.

Definition at line 218 of file harvesting.py.

save_tree

save_tree = refiners.SaveTreeRefiner()

static

Refiners to be executed at the end of the harvesting / termination of the module Save a tree of all collected variables in a sub folder.

Definition at line 151 of file harvester.py.

show_results

show_results = show_results

inherited

Switch to show the result ROOT file in a TBrowser on terminate.

Definition at line 221 of file harvesting.py.

stash

stash = self.barn()

inherited

stash of the harvested crops (start with those in the barn)

Definition at line 237 of file harvesting.py.

title

title = title or self.name()

inherited

Name of this harvest.

Title particle of this harvest

Definition at line 208 of file harvesting.py.

---

The documentation for this class was generated from the following file:

• tracking/studies/low_momentum_vxd_estimation/harvester.py