Belle II Software development
CDCDedxBadWireAlgorithm Class Reference

A calibration algorithm for CDC dE/dx to find the bad wires. More...

#include <CDCDedxBadWireAlgorithm.h>

Inheritance diagram for CDCDedxBadWireAlgorithm:
CalibrationAlgorithm

Public Types

enum  EResult {
  c_OK ,
  c_Iterate ,
  c_NotEnoughData ,
  c_Failure ,
  c_Undefined
}
 The result of calibration. More...
 

Public Member Functions

 CDCDedxBadWireAlgorithm ()
 Constructor: Sets the description, the properties and the parameters of the algorithm.
 
virtual ~CDCDedxBadWireAlgorithm ()
 Destructor.
 
void setMonitoringPlots (bool value=false)
 function to enable plotting
 
void setHighFracThres (double value)
 function to set high dedx fraction threshold
 
void setRMSThres (double value)
 function to set RMS Threshold
 
void setMeanThres (double value)
 function to set Mean Threshold
 
void setADC (bool value=false)
 function to choose adc or dedx as variable
 
void setHistPars (int nbin, double min, double max)
 function to set adc/dedx parameters
 
void getExpRunInfo ()
 function to get extract calibration run/exp
 
void plotWireDist (const std::vector< double > &inwires, std::map< int, std::vector< double > > &vhitvar)
 function to draw per wire plots
 
void printCanvas (TList *list, TList *hflist, Color_t color)
 function to print canvas
 
void plotBadWireMap (const std::vector< double > &vbadwires, const std::vector< double > &vdeadwires)
 function to plot wire status map (all, bad and dead)
 
TH2F * getHistoPattern (const std::vector< double > &inwires, const std::string &suffix, int &total)
 function to get wire map with input file (all, bad and dead)
 
void plotQaPars (std::map< int, std::vector< double > > &qapars)
 function to plot the QA (decision) parameters
 
void plotEventStats ()
 function to draw the stats
 
void setTextCosmetics (TPaveText *pt, double size)
 function to change text styles
 
void setHistCosmetics (TH2F *hist, Color_t color)
 function to change histogram styles
 
std::string getPrefix () const
 Get the prefix used for getting calibration data.
 
bool checkPyExpRun (PyObject *pyObj)
 Checks that a PyObject can be successfully converted to an ExpRun type.
 
Calibration::ExpRun convertPyExpRun (PyObject *pyObj)
 Performs the conversion of PyObject to ExpRun.
 
std::string getCollectorName () const
 Alias for prefix.
 
void setPrefix (const std::string &prefix)
 Set the prefix used to identify datastore objects.
 
void setInputFileNames (PyObject *inputFileNames)
 Set the input file names used for this algorithm from a Python list.
 
PyObject * getInputFileNames ()
 Get the input file names used for this algorithm and pass them out as a Python list of unicode strings.
 
std::vector< Calibration::ExpRun > getRunListFromAllData () const
 Get the complete list of runs from inspection of collected data.
 
RunRange getRunRangeFromAllData () const
 Get the complete RunRange from inspection of collected data.
 
IntervalOfValidity getIovFromAllData () const
 Get the complete IoV from inspection of collected data.
 
void fillRunToInputFilesMap ()
 Fill the mapping of ExpRun -> Files.
 
std::string getGranularity () const
 Get the granularity of collected data.
 
EResult execute (std::vector< Calibration::ExpRun > runs={}, int iteration=0, IntervalOfValidity iov=IntervalOfValidity())
 Runs calibration over vector of runs for a given iteration.
 
EResult execute (PyObject *runs, int iteration=0, IntervalOfValidity iov=IntervalOfValidity())
 Runs calibration over Python list of runs. Converts to C++ and then calls the other execute() function.
 
std::list< Database::DBImportQuery > & getPayloads ()
 Get constants (in TObjects) for database update from last execution.
 
std::list< Database::DBImportQuerygetPayloadValues ()
 Get constants (in TObjects) for database update from last execution but passed by VALUE.
 
bool commit ()
 Submit constants from last calibration into database.
 
bool commit (std::list< Database::DBImportQuery > payloads)
 Submit constants from a (potentially previous) set of payloads.
 
const std::string & getDescription () const
 Get the description of the algorithm (set by developers in constructor)
 
bool loadInputJson (const std::string &jsonString)
 Load the m_inputJson variable from a string (useful from Python interface). The return bool indicates success or failure.
 
const std::string dumpOutputJson () const
 Dump the JSON string of the output JSON object.
 
const std::vector< Calibration::ExpRun > findPayloadBoundaries (std::vector< Calibration::ExpRun > runs, int iteration=0)
 Used to discover the ExpRun boundaries that you want the Python CAF to execute on. This is optional and only used in some.
 
template<>
std::shared_ptr< TTree > getObjectPtr (const std::string &name, const std::vector< Calibration::ExpRun > &requestedRuns)
 Specialization of getObjectPtr<TTree>.
 

Protected Member Functions

virtual EResult calibrate () override
 cdcdedx badwire algorithm
 
void setInputFileNames (std::vector< std::string > inputFileNames)
 Set the input file names used for this algorithm.
 
virtual bool isBoundaryRequired (const Calibration::ExpRun &)
 Given the current collector data, make a decision about whether or not this run should be the start of a payload boundary.
 
virtual void boundaryFindingSetup (std::vector< Calibration::ExpRun >, int)
 If you need to make some changes to your algorithm class before 'findPayloadBoundaries' is run, make them in this function.
 
virtual void boundaryFindingTearDown ()
 Put your algorithm back into a state ready for normal execution if you need to.
 
const std::vector< Calibration::ExpRun > & getRunList () const
 Get the list of runs for which calibration is called.
 
int getIteration () const
 Get current iteration.
 
std::vector< std::string > getVecInputFileNames () const
 Get the input file names used for this algorithm as a STL vector.
 
template<class T>
std::shared_ptr< T > getObjectPtr (const std::string &name, const std::vector< Calibration::ExpRun > &requestedRuns)
 Get calibration data object by name and list of runs, the Merge function will be called to generate the overall object.
 
template<class T>
std::shared_ptr< T > getObjectPtr (std::string name)
 Get calibration data object (for all runs the calibration is requested for) This function will only work during or after execute() has been called once.
 
template<>
shared_ptr< TTree > getObjectPtr (const string &name, const vector< ExpRun > &requestedRuns)
 We cheekily cast the TChain to TTree for the returned pointer so that the user never knows Hopefully this doesn't cause issues if people do low level stuff to the tree...
 
std::string getGranularityFromData () const
 Get the granularity of collected data.
 
void saveCalibration (TClonesArray *data, const std::string &name)
 Store DBArray payload with given name with default IOV.
 
void saveCalibration (TClonesArray *data, const std::string &name, const IntervalOfValidity &iov)
 Store DBArray with given name and custom IOV.
 
void saveCalibration (TObject *data)
 Store DB payload with default name and default IOV.
 
void saveCalibration (TObject *data, const IntervalOfValidity &iov)
 Store DB payload with default name and custom IOV.
 
void saveCalibration (TObject *data, const std::string &name)
 Store DB payload with given name with default IOV.
 
void saveCalibration (TObject *data, const std::string &name, const IntervalOfValidity &iov)
 Store DB payload with given name and custom IOV.
 
void updateDBObjPtrs (const unsigned int event, const int run, const int experiment)
 Updates any DBObjPtrs by calling update(event) for DBStore.
 
void setDescription (const std::string &description)
 Set algorithm description (in constructor)
 
void clearCalibrationData ()
 Clear calibration data.
 
Calibration::ExpRun getAllGranularityExpRun () const
 Returns the Exp,Run pair that means 'Everything'. Currently unused.
 
void resetInputJson ()
 Clears the m_inputJson member variable.
 
void resetOutputJson ()
 Clears the m_outputJson member variable.
 
template<class T>
void setOutputJsonValue (const std::string &key, const T &value)
 Set a key:value pair for the outputJson object, expected to used internally during calibrate()
 
template<class T>
const T getOutputJsonValue (const std::string &key) const
 Get a value using a key from the JSON output object, not sure why you would want to do this.
 
template<class T>
const T getInputJsonValue (const std::string &key) const
 Get an input JSON value using a key. The normal exceptions are raised when the key doesn't exist.
 
const nlohmann::json & getInputJsonObject () const
 Get the entire top level JSON object. We explicitly say this must be of object type so that we might pick.
 
bool inputJsonKeyExists (const std::string &key) const
 Test for a key in the input JSON object.
 

Protected Attributes

std::vector< Calibration::ExpRun > m_boundaries
 When using the boundaries functionality from isBoundaryRequired, this is used to store the boundaries. It is cleared when.
 

Private Member Functions

std::string getExpRunString (Calibration::ExpRun &expRun) const
 Gets the "exp.run" string repr. of (exp,run)
 
std::string getFullObjectPath (const std::string &name, Calibration::ExpRun expRun) const
 constructs the full TDirectory + Key name of an object in a TFile based on its name and exprun
 

Private Attributes

unsigned int c_nwireCDC
 number of wires in CDC
 
bool m_isMakePlots
 produce plots for status
 
bool m_isADC
 Use adc if(true) else dedx for calibration.
 
int m_varBins
 number of bins for input variable
 
double m_varMin
 min range for input variable
 
double m_varMax
 max range for input variable
 
double m_meanThres
 mean Threshold accepted for good wire
 
double m_rmsThres
 rms Threshold accepted for good wire
 
double m_fracThres
 high-frac Threshold accepted for good wire
 
double m_amean
 average mean of dedx for all wires
 
double m_arms
 average rms of dedx for all wires
 
std::string m_varName
 std::string to set var name (adc or dedx)
 
std::string m_suffix
 suffix std::string for naming plots
 
DBObjPtr< CDCDedxBadWiresm_DBBadWires
 Badwire DB object.
 
DBObjPtr< CDCDedxWireGainm_DBWireGains
 Wiregain DB object.
 
DBObjPtr< CDCGeometrym_cdcGeo
 Geometry of CDC.
 
std::vector< std::string > m_inputFileNames
 List of input files to the Algorithm, will initially be user defined but then gets the wildcards expanded during execute()
 
std::map< Calibration::ExpRun, std::vector< std::string > > m_runsToInputFiles
 Map of Runs to input files. Gets filled when you call getRunRangeFromAllData, gets cleared when setting input files again.
 
std::string m_granularityOfData
 Granularity of input data. This only changes when the input files change so it isn't specific to an execution.
 
ExecutionData m_data
 Data specific to a SINGLE execution of the algorithm. Gets reset at the beginning of execution.
 
std::string m_description {""}
 Description of the algorithm.
 
std::string m_prefix {""}
 The name of the TDirectory the collector objects are contained within.
 
nlohmann::json m_jsonExecutionInput = nlohmann::json::object()
 Optional input JSON object used to make decisions about how to execute the algorithm code.
 
nlohmann::json m_jsonExecutionOutput = nlohmann::json::object()
 Optional output JSON object that can be set during the execution by the underlying algorithm code.
 

Static Private Attributes

static const Calibration::ExpRun m_allExpRun = make_pair(-1, -1)
 allExpRun
 

Detailed Description

A calibration algorithm for CDC dE/dx to find the bad wires.

Definition at line 36 of file CDCDedxBadWireAlgorithm.h.

Member Enumeration Documentation

◆ EResult

enum EResult
inherited

The result of calibration.

Enumerator
c_OK 

Finished successfully =0 in Python.

c_Iterate 

Needs iteration =1 in Python.

c_NotEnoughData 

Needs more data =2 in Python.

c_Failure 

Failed =3 in Python.

c_Undefined 

Not yet known (before execution) =4 in Python.

Definition at line 40 of file CalibrationAlgorithm.h.

40 {
41 c_OK,
42 c_Iterate,
43 c_NotEnoughData,
44 c_Failure,
45 c_Undefined
46 };

Constructor & Destructor Documentation

◆ CDCDedxBadWireAlgorithm()

Constructor: Sets the description, the properties and the parameters of the algorithm.

Definition at line 26 of file CDCDedxBadWireAlgorithm.cc.

26 :
27 CalibrationAlgorithm("CDCDedxElectronCollector"),
28 c_nwireCDC(c_nSenseWires),
29 m_isMakePlots(true),
30 m_isADC(false),
31 m_varBins(100),
32 m_varMin(0.0),
33 m_varMax(7.0),
34 m_meanThres(1.0),
35 m_rmsThres(1.0),
36 m_fracThres(1.0),
37 m_varName("hitdedx"),
38 m_suffix("")
39{
40 // Set module properties
41 setDescription("A calibration algorithm for CDC dE/dx bad wires");
42}
double m_varMax
max range for input variable
double m_rmsThres
rms Threshold accepted for good wire
double m_varMin
min range for input variable
std::string m_varName
std::string to set var name (adc or dedx)
unsigned int c_nwireCDC
number of wires in CDC
bool m_isMakePlots
produce plots for status
std::string m_suffix
suffix std::string for naming plots
double m_meanThres
mean Threshold accepted for good wire
double m_fracThres
high-frac Threshold accepted for good wire
int m_varBins
number of bins for input variable
bool m_isADC
Use adc if(true) else dedx for calibration.
void setDescription(const std::string &description)
Set algorithm description (in constructor)
CalibrationAlgorithm(const std::string &collectorModuleName)
Constructor - sets the prefix for collected objects (won't be accesses until execute(....

◆ ~CDCDedxBadWireAlgorithm()

virtual ~CDCDedxBadWireAlgorithm ( )
inlinevirtual

Destructor.

Definition at line 48 of file CDCDedxBadWireAlgorithm.h.

48{}

Member Function Documentation

◆ boundaryFindingSetup()

virtual void boundaryFindingSetup ( std::vector< Calibration::ExpRun > ,
int  )
inlineprotectedvirtualinherited

If you need to make some changes to your algorithm class before 'findPayloadBoundaries' is run, make them in this function.

Reimplemented in PXDAnalyticGainCalibrationAlgorithm, PXDValidationAlgorithm, SVD3SampleCoGTimeCalibrationAlgorithm, SVD3SampleELSTimeCalibrationAlgorithm, SVDCoGTimeCalibrationAlgorithm, TestBoundarySettingAlgorithm, and TestCalibrationAlgorithm.

Definition at line 252 of file CalibrationAlgorithm.h.

252{};

◆ boundaryFindingTearDown()

virtual void boundaryFindingTearDown ( )
inlineprotectedvirtualinherited

Put your algorithm back into a state ready for normal execution if you need to.

Definition at line 257 of file CalibrationAlgorithm.h.

257{};

◆ calibrate()

CalibrationAlgorithm::EResult calibrate ( )
overrideprotectedvirtual

cdcdedx badwire algorithm

Implements CalibrationAlgorithm.

Definition at line 47 of file CDCDedxBadWireAlgorithm.cc.

48{
49
51
52 //old wg for book-keeping previous bad+dead
53 if (!m_DBBadWires.isValid() || !m_DBWireGains.isValid())
54 B2FATAL("There is no valid payload for BadWire and/or Wirgain");
55
56 // Get data objects
57 auto ttree = getObjectPtr<TTree>("tree");
58 if (ttree->GetEntries() < 1000) return c_NotEnoughData;
59
60 vector<int>* wire = 0;
61 ttree->SetBranchAddress("wire", &wire);
62
63 vector<double>* hitvar = 0;
64 if (m_isADC) ttree->SetBranchAddress("adccorr", &hitvar);
65 else ttree->SetBranchAddress("dedxhit", &hitvar);
66
67 if (m_isADC) m_varName = "hitadc";
68 m_suffix = Form("%s_%s", m_varName.data(), m_suffix.data());
69
70 TH1D hvarall(Form("hvarall_%s", m_suffix.data()), "", m_varBins, m_varMin, m_varMax);
71 hvarall.SetTitle(Form("dist %s; %s; %s", m_suffix.data(), m_varName.data(), "entries"));
72
73 map<int, vector<double>> vhitvar;
74
75 for (int i = 0; i < ttree->GetEntries(); ++i) {
76 ttree->GetEvent(i);
77 for (unsigned int ih = 0; ih < wire->size(); ++ih) {
78 double ivalue = hitvar->at(ih);
79 vhitvar[wire->at(ih)].push_back(ivalue);
80 hvarall.Fill(ivalue);
81 }
82 }
83
84 m_amean = hvarall.GetMean();
85 m_arms = hvarall.GetRMS();
86
87 // Commenting minstat cut on March 2024,
88 //it is not worth to skip the calibration if there is more than 5% bad/dead wires
89
90 //return if >5% bad wire or null histogram
91 // int minstat = 0;
92 // for (unsigned int jw = 0; jw < c_nwireCDC; ++jw)
93 // if (vhitvar[jw].size() <= 100) minstat++;
94 // if (minstat > 0.05 * c_nwireCDC) return c_NotEnoughData;
95
96 if (m_amean == 0 || m_arms == 0) return c_NotEnoughData;
97
98 map<int, vector<double>> qapars;
99 vector<double> vdefectwires, vbadwires, vdeadwires;
100
101 for (unsigned int jw = 0; jw < c_nwireCDC; ++jw) {
102 int ncount = 0, tcount = 0;
103 double nmean = 0.;
104 for (unsigned int jh = 0; jh < vhitvar[jw].size(); ++jh) {
105 double jvalue = vhitvar[jw][jh];
106 if (jvalue < m_varMax) {
107 ncount++;
108 nmean += jvalue;
109 } else tcount++;
110 }
111
112 bool badwire = false;
113 if (ncount < 100) {
114 qapars[0].push_back(0);
115 qapars[1].push_back(0);
116 qapars[2].push_back(0);
117 badwire = true; //partial dead
118 } else {
119 nmean = nmean / ncount;
120 if (abs(nmean - m_amean) / m_amean > m_meanThres) badwire = true;
121
122 double nrms = 0.;
123 for (unsigned int kh = 0; kh < vhitvar[jw].size(); ++kh) {
124 double kvalue = vhitvar[jw][kh];
125 if (kvalue < m_varMax) nrms += pow(kvalue - nmean, 2);
126 }
127
128 nrms = sqrt(nrms / ncount);
129 if (abs(nrms - m_arms) / m_arms > m_rmsThres) badwire = true;
130
131 double badfrac = 0.0;
132 if (tcount > 0) badfrac = (1.0 * tcount) / (tcount + ncount);
133 if (badfrac > m_fracThres) badwire = true;
134
135 qapars[0].push_back(nmean);
136 qapars[1].push_back(nrms);
137 qapars[2].push_back(badfrac);
138 }
139
140 if (badwire) {
141 vdefectwires.push_back(0.0);
142 if (ncount == 0) vdeadwires.push_back(jw);
143 else vbadwires.push_back(jw);
144 } else vdefectwires.push_back(1.0);
145 }
146
147
148 if (m_isMakePlots) {
149 //1. plot bad and good wire plots.
150 plotWireDist(vbadwires, vhitvar);
151
152 //2. plots wire status map
153 plotBadWireMap(vbadwires, vdeadwires);
154
155 //3. plot control parameters histograms
156 plotQaPars(qapars);
157
158 //4. plot statistics related histograms
160 }
161
162 // Save payloads
163 B2INFO("dE/dx Badwire Calibration done: " << vdefectwires.size() << " wires");
164 CDCDedxBadWires* c_badwires = new CDCDedxBadWires(vdefectwires);
165 saveCalibration(c_badwires, "CDCDedxBadWires");
166
167 m_suffix.clear();
168
169 return c_OK;
170}
void plotBadWireMap(const std::vector< double > &vbadwires, const std::vector< double > &vdeadwires)
function to plot wire status map (all, bad and dead)
void getExpRunInfo()
function to get extract calibration run/exp
double m_arms
average rms of dedx for all wires
DBObjPtr< CDCDedxBadWires > m_DBBadWires
Badwire DB object.
DBObjPtr< CDCDedxWireGain > m_DBWireGains
Wiregain DB object.
void plotQaPars(std::map< int, std::vector< double > > &qapars)
function to plot the QA (decision) parameters
void plotEventStats()
function to draw the stats
void plotWireDist(const std::vector< double > &inwires, std::map< int, std::vector< double > > &vhitvar)
function to draw per wire plots
double m_amean
average mean of dedx for all wires
void saveCalibration(TClonesArray *data, const std::string &name)
Store DBArray payload with given name with default IOV.
@ c_OK
Finished successfully =0 in Python.
@ c_NotEnoughData
Needs more data =2 in Python.
std::shared_ptr< T > getObjectPtr(const std::string &name, const std::vector< Calibration::ExpRun > &requestedRuns)
Get calibration data object by name and list of runs, the Merge function will be called to generate t...
double sqrt(double a)
sqrt for double
Definition beamHelpers.h:28

◆ checkPyExpRun()

bool checkPyExpRun ( PyObject * pyObj)
inherited

Checks that a PyObject can be successfully converted to an ExpRun type.

Checks if the PyObject can be converted to ExpRun.

Definition at line 28 of file CalibrationAlgorithm.cc.

29{
30 // Is it a sequence?
31 if (PySequence_Check(pyObj)) {
32 Py_ssize_t nObj = PySequence_Length(pyObj);
33 // Does it have 2 objects in it?
34 if (nObj != 2) {
35 B2DEBUG(29, "ExpRun was a Python sequence which didn't have exactly 2 entries!");
36 return false;
37 }
38 PyObject* item1, *item2;
39 item1 = PySequence_GetItem(pyObj, 0);
40 item2 = PySequence_GetItem(pyObj, 1);
41 // Did the GetItem work?
42 if ((item1 == NULL) || (item2 == NULL)) {
43 B2DEBUG(29, "A PyObject pointer was NULL in the sequence");
44 return false;
45 }
46 // Are they longs?
47 if (PyLong_Check(item1) && PyLong_Check(item2)) {
48 long value1, value2;
49 value1 = PyLong_AsLong(item1);
50 value2 = PyLong_AsLong(item2);
51 if (((value1 == -1) || (value2 == -1)) && PyErr_Occurred()) {
52 B2DEBUG(29, "An error occurred while converting the PyLong to long");
53 return false;
54 }
55 } else {
56 B2DEBUG(29, "One or more of the PyObjects in the ExpRun wasn't a long");
57 return false;
58 }
59 // Make sure to kill off the reference GetItem gave us responsibility for
60 Py_DECREF(item1);
61 Py_DECREF(item2);
62 } else {
63 B2DEBUG(29, "ExpRun was not a Python sequence.");
64 return false;
65 }
66 return true;
67}

◆ clearCalibrationData()

void clearCalibrationData ( )
inlineprotectedinherited

Clear calibration data.

Definition at line 324 of file CalibrationAlgorithm.h.

324{m_data.clearCalibrationData();}

◆ commit() [1/2]

bool commit ( )
inherited

Submit constants from last calibration into database.

Definition at line 302 of file CalibrationAlgorithm.cc.

303{
304 if (getPayloads().empty())
305 return false;
306 list<Database::DBImportQuery> payloads = getPayloads();
307 B2INFO("Committing " << payloads.size() << " payloads to database.");
308 return Database::Instance().storeData(payloads);
309}
std::list< Database::DBImportQuery > & getPayloads()
Get constants (in TObjects) for database update from last execution.
static Database & Instance()
Instance of a singleton Database.
Definition Database.cc:41
bool storeData(const std::string &name, TObject *object, const IntervalOfValidity &iov)
Store an object in the database.
Definition Database.cc:140

◆ commit() [2/2]

bool commit ( std::list< Database::DBImportQuery > payloads)
inherited

Submit constants from a (potentially previous) set of payloads.

Definition at line 311 of file CalibrationAlgorithm.cc.

312{
313 if (payloads.empty())
314 return false;
315 return Database::Instance().storeData(payloads);
316}

◆ convertPyExpRun()

ExpRun convertPyExpRun ( PyObject * pyObj)
inherited

Performs the conversion of PyObject to ExpRun.

Converts the PyObject to an ExpRun. We've preoviously checked the object so this assumes a lot about the PyObject.

Definition at line 70 of file CalibrationAlgorithm.cc.

71{
72 ExpRun expRun;
73 PyObject* itemExp, *itemRun;
74 itemExp = PySequence_GetItem(pyObj, 0);
75 itemRun = PySequence_GetItem(pyObj, 1);
76 expRun.first = PyLong_AsLong(itemExp);
77 Py_DECREF(itemExp);
78 expRun.second = PyLong_AsLong(itemRun);
79 Py_DECREF(itemRun);
80 return expRun;
81}

◆ dumpOutputJson()

const std::string dumpOutputJson ( ) const
inlineinherited

Dump the JSON string of the output JSON object.

Definition at line 223 of file CalibrationAlgorithm.h.

223{return m_jsonExecutionOutput.dump();}

◆ execute() [1/2]

CalibrationAlgorithm::EResult execute ( PyObject * runs,
int iteration = 0,
IntervalOfValidity iov = IntervalOfValidity() )
inherited

Runs calibration over Python list of runs. Converts to C++ and then calls the other execute() function.

Definition at line 83 of file CalibrationAlgorithm.cc.

84{
85 B2DEBUG(29, "Running execute() using Python Object as input argument");
86 // Reset the execution specific data in case the algorithm was previously called
87 m_data.reset();
88 m_data.setIteration(iteration);
89 vector<ExpRun> vecRuns;
90 // Is it a list?
91 if (PySequence_Check(runs)) {
92 boost::python::handle<> handle(boost::python::borrowed(runs));
93 boost::python::list listRuns(handle);
94
95 int nList = boost::python::len(listRuns);
96 for (int iList = 0; iList < nList; ++iList) {
97 boost::python::object pyExpRun(listRuns[iList]);
98 if (!checkPyExpRun(pyExpRun.ptr())) {
99 B2ERROR("Received Python ExpRuns couldn't be converted to C++");
100 m_data.setResult(c_Failure);
101 return c_Failure;
102 } else {
103 vecRuns.push_back(convertPyExpRun(pyExpRun.ptr()));
104 }
105 }
106 } else {
107 B2ERROR("Tried to set the input runs but we didn't receive a Python sequence object (list,tuple).");
108 m_data.setResult(c_Failure);
109 return c_Failure;
110 }
111 return execute(vecRuns, iteration, iov);
112}
bool checkPyExpRun(PyObject *pyObj)
Checks that a PyObject can be successfully converted to an ExpRun type.
EResult execute(std::vector< Calibration::ExpRun > runs={}, int iteration=0, IntervalOfValidity iov=IntervalOfValidity())
Runs calibration over vector of runs for a given iteration.
Calibration::ExpRun convertPyExpRun(PyObject *pyObj)
Performs the conversion of PyObject to ExpRun.
ExecutionData m_data
Data specific to a SINGLE execution of the algorithm. Gets reset at the beginning of execution.

◆ execute() [2/2]

CalibrationAlgorithm::EResult execute ( std::vector< Calibration::ExpRun > runs = {},
int iteration = 0,
IntervalOfValidity iov = IntervalOfValidity() )
inherited

Runs calibration over vector of runs for a given iteration.

You can also specify the IoV to save the database payload as. By default the Algorithm will create an IoV from your requested ExpRuns, or from the overall ExpRuns of the input data if you haven't specified ExpRuns in this function.

No checks are performed to make sure that a IoV you specify matches the data you ran over, it simply labels the IoV to commit to the database later.

Definition at line 114 of file CalibrationAlgorithm.cc.

115{
116 // Check if we are calling this function directly and need to reset, or through Python where it was already done.
117 if (m_data.getResult() != c_Undefined) {
118 m_data.reset();
119 m_data.setIteration(iteration);
120 }
121
122 if (m_inputFileNames.empty()) {
123 B2ERROR("There aren't any input files set. Please use CalibrationAlgorithm::setInputFiles()");
124 m_data.setResult(c_Failure);
125 return c_Failure;
126 }
127
128 // Did we receive runs to execute over explicitly?
129 if (!(runs.empty())) {
130 for (auto expRun : runs) {
131 B2DEBUG(29, "ExpRun requested = (" << expRun.first << ", " << expRun.second << ")");
132 }
133 // We've asked explicitly for certain runs, but we should check if the data granularity is 'run'
134 if (strcmp(getGranularity().c_str(), "all") == 0) {
135 B2ERROR(("The data is collected with granularity=all (exp=-1,run=-1), but you seem to request calibration for specific runs."
136 " We'll continue but using ALL the input data given instead of the specific runs requested."));
137 }
138 } else {
139 // If no runs are provided, infer the runs from all collected data
140 runs = getRunListFromAllData();
141 // Let's check that we have some now
142 if (runs.empty()) {
143 B2ERROR("No collected data in input files.");
144 m_data.setResult(c_Failure);
145 return c_Failure;
146 }
147 for (auto expRun : runs) {
148 B2DEBUG(29, "ExpRun requested = (" << expRun.first << ", " << expRun.second << ")");
149 }
150 }
151
152 m_data.setRequestedRuns(runs);
153 if (iov.empty()) {
154 // If no user specified IoV we use the IoV from the executed run list
155 iov = IntervalOfValidity(runs[0].first, runs[0].second, runs[runs.size() - 1].first, runs[runs.size() - 1].second);
156 }
157 m_data.setRequestedIov(iov);
158 // After here, the getObject<...>(...) helpers start to work
159
161 m_data.setResult(result);
162 return result;
163}
std::vector< Calibration::ExpRun > getRunListFromAllData() const
Get the complete list of runs from inspection of collected data.
std::vector< std::string > m_inputFileNames
List of input files to the Algorithm, will initially be user defined but then gets the wildcards expa...
EResult
The result of calibration.
@ c_Undefined
Not yet known (before execution) =4 in Python.
virtual EResult calibrate()=0
Run algo on data - pure virtual: needs to be implemented.
std::string getGranularity() const
Get the granularity of collected data.

◆ fillRunToInputFilesMap()

void fillRunToInputFilesMap ( )
inherited

Fill the mapping of ExpRun -> Files.

Definition at line 330 of file CalibrationAlgorithm.cc.

331{
332 m_runsToInputFiles.clear();
333 // Save TDirectory to change back at the end
334 TDirectory* dir = gDirectory;
335 RunRange* runRange;
336 // Construct the TDirectory name where we expect our objects to be
337 string runRangeObjName(getPrefix() + "/" + RUN_RANGE_OBJ_NAME);
338 for (const auto& fileName : m_inputFileNames) {
339 //Open TFile to get the objects
340 unique_ptr<TFile> f;
341 f.reset(TFile::Open(fileName.c_str(), "READ"));
342 runRange = dynamic_cast<RunRange*>(f->Get(runRangeObjName.c_str()));
343 if (runRange) {
344 // Insert or extend the run -> file mapping for this ExpRun
345 auto expRuns = runRange->getExpRunSet();
346 for (const auto& expRun : expRuns) {
347 auto runFiles = m_runsToInputFiles.find(expRun);
348 if (runFiles != m_runsToInputFiles.end()) {
349 (runFiles->second).push_back(fileName);
350 } else {
351 m_runsToInputFiles.insert(std::make_pair(expRun, std::vector<std::string> {fileName}));
352 }
353 }
354 } else {
355 B2WARNING("Missing a RunRange object for file: " << fileName);
356 }
357 }
358 dir->cd();
359}
std::string getPrefix() const
Get the prefix used for getting calibration data.
std::map< Calibration::ExpRun, std::vector< std::string > > m_runsToInputFiles
Map of Runs to input files. Gets filled when you call getRunRangeFromAllData, gets cleared when setti...
const std::set< Calibration::ExpRun > & getExpRunSet()
Get access to the stored set.
Definition RunRange.h:64

◆ findPayloadBoundaries()

const std::vector< ExpRun > findPayloadBoundaries ( std::vector< Calibration::ExpRun > runs,
int iteration = 0 )
inherited

Used to discover the ExpRun boundaries that you want the Python CAF to execute on. This is optional and only used in some.

Definition at line 520 of file CalibrationAlgorithm.cc.

521{
522 m_boundaries.clear();
523 if (m_inputFileNames.empty()) {
524 B2ERROR("There aren't any input files set. Please use CalibrationAlgorithm::setInputFiles()");
525 return m_boundaries;
526 }
527 // Reset the internal execution data just in case something is hanging around
528 m_data.reset();
529 if (runs.empty()) {
530 // Want to loop over all runs we could possibly know about
531 runs = getRunListFromAllData();
532 }
533 // Let's check that we have some now
534 if (runs.empty()) {
535 B2ERROR("No collected data in input files.");
536 return m_boundaries;
537 }
538 // In order to find run boundaries we must have collected with data granularity == 'run'
539 if (strcmp(getGranularity().c_str(), "all") == 0) {
540 B2ERROR("The data is collected with granularity='all' (exp=-1,run=-1), and we can't use that to find run boundaries.");
541 return m_boundaries;
542 }
543 m_data.setIteration(iteration);
544 // User defined setup function
545 boundaryFindingSetup(runs, iteration);
546 std::vector<ExpRun> runList;
547 // Loop over run list and call derived class "isBoundaryRequired" member function
548 for (auto currentRun : runs) {
549 runList.push_back(currentRun);
550 m_data.setRequestedRuns(runList);
551 // After here, the getObject<...>(...) helpers start to work
552 if (isBoundaryRequired(currentRun)) {
553 m_boundaries.push_back(currentRun);
554 }
555 // Only want run-by-run
556 runList.clear();
557 // Don't want memory hanging around
558 m_data.clearCalibrationData();
559 }
560 m_data.reset();
562 return m_boundaries;
563}
std::vector< Calibration::ExpRun > m_boundaries
When using the boundaries functionality from isBoundaryRequired, this is used to store the boundaries...
virtual void boundaryFindingTearDown()
Put your algorithm back into a state ready for normal execution if you need to.
virtual void boundaryFindingSetup(std::vector< Calibration::ExpRun >, int)
If you need to make some changes to your algorithm class before 'findPayloadBoundaries' is run,...
virtual bool isBoundaryRequired(const Calibration::ExpRun &)
Given the current collector data, make a decision about whether or not this run should be the start o...

◆ getAllGranularityExpRun()

Calibration::ExpRun getAllGranularityExpRun ( ) const
inlineprotectedinherited

Returns the Exp,Run pair that means 'Everything'. Currently unused.

Definition at line 327 of file CalibrationAlgorithm.h.

327{return m_allExpRun;}

◆ getCollectorName()

std::string getCollectorName ( ) const
inlineinherited

Alias for prefix.

For convenience and less writing, we say developers to set this to default collector module name in constructor of base class. One can however use the dublets of collector+algorithm multiple times with different settings. To bind these together correctly, the prefix has to be set the same for algo and collector. So we call the setter setPrefix rather than setModuleName or whatever. This getter will work out of the box for default cases -> return the name of module you have to add to your path to collect data for this algorithm.

Definition at line 164 of file CalibrationAlgorithm.h.

164{return getPrefix();}

◆ getDescription()

const std::string & getDescription ( ) const
inlineinherited

Get the description of the algorithm (set by developers in constructor)

Definition at line 216 of file CalibrationAlgorithm.h.

216{return m_description;}

◆ getExpRunInfo()

void getExpRunInfo ( )

function to get extract calibration run/exp

Definition at line 173 of file CDCDedxBadWireAlgorithm.cc.

174{
175
176 int cruns = 0;
177 for (auto expRun : getRunList()) {
178 if (cruns == 0) B2INFO("CDCDedxBadWires: start exp " << expRun.first << " and run " << expRun.second << "");
179 cruns++;
180 }
181
182 const auto erStart = getRunList()[0];
183 int estart = erStart.first;
184 int rstart = erStart.second;
185
186 const auto erEnd = getRunList()[cruns - 1];
187 int rend = erEnd.second;
188
189 updateDBObjPtrs(1, rstart, estart);
190
191 if (m_suffix.length() > 0) m_suffix = Form("%s_e%d_r%dr%d", m_suffix.data(), estart, rstart, rend);
192 else m_suffix = Form("e%d_r%dr%d", estart, rstart, rend);
193}
void updateDBObjPtrs(const unsigned int event, const int run, const int experiment)
Updates any DBObjPtrs by calling update(event) for DBStore.
const std::vector< Calibration::ExpRun > & getRunList() const
Get the list of runs for which calibration is called.

◆ getExpRunString()

string getExpRunString ( Calibration::ExpRun & expRun) const
privateinherited

Gets the "exp.run" string repr. of (exp,run)

Definition at line 254 of file CalibrationAlgorithm.cc.

255{
256 string expRunString;
257 expRunString += to_string(expRun.first);
258 expRunString += ".";
259 expRunString += to_string(expRun.second);
260 return expRunString;
261}

◆ getFullObjectPath()

string getFullObjectPath ( const std::string & name,
Calibration::ExpRun expRun ) const
privateinherited

constructs the full TDirectory + Key name of an object in a TFile based on its name and exprun

Definition at line 263 of file CalibrationAlgorithm.cc.

264{
265 string dirName = getPrefix() + "/" + name;
266 string objName = name + "_" + getExpRunString(expRun);
267 return dirName + "/" + objName;
268}
std::string getExpRunString(Calibration::ExpRun &expRun) const
Gets the "exp.run" string repr. of (exp,run)

◆ getGranularity()

std::string getGranularity ( ) const
inlineinherited

Get the granularity of collected data.

Definition at line 188 of file CalibrationAlgorithm.h.

188{return m_granularityOfData;};

◆ getGranularityFromData()

string getGranularityFromData ( ) const
protectedinherited

Get the granularity of collected data.

Definition at line 383 of file CalibrationAlgorithm.cc.

384{
385 // Save TDirectory to change back at the end
386 TDirectory* dir = gDirectory;
387 RunRange* runRange;
388 string runRangeObjName(getPrefix() + "/" + RUN_RANGE_OBJ_NAME);
389 // We only check the first file
390 string fileName = m_inputFileNames[0];
391 unique_ptr<TFile> f;
392 f.reset(TFile::Open(fileName.c_str(), "READ"));
393 runRange = dynamic_cast<RunRange*>(f->Get(runRangeObjName.c_str()));
394 if (!runRange) {
395 B2FATAL("The input file " << fileName << " does not contain a RunRange object at "
396 << runRangeObjName << ". Please set your input files to exclude it.");
397 return "";
398 }
399 string granularity = runRange->getGranularity();
400 dir->cd();
401 return granularity;
402}
std::string getGranularity() const
Gets the m_granularity.
Definition RunRange.h:110

◆ getHistoPattern()

TH2F * getHistoPattern ( const std::vector< double > & inwires,
const std::string & suffix,
int & total )

function to get wire map with input file (all, bad and dead)

Definition at line 367 of file CDCDedxBadWireAlgorithm.cc.

368{
369
370 B2INFO("Creating CDCGeometryPar object");
371 CDCGeometryPar& cdcgeo = CDCGeometryPar::Instance(&(*m_cdcGeo));
372
373 TH2F* temp = new TH2F(Form("temp_%s_%s", m_suffix.data(), suffix.data()), "", 2400, -1.2, 1.2, 2400, -1.2, 1.2);
374
375 int jwire = -1;
376 total = 0;
377 for (unsigned int ilay = 0; ilay < c_maxNSenseLayers; ++ilay) {
378 for (unsigned int iwire = 0; iwire < cdcgeo.nWiresInLayer(ilay); ++iwire) {
379 jwire++;
380 double phi = 2.*TMath::Pi() * (float(iwire) / float(cdcgeo.nWiresInLayer(ilay)));
381 double radius = cdcgeo.senseWireR(ilay) / 100.;
382 double x = radius * cos(phi);
383 double y = radius * sin(phi);
384 if (suffix == "all") {
385 total++;
386 temp->Fill(x, y);
387 } else {
388 if (count(inwires.begin(), inwires.end(), jwire)) {
389 temp->Fill(x, y);
390 total++;
391 }
392 }
393 }
394 }
395 return temp;
396}
DBObjPtr< CDCGeometry > m_cdcGeo
Geometry of CDC.
unsigned nWiresInLayer(int layerId) const
Returns wire numbers in a layer.
static CDCGeometryPar & Instance(const CDCGeometry *=nullptr)
Static method to get a reference to the CDCGeometryPar instance.
double senseWireR(int layerId) const
Returns radius of sense wire in each layer.

◆ getInputFileNames()

PyObject * getInputFileNames ( )
inherited

Get the input file names used for this algorithm and pass them out as a Python list of unicode strings.

Definition at line 245 of file CalibrationAlgorithm.cc.

246{
247 PyObject* objInputFileNames = PyList_New(m_inputFileNames.size());
248 for (size_t i = 0; i < m_inputFileNames.size(); ++i) {
249 PyList_SetItem(objInputFileNames, i, Py_BuildValue("s", m_inputFileNames[i].c_str()));
250 }
251 return objInputFileNames;
252}

◆ getInputJsonObject()

const nlohmann::json & getInputJsonObject ( ) const
inlineprotectedinherited

Get the entire top level JSON object. We explicitly say this must be of object type so that we might pick.

Definition at line 357 of file CalibrationAlgorithm.h.

357{return m_jsonExecutionInput;}

◆ getInputJsonValue()

template<class T>
const T getInputJsonValue ( const std::string & key) const
inlineprotectedinherited

Get an input JSON value using a key. The normal exceptions are raised when the key doesn't exist.

Definition at line 350 of file CalibrationAlgorithm.h.

351 {
352 return m_jsonExecutionInput.at(key);
353 }

◆ getIovFromAllData()

IntervalOfValidity getIovFromAllData ( ) const
inherited

Get the complete IoV from inspection of collected data.

Definition at line 325 of file CalibrationAlgorithm.cc.

326{
328}
RunRange getRunRangeFromAllData() const
Get the complete RunRange from inspection of collected data.
IntervalOfValidity getIntervalOfValidity()
Make IntervalOfValidity from the set, spanning all runs. Works because sets are sorted by default.
Definition RunRange.h:70

◆ getIteration()

int getIteration ( ) const
inlineprotectedinherited

Get current iteration.

Definition at line 269 of file CalibrationAlgorithm.h.

269{ return m_data.getIteration(); }

◆ getObjectPtr()

template<class T>
std::shared_ptr< T > getObjectPtr ( std::string name)
inlineprotectedinherited

Get calibration data object (for all runs the calibration is requested for) This function will only work during or after execute() has been called once.

Definition at line 285 of file CalibrationAlgorithm.h.

286 {
287 if (m_runsToInputFiles.size() == 0)
288 fillRunToInputFilesMap();
289 return getObjectPtr<T>(name, m_data.getRequestedRuns());
290 }

◆ getOutputJsonValue()

template<class T>
const T getOutputJsonValue ( const std::string & key) const
inlineprotectedinherited

Get a value using a key from the JSON output object, not sure why you would want to do this.

Definition at line 342 of file CalibrationAlgorithm.h.

343 {
344 return m_jsonExecutionOutput.at(key);
345 }

◆ getPayloads()

std::list< Database::DBImportQuery > & getPayloads ( )
inlineinherited

Get constants (in TObjects) for database update from last execution.

Definition at line 204 of file CalibrationAlgorithm.h.

204{return m_data.getPayloads();}

◆ getPayloadValues()

std::list< Database::DBImportQuery > getPayloadValues ( )
inlineinherited

Get constants (in TObjects) for database update from last execution but passed by VALUE.

Definition at line 207 of file CalibrationAlgorithm.h.

207{return m_data.getPayloadValues();}

◆ getPrefix()

std::string getPrefix ( ) const
inlineinherited

Get the prefix used for getting calibration data.

Definition at line 146 of file CalibrationAlgorithm.h.

146{return m_prefix;}

◆ getRunList()

const std::vector< Calibration::ExpRun > & getRunList ( ) const
inlineprotectedinherited

Get the list of runs for which calibration is called.

Definition at line 266 of file CalibrationAlgorithm.h.

266{return m_data.getRequestedRuns();}

◆ getRunListFromAllData()

vector< ExpRun > getRunListFromAllData ( ) const
inherited

Get the complete list of runs from inspection of collected data.

Definition at line 318 of file CalibrationAlgorithm.cc.

319{
320 RunRange runRange = getRunRangeFromAllData();
321 set<ExpRun> expRunSet = runRange.getExpRunSet();
322 return vector<ExpRun>(expRunSet.begin(), expRunSet.end());
323}

◆ getRunRangeFromAllData()

RunRange getRunRangeFromAllData ( ) const
inherited

Get the complete RunRange from inspection of collected data.

Definition at line 361 of file CalibrationAlgorithm.cc.

362{
363 // Save TDirectory to change back at the end
364 TDirectory* dir = gDirectory;
365 RunRange runRange;
366 // Construct the TDirectory name where we expect our objects to be
367 string runRangeObjName(getPrefix() + "/" + RUN_RANGE_OBJ_NAME);
368 for (const auto& fileName : m_inputFileNames) {
369 //Open TFile to get the objects
370 unique_ptr<TFile> f;
371 f.reset(TFile::Open(fileName.c_str(), "READ"));
372 RunRange* runRangeOther = dynamic_cast<RunRange*>(f->Get(runRangeObjName.c_str()));
373 if (runRangeOther) {
374 runRange.merge(runRangeOther);
375 } else {
376 B2WARNING("Missing a RunRange object for file: " << fileName);
377 }
378 }
379 dir->cd();
380 return runRange;
381}
virtual void merge(const RunRange *other)
Implementation of merging - other is added to the set (union)
Definition RunRange.h:52

◆ getVecInputFileNames()

std::vector< std::string > getVecInputFileNames ( ) const
inlineprotectedinherited

Get the input file names used for this algorithm as a STL vector.

Definition at line 275 of file CalibrationAlgorithm.h.

275{return m_inputFileNames;}

◆ inputJsonKeyExists()

bool inputJsonKeyExists ( const std::string & key) const
inlineprotectedinherited

Test for a key in the input JSON object.

Definition at line 360 of file CalibrationAlgorithm.h.

360{return m_jsonExecutionInput.count(key);}

◆ isBoundaryRequired()

virtual bool isBoundaryRequired ( const Calibration::ExpRun & )
inlineprotectedvirtualinherited

Given the current collector data, make a decision about whether or not this run should be the start of a payload boundary.

Reimplemented in PXDAnalyticGainCalibrationAlgorithm, PXDValidationAlgorithm, SVD3SampleCoGTimeCalibrationAlgorithm, SVD3SampleELSTimeCalibrationAlgorithm, SVDCoGTimeCalibrationAlgorithm, TestBoundarySettingAlgorithm, and TestCalibrationAlgorithm.

Definition at line 243 of file CalibrationAlgorithm.h.

244 {
245 B2ERROR("You didn't implement a isBoundaryRequired() member function in your CalibrationAlgorithm but you are calling it!");
246 return false;
247 }

◆ loadInputJson()

bool loadInputJson ( const std::string & jsonString)
inherited

Load the m_inputJson variable from a string (useful from Python interface). The return bool indicates success or failure.

Definition at line 502 of file CalibrationAlgorithm.cc.

503{
504 try {
505 auto jsonInput = nlohmann::json::parse(jsonString);
506 // Input string has an object (dict) as the top level object?
507 if (jsonInput.is_object()) {
508 m_jsonExecutionInput = jsonInput;
509 return true;
510 } else {
511 B2ERROR("JSON input string isn't an object type i.e. not a '{}' at the top level.");
512 return false;
513 }
514 } catch (nlohmann::json::parse_error&) {
515 B2ERROR("Parsing of JSON input string failed");
516 return false;
517 }
518}
nlohmann::json m_jsonExecutionInput
Optional input JSON object used to make decisions about how to execute the algorithm code.

◆ plotBadWireMap()

void plotBadWireMap ( const std::vector< double > & vbadwires,
const std::vector< double > & vdeadwires )

function to plot wire status map (all, bad and dead)

Definition at line 316 of file CDCDedxBadWireAlgorithm.cc.

317{
318
319 TCanvas cmap(Form("cmap_%s", m_suffix.data()), "", 800, 800);
320 cmap.SetTitle("CDC dE/dx bad wire status");
321
322 int total = 0;
323 TH2F* hxyAll = getHistoPattern(vbadwires, "all", total);
324 hxyAll->SetTitle(Form("wire status map (%s)", m_suffix.data()));
325 setHistCosmetics(hxyAll, kGray);
326 hxyAll->Draw();
327
328 int nbad = 0.0;
329 TH2F* hxyBad = getHistoPattern(vbadwires, "bad", nbad);
330 if (hxyBad) {
331 setHistCosmetics(hxyBad, kRed);
332 hxyBad->Draw("same");
333 }
334
335 int ndead = 0.0;
336 TH2F* hxyDead = getHistoPattern(vdeadwires, "dead", ndead);
337 if (hxyDead) {
338 setHistCosmetics(hxyDead, kBlack);
339 hxyDead->Draw("same");
340 }
341
342 int ndefect = nbad + ndead;
343 auto leg = new TLegend(0.68, 0.80, 0.90, 0.92);
344 leg->SetBorderSize(0);
345 leg->SetLineWidth(3);
346 leg->SetHeader(Form("total defective: %d (~%0.02f%%)", ndefect, 100.*(ndefect) / c_nwireCDC));
347 leg->AddEntry(hxyBad, Form("bad #rightarrow %d", nbad), "p");
348 leg->AddEntry(hxyDead, Form("dead #rightarrow %d", ndead), "p");
349 leg->Draw();
350
351 gStyle->SetLegendTextSize(0.025);
352 TPaveText* pt = new TPaveText(-0.30, -1.47, -0.31, -1.30, "br");
353 setTextCosmetics(pt, 0.02258064);
354
355 TText* text = pt->AddText("CDC-wire map: counter-clockwise and start from +x");
356 text->SetTextColor(kGray + 1);
357 pt->Draw("same");
358
359 cmap.SaveAs(Form("cdcdedx_bdcal_wiremap_%s.pdf", m_suffix.data()));
360
361 delete hxyAll;
362 delete hxyBad;
363 delete hxyDead;
364}
void setHistCosmetics(TH2F *hist, Color_t color)
function to change histogram styles
void setTextCosmetics(TPaveText *pt, double size)
function to change text styles
TH2F * getHistoPattern(const std::vector< double > &inwires, const std::string &suffix, int &total)
function to get wire map with input file (all, bad and dead)

◆ plotEventStats()

void plotEventStats ( )

function to draw the stats

Definition at line 440 of file CDCDedxBadWireAlgorithm.cc.

441{
442
443 TCanvas cstats("cstats", "cstats", 1000, 500);
444 cstats.SetBatch(kTRUE);
445 cstats.Divide(2, 1);
446
447 cstats.cd(1);
448 auto hestats = getObjectPtr<TH1I>("hestats");
449 if (hestats) {
450 hestats->SetName(Form("htstats_%s", m_suffix.data()));
451 hestats->SetStats(0);
452 hestats->DrawCopy("");
453 }
454
455 cstats.cd(2);
456 auto htstats = getObjectPtr<TH1I>("htstats");
457 if (htstats) {
458 htstats->SetName(Form("htstats_%s", m_suffix.data()));
459 htstats->SetStats(0);
460 htstats->DrawCopy("");
461 }
462
463 cstats.Print(Form("cdcdedx_bdcal_qastats_%s.pdf", m_suffix.data()));
464}

◆ plotQaPars()

void plotQaPars ( std::map< int, std::vector< double > > & qapars)

function to plot the QA (decision) parameters

Definition at line 399 of file CDCDedxBadWireAlgorithm.cc.

400{
401
402 string qaname[3] = {"mean", "rms", "high_fraction"};
403
404 double linemin[3] = {m_amean* (1 - m_meanThres), m_arms* (1 - m_rmsThres), m_fracThres * 100};
405 double linemax[3] = {m_amean* (1 + m_meanThres), m_arms* (1 + m_rmsThres), m_fracThres * 100};
406
407 for (int iqa = 0; iqa < 3; iqa++) {
408
409 TH1D histqa(Form("%s_%s", qaname[iqa].data(), m_suffix.data()), "", c_nwireCDC, -0.5, 14335.5);
410
411 for (unsigned int jw = 0; jw < c_nwireCDC; jw++) {
412 if (iqa == 2) histqa.SetBinContent(jw + 1, qapars[iqa][jw] * 100);
413 else histqa.SetBinContent(jw + 1, qapars[iqa][jw]);
414 }
415
416 TCanvas c_pars(Form("c_pars_%d", iqa), "", 800, 600);
417 c_pars.cd();
418 gPad->SetGridy();
419
420 histqa.SetTitle(Form("%s vs wires (%s); wire ; %s", qaname[iqa].data(), m_suffix.data(), qaname[iqa].data()));
421 histqa.SetStats(0);
422 histqa.Draw();
423
424 TLine* lmin = new TLine(-0.5, linemin[iqa], 14335.5, linemin[iqa]);
425 lmin->SetLineColor(kRed);
426 lmin->Draw("same");
427 TLine* lmax = new TLine(-0.5, linemax[iqa], 14335.5, linemax[iqa]);
428 lmax->SetLineColor(kRed);
429 lmax->Draw("same");
430
431 c_pars.Print(Form("cdcdedx_bdcal_%s_%s.root", qaname[iqa].data(), m_suffix.data()));
432 c_pars.Print(Form("cdcdedx_bdcal_%s_%s.pdf", qaname[iqa].data(), m_suffix.data()));
433
434 delete lmax;
435 delete lmin;
436 }
437}

◆ plotWireDist()

void plotWireDist ( const std::vector< double > & inwires,
std::map< int, std::vector< double > > & vhitvar )

function to draw per wire plots

Definition at line 197 of file CDCDedxBadWireAlgorithm.cc.

199{
200
201 TList* bdlist = new TList();
202 bdlist->SetName("badwires");
203
204 TList* goodlist = new TList();
205 goodlist->SetName("goodwires");
206
207 TList* hflist = new TList();
208 hflist->SetName("highfracwires");
209
210 for (unsigned int jw = 0; jw < c_nwireCDC; ++jw) {
211
212 TH1D* hvar = new TH1D(Form("%s_wire%d", m_suffix.data(), jw), "", m_varBins, m_varMin, m_varMax);
213
214 TH1D* hvarhf = new TH1D(Form("hf%s_wire%d", m_suffix.data(), jw), "", m_varBins, m_varMin, m_varMax);
215 hvarhf->SetTitle(Form("%s, wire = %d; %s; entries", m_suffix.data(), jw, m_varName.data()));
216
217 int ncount = 0, tcount = 0;
218
219 for (unsigned int jh = 0; jh < vhitvar[jw].size(); ++jh) {
220 double jvalue = vhitvar[jw][jh];
221 if (jvalue < m_varMax) {
222 ncount++;
223 hvar->Fill(jvalue);
224 } else {
225 tcount++;
226 if (jvalue < m_varMax * 10.) hvarhf->Fill(jvalue / 10.);
227 }
228 }
229
230 double badfrac = 0.0;
231 if (tcount > 0) badfrac = (1.0 * tcount) / (tcount + ncount);
232 hvar->SetTitle(Form("%s, wire = %d; %s; %0.01f", m_suffix.data(), jw, m_varName.data(), badfrac * 100));
233
234 bool isbad = false;
235 if (count(inwires.begin(), inwires.end(), jw)) isbad = true;
236
237 double oldwg = m_DBWireGains->getWireGain(jw);
238 if (oldwg == 0) {
239 hvar->SetLineWidth(2);
240 hvar->SetLineColor(kRed);
241 }
242
243 if (isbad) {
244 bdlist->Add(hvar);
245 hflist->Add(hvarhf);
246 } else {
247 if (hvar->Integral() > 100) goodlist->Add(hvar);
248 }
249 }
250
251 printCanvas(bdlist, hflist, kYellow - 9);
252 printCanvas(goodlist, hflist, kGreen);
253
254 delete bdlist;
255 delete goodlist;
256 delete hflist;
257}
void printCanvas(TList *list, TList *hflist, Color_t color)
function to print canvas

◆ printCanvas()

void printCanvas ( TList * list,
TList * hflist,
Color_t color )

function to print canvas

Definition at line 260 of file CDCDedxBadWireAlgorithm.cc.

261{
262
263 string listname = list->GetName();
264 string sfx = Form("%s_%s", listname.data(), m_suffix.data());
265
266 TCanvas ctmp(Form("cdcdedx_%s", sfx.data()), "", 1200, 1200);
267 ctmp.Divide(4, 4);
268 ctmp.SetBatch(kTRUE);
269
270 stringstream psname;
271 psname << Form("cdcdedx_bdcal_%s.pdf[", sfx.data());
272 ctmp.Print(psname.str().c_str());
273 psname.str("");
274 psname << Form("cdcdedx_bdcal_%s.pdf", sfx.data());
275
276 for (int ih = 0; ih < list->GetSize(); ih++) {
277
278 TH1D* hist = (TH1D*)list->At(ih);
279
280 double frac = stod(hist->GetYaxis()->GetTitle());
281
282 TPaveText* pinfo = new TPaveText(0.40, 0.63, 0.89, 0.89, "NBNDC");
283 pinfo->AddText(Form("#mu: %0.2f(%0.2f#pm%0.2f)", hist->GetMean(), m_amean, m_meanThres * m_amean));
284 pinfo->AddText(Form("#sigma: %0.2f(%0.2f#pm%0.2f)", hist->GetRMS(), m_arms, m_rmsThres * m_arms));
285 pinfo->AddText(Form("N: %0.00f", hist->Integral()));
286 pinfo->AddText(Form("hf: %0.00f%%(%0.00f%%)", frac, m_fracThres * 100));
287 setTextCosmetics(pinfo, 0.04258064);
288
289 ctmp.cd(ih % 16 + 1);
290 hist->GetYaxis()->SetTitle("entries");
291 hist->SetFillColor(color);
292 hist->SetStats(0);
293 hist->Draw();
294 pinfo->Draw("same");
295
296 if (listname == "badwires") {
297 TH1D* histhf = (TH1D*)hflist->At(ih);
298 if (hist->GetMaximum() < histhf->GetMaximum()) hist->SetMaximum(histhf->GetMaximum() * 1.05);
299 histhf->SetFillColor(kGray);
300 histhf->SetStats(0);
301 histhf->Draw("same");
302 }
303
304 if (((ih + 1) % 16 == 0) || ih == (list->GetSize() - 1)) {
305 ctmp.Print(psname.str().c_str());
306 ctmp.Clear("D");
307 }
308 }
309
310 psname.str("");
311 psname << Form("cdcdedx_bdcal_%s.pdf]", sfx.data());
312 ctmp.Print(psname.str().c_str());
313}

◆ resetInputJson()

void resetInputJson ( )
inlineprotectedinherited

Clears the m_inputJson member variable.

Definition at line 330 of file CalibrationAlgorithm.h.

330{m_jsonExecutionInput.clear();}

◆ resetOutputJson()

void resetOutputJson ( )
inlineprotectedinherited

Clears the m_outputJson member variable.

Definition at line 333 of file CalibrationAlgorithm.h.

333{m_jsonExecutionOutput.clear();}

◆ saveCalibration() [1/6]

void saveCalibration ( TClonesArray * data,
const std::string & name )
protectedinherited

Store DBArray payload with given name with default IOV.

Definition at line 297 of file CalibrationAlgorithm.cc.

298{
299 saveCalibration(data, name, m_data.getRequestedIov());
300}

◆ saveCalibration() [2/6]

void saveCalibration ( TClonesArray * data,
const std::string & name,
const IntervalOfValidity & iov )
protectedinherited

Store DBArray with given name and custom IOV.

Definition at line 276 of file CalibrationAlgorithm.cc.

277{
278 B2DEBUG(29, "Saving calibration TClonesArray '" << name << "' to payloads list.");
279 getPayloads().emplace_back(name, data, iov);
280}

◆ saveCalibration() [3/6]

void saveCalibration ( TObject * data)
protectedinherited

Store DB payload with default name and default IOV.

Definition at line 287 of file CalibrationAlgorithm.cc.

288{
289 saveCalibration(data, DataStore::objectName(data->IsA(), ""));
290}
static std::string objectName(const TClass *t, const std::string &name)
Return the storage name for an object of the given TClass and name.
Definition DataStore.cc:150

◆ saveCalibration() [4/6]

void saveCalibration ( TObject * data,
const IntervalOfValidity & iov )
protectedinherited

Store DB payload with default name and custom IOV.

Definition at line 282 of file CalibrationAlgorithm.cc.

283{
284 saveCalibration(data, DataStore::objectName(data->IsA(), ""), iov);
285}

◆ saveCalibration() [5/6]

void saveCalibration ( TObject * data,
const std::string & name )
protectedinherited

Store DB payload with given name with default IOV.

Definition at line 292 of file CalibrationAlgorithm.cc.

293{
294 saveCalibration(data, name, m_data.getRequestedIov());
295}

◆ saveCalibration() [6/6]

void saveCalibration ( TObject * data,
const std::string & name,
const IntervalOfValidity & iov )
protectedinherited

Store DB payload with given name and custom IOV.

Definition at line 270 of file CalibrationAlgorithm.cc.

271{
272 B2DEBUG(29, "Saving calibration TObject = '" << name << "' to payloads list.");
273 getPayloads().emplace_back(name, data, iov);
274}

◆ setADC()

void setADC ( bool value = false)
inline

function to choose adc or dedx as variable

Definition at line 73 of file CDCDedxBadWireAlgorithm.h.

74 {
75 m_isADC = value;
76 if (m_isADC) m_varMax = 1000.0;
77 else m_varMax = 7.0;
78 }

◆ setDescription()

void setDescription ( const std::string & description)
inlineprotectedinherited

Set algorithm description (in constructor)

Definition at line 321 of file CalibrationAlgorithm.h.

321{m_description = description;}

◆ setHighFracThres()

void setHighFracThres ( double value)
inline

function to set high dedx fraction threshold

Definition at line 58 of file CDCDedxBadWireAlgorithm.h.

58{m_fracThres = value;}

◆ setHistCosmetics()

void setHistCosmetics ( TH2F * hist,
Color_t color )
inline

function to change histogram styles

Definition at line 140 of file CDCDedxBadWireAlgorithm.h.

141 {
142 hist->SetMarkerStyle(20);
143 hist->SetMarkerSize(0.3);
144 hist->SetMarkerColor(color);
145 hist->SetFillColor(color);
146 hist->SetStats(0);
147 }

◆ setHistPars()

void setHistPars ( int nbin,
double min,
double max )
inline

function to set adc/dedx parameters

Definition at line 83 of file CDCDedxBadWireAlgorithm.h.

84 {
85 m_varBins = nbin;
86 m_varMin = min;
87 m_varMax = max;
88 }

◆ setInputFileNames() [1/2]

void setInputFileNames ( PyObject * inputFileNames)
inherited

Set the input file names used for this algorithm from a Python list.

Set the input file names used for this algorithm and resolve the wildcards.

Definition at line 166 of file CalibrationAlgorithm.cc.

167{
168 // The reasoning for this very 'manual' approach to extending the Python interface
169 // (instead of using boost::python) is down to my fear of putting off final users with
170 // complexity on their side.
171 //
172 // I didn't want users that inherit from this class to be forced to use boost and
173 // to have to define a new python module just to use the CAF. A derived class from
174 // from a boost exposed class would need to have its own boost python module definition
175 // to allow access from a steering file and to the base class functions (I think).
176 // I also couldn't be bothered to write a full framework to get around the issue in a similar
177 // way to Module()...maybe there's an easy way.
178 //
179 // But this way we can allow people to continue using their ROOT implemented classes and inherit
180 // easily from this one. But add in a few helper functions that work with Python objects
181 // created in their steering file i.e. instead of being forced to use STL objects as input
182 // to the algorithm.
183 if (PyList_Check(inputFileNames)) {
184 boost::python::handle<> handle(boost::python::borrowed(inputFileNames));
185 boost::python::list listInputFileNames(handle);
186 auto vecInputFileNames = PyObjConvUtils::convertPythonObject(listInputFileNames, vector<string>());
187 setInputFileNames(vecInputFileNames);
188 } else {
189 B2ERROR("Tried to set the input files but we didn't receive a Python list.");
190 }
191}
void setInputFileNames(PyObject *inputFileNames)
Set the input file names used for this algorithm from a Python list.
Scalar convertPythonObject(const boost::python::object &pyObject, Scalar)
Convert from Python to given type.

◆ setInputFileNames() [2/2]

void setInputFileNames ( std::vector< std::string > inputFileNames)
protectedinherited

Set the input file names used for this algorithm.

Set the input file names used for this algorithm and resolve the wildcards.

Definition at line 194 of file CalibrationAlgorithm.cc.

195{
196 // A lot of code below is tweaked from RootInputModule::initialize,
197 // since we're basically copying the functionality anyway.
198 if (inputFileNames.empty()) {
199 B2WARNING("You have called setInputFileNames() with an empty list. Did you mean to do that?");
200 return;
201 }
202 auto tmpInputFileNames = RootIOUtilities::expandWordExpansions(inputFileNames);
203
204 // We'll use a set to enforce sorted unique file paths as we check them
205 set<string> setInputFileNames;
206 // Check that files exist and convert to absolute paths
207 for (auto path : tmpInputFileNames) {
208 string fullPath = fs::absolute(path).string();
209 if (fs::exists(fullPath)) {
210 setInputFileNames.insert(fs::canonical(fullPath).string());
211 } else {
212 B2WARNING("Couldn't find the file " << path);
213 }
214 }
215
216 if (setInputFileNames.empty()) {
217 B2WARNING("No valid files specified!");
218 return;
219 } else {
220 // Reset the run -> files map as our files are likely different
221 m_runsToInputFiles.clear();
222 }
223
224 // Open TFile to check they can be accessed by ROOT
225 TDirectory* dir = gDirectory;
226 for (const string& fileName : setInputFileNames) {
227 unique_ptr<TFile> f;
228 try {
229 f.reset(TFile::Open(fileName.c_str(), "READ"));
230 } catch (logic_error&) {
231 //this might happen for ~invaliduser/foo.root
232 //actually undefined behaviour per standard, reported as ROOT-8490 in JIRA
233 }
234 if (!f || !f->IsOpen()) {
235 B2FATAL("Couldn't open input file " + fileName);
236 }
237 }
238 dir->cd();
239
240 // Copy the entries of the set to a vector
241 m_inputFileNames = vector<string>(setInputFileNames.begin(), setInputFileNames.end());
243}
std::string m_granularityOfData
Granularity of input data. This only changes when the input files change so it isn't specific to an e...
std::string getGranularityFromData() const
Get the granularity of collected data.
std::vector< std::string > expandWordExpansions(const std::vector< std::string > &filenames)
Performs wildcard expansion using wordexp(), returns matches.

◆ setMeanThres()

void setMeanThres ( double value)
inline

function to set Mean Threshold

Definition at line 68 of file CDCDedxBadWireAlgorithm.h.

68{m_meanThres = value;}

◆ setMonitoringPlots()

void setMonitoringPlots ( bool value = false)
inline

function to enable plotting

Definition at line 53 of file CDCDedxBadWireAlgorithm.h.

53{m_isMakePlots = value;}

◆ setOutputJsonValue()

template<class T>
void setOutputJsonValue ( const std::string & key,
const T & value )
inlineprotectedinherited

Set a key:value pair for the outputJson object, expected to used internally during calibrate()

Definition at line 337 of file CalibrationAlgorithm.h.

337{m_jsonExecutionOutput[key] = value;}

◆ setPrefix()

void setPrefix ( const std::string & prefix)
inlineinherited

Set the prefix used to identify datastore objects.

Definition at line 167 of file CalibrationAlgorithm.h.

167{m_prefix = prefix;}

◆ setRMSThres()

void setRMSThres ( double value)
inline

function to set RMS Threshold

Definition at line 63 of file CDCDedxBadWireAlgorithm.h.

63{m_rmsThres = value;}

◆ setTextCosmetics()

void setTextCosmetics ( TPaveText * pt,
double size )
inline

function to change text styles

Definition at line 128 of file CDCDedxBadWireAlgorithm.h.

129 {
130 pt->SetTextAlign(11);
131 pt->SetFillStyle(3001);
132 pt->SetLineColor(2);
133 pt->SetTextFont(82);
134 pt->SetTextSize(size);
135 }

◆ updateDBObjPtrs()

void updateDBObjPtrs ( const unsigned int event = 1,
const int run = 0,
const int experiment = 0 )
protectedinherited

Updates any DBObjPtrs by calling update(event) for DBStore.

Definition at line 404 of file CalibrationAlgorithm.cc.

405{
406 // Construct an EventMetaData object but NOT in the Datastore
407 EventMetaData emd(event, run, experiment);
408 // Explicitly update while avoiding registering a Datastore object
410 // Also update the intra-run objects to the event at the same time (maybe unnecessary...)
412}
static DBStore & Instance()
Instance of a singleton DBStore.
Definition DBStore.cc:26
void updateEvent()
Updates all intra-run dependent objects.
Definition DBStore.cc:140
void update()
Updates all objects that are outside their interval of validity.
Definition DBStore.cc:77

Member Data Documentation

◆ c_nwireCDC

unsigned int c_nwireCDC
private

number of wires in CDC

Definition at line 158 of file CDCDedxBadWireAlgorithm.h.

◆ m_allExpRun

const ExpRun m_allExpRun = make_pair(-1, -1)
staticprivateinherited

allExpRun

Definition at line 364 of file CalibrationAlgorithm.h.

◆ m_amean

double m_amean
private

average mean of dedx for all wires

Definition at line 169 of file CDCDedxBadWireAlgorithm.h.

◆ m_arms

double m_arms
private

average rms of dedx for all wires

Definition at line 170 of file CDCDedxBadWireAlgorithm.h.

◆ m_boundaries

std::vector<Calibration::ExpRun> m_boundaries
protectedinherited

When using the boundaries functionality from isBoundaryRequired, this is used to store the boundaries. It is cleared when.

Definition at line 261 of file CalibrationAlgorithm.h.

◆ m_cdcGeo

DBObjPtr<CDCGeometry> m_cdcGeo
private

Geometry of CDC.

Definition at line 177 of file CDCDedxBadWireAlgorithm.h.

◆ m_data

ExecutionData m_data
privateinherited

Data specific to a SINGLE execution of the algorithm. Gets reset at the beginning of execution.

Definition at line 382 of file CalibrationAlgorithm.h.

◆ m_DBBadWires

DBObjPtr<CDCDedxBadWires> m_DBBadWires
private

Badwire DB object.

Definition at line 175 of file CDCDedxBadWireAlgorithm.h.

◆ m_DBWireGains

DBObjPtr<CDCDedxWireGain> m_DBWireGains
private

Wiregain DB object.

Definition at line 176 of file CDCDedxBadWireAlgorithm.h.

◆ m_description

std::string m_description {""}
privateinherited

Description of the algorithm.

Definition at line 385 of file CalibrationAlgorithm.h.

385{""};

◆ m_fracThres

double m_fracThres
private

high-frac Threshold accepted for good wire

Definition at line 168 of file CDCDedxBadWireAlgorithm.h.

◆ m_granularityOfData

std::string m_granularityOfData
privateinherited

Granularity of input data. This only changes when the input files change so it isn't specific to an execution.

Definition at line 379 of file CalibrationAlgorithm.h.

◆ m_inputFileNames

std::vector<std::string> m_inputFileNames
privateinherited

List of input files to the Algorithm, will initially be user defined but then gets the wildcards expanded during execute()

Definition at line 373 of file CalibrationAlgorithm.h.

◆ m_isADC

bool m_isADC
private

Use adc if(true) else dedx for calibration.

Definition at line 161 of file CDCDedxBadWireAlgorithm.h.

◆ m_isMakePlots

bool m_isMakePlots
private

produce plots for status

Definition at line 160 of file CDCDedxBadWireAlgorithm.h.

◆ m_jsonExecutionInput

nlohmann::json m_jsonExecutionInput = nlohmann::json::object()
privateinherited

Optional input JSON object used to make decisions about how to execute the algorithm code.

Definition at line 397 of file CalibrationAlgorithm.h.

◆ m_jsonExecutionOutput

nlohmann::json m_jsonExecutionOutput = nlohmann::json::object()
privateinherited

Optional output JSON object that can be set during the execution by the underlying algorithm code.

Definition at line 403 of file CalibrationAlgorithm.h.

◆ m_meanThres

double m_meanThres
private

mean Threshold accepted for good wire

Definition at line 166 of file CDCDedxBadWireAlgorithm.h.

◆ m_prefix

std::string m_prefix {""}
privateinherited

The name of the TDirectory the collector objects are contained within.

Definition at line 388 of file CalibrationAlgorithm.h.

388{""};

◆ m_rmsThres

double m_rmsThres
private

rms Threshold accepted for good wire

Definition at line 167 of file CDCDedxBadWireAlgorithm.h.

◆ m_runsToInputFiles

std::map<Calibration::ExpRun, std::vector<std::string> > m_runsToInputFiles
privateinherited

Map of Runs to input files. Gets filled when you call getRunRangeFromAllData, gets cleared when setting input files again.

Definition at line 376 of file CalibrationAlgorithm.h.

◆ m_suffix

std::string m_suffix
private

suffix std::string for naming plots

Definition at line 173 of file CDCDedxBadWireAlgorithm.h.

◆ m_varBins

int m_varBins
private

number of bins for input variable

Definition at line 163 of file CDCDedxBadWireAlgorithm.h.

◆ m_varMax

double m_varMax
private

max range for input variable

Definition at line 165 of file CDCDedxBadWireAlgorithm.h.

◆ m_varMin

double m_varMin
private

min range for input variable

Definition at line 164 of file CDCDedxBadWireAlgorithm.h.

◆ m_varName

std::string m_varName
private

std::string to set var name (adc or dedx)

Definition at line 172 of file CDCDedxBadWireAlgorithm.h.


The documentation for this class was generated from the following files: