Belle II Software development
SerializerModule Class Reference

A class definition of an input module for Sequential ROOT I/O. More...

#include <Serializer.h>

Inheritance diagram for SerializerModule:
Module PathElement

Public Types

enum  EModulePropFlags {
  c_Input = 1 ,
  c_Output = 2 ,
  c_ParallelProcessingCertified = 4 ,
  c_HistogramManager = 8 ,
  c_InternalSerializer = 16 ,
  c_TerminateInAllProcesses = 32 ,
  c_DontCollectStatistics = 64
}
 Each module can be tagged with property flags, which indicate certain features of the module. More...
 
typedef ModuleCondition::EAfterConditionPath EAfterConditionPath
 Forward the EAfterConditionPath definition from the ModuleCondition.
 

Public Member Functions

 SerializerModule ()
 Constructor / Destructor.
 
void initialize () override
 Module functions to be called from main process.
 
void beginRun () override
 Module functions to be called from event process.
 
void event () override
 This method is the core of the module.
 
void endRun () override
 This method is called if the current run ends.
 
void terminate () override
 This method is called at the end of the event processing.
 
virtual int sendByWriteV (RawDataBlock *rawdblk)
 
virtual void Accept ()
 
virtual void fillSendHeaderTrailer (SendHeader *hdr, SendTrailer *trl, RawDataBlock *rawdblk)
 
unsigned int calcXORChecksum (int *buf, int nwords)
 calculate checksum
 
void shmOpen (char *path_cfg, char *path_sta)
 open shared memory
 
int * shmGet (int fd, int size_words)
 Get shared memory.
 
int Send (int socket, char *buf, int size_bytes)
 send buffer
 
void printData (int *buf, int nwords)
 print data contents
 
int CheckConnection (int socket)
 Check socket status.
 
virtual std::vector< std::string > getFileNames (bool outputFiles)
 Return a list of output filenames for this modules.
 
const std::string & getName () const
 Returns the name of the module.
 
const std::string & getType () const
 Returns the type of the module (i.e.
 
const std::string & getPackage () const
 Returns the package this module is in.
 
const std::string & getDescription () const
 Returns the description of the module.
 
void setName (const std::string &name)
 Set the name of the module.
 
void setPropertyFlags (unsigned int propertyFlags)
 Sets the flags for the module properties.
 
LogConfiggetLogConfig ()
 Returns the log system configuration.
 
void setLogConfig (const LogConfig &logConfig)
 Set the log system configuration.
 
void setLogLevel (int logLevel)
 Configure the log level.
 
void setDebugLevel (int debugLevel)
 Configure the debug messaging level.
 
void setAbortLevel (int abortLevel)
 Configure the abort log level.
 
void setLogInfo (int logLevel, unsigned int logInfo)
 Configure the printed log information for the given level.
 
void if_value (const std::string &expression, const std::shared_ptr< Path > &path, EAfterConditionPath afterConditionPath=EAfterConditionPath::c_End)
 Add a condition to the module.
 
void if_false (const std::shared_ptr< Path > &path, EAfterConditionPath afterConditionPath=EAfterConditionPath::c_End)
 A simplified version to add a condition to the module.
 
void if_true (const std::shared_ptr< Path > &path, EAfterConditionPath afterConditionPath=EAfterConditionPath::c_End)
 A simplified version to set the condition of the module.
 
bool hasCondition () const
 Returns true if at least one condition was set for the module.
 
const ModuleConditiongetCondition () const
 Return a pointer to the first condition (or nullptr, if none was set)
 
const std::vector< ModuleCondition > & getAllConditions () const
 Return all set conditions for this module.
 
bool evalCondition () const
 If at least one condition was set, it is evaluated and true returned if at least one condition returns true.
 
std::shared_ptr< PathgetConditionPath () const
 Returns the path of the last true condition (if there is at least one, else reaturn a null pointer).
 
Module::EAfterConditionPath getAfterConditionPath () const
 What to do after the conditional path is finished.
 
std::vector< std::shared_ptr< Path > > getAllConditionPaths () const
 Return all condition paths currently set (no matter if the condition is true or not).
 
bool hasProperties (unsigned int propertyFlags) const
 Returns true if all specified property flags are available in this module.
 
bool hasUnsetForcedParams () const
 Returns true and prints error message if the module has unset parameters which the user has to set in the steering file.
 
const ModuleParamListgetParamList () const
 Return module param list.
 
template<typename T >
ModuleParam< T > & getParam (const std::string &name) const
 Returns a reference to a parameter.
 
bool hasReturnValue () const
 Return true if this module has a valid return value set.
 
int getReturnValue () const
 Return the return value set by this module.
 
std::shared_ptr< PathElementclone () const override
 Create an independent copy of this module.
 
std::shared_ptr< boost::python::list > getParamInfoListPython () const
 Returns a python list of all parameters.
 

Static Public Member Functions

static void exposePythonAPI ()
 Exposes methods of the Module class to Python.
 

Public Attributes

int m_shmflag
 Use shared memory.
 
int m_shmfd_cfg
 file descripter for shm
 
int m_shmfd_sta
 file descripter for shm
 
int * m_cfg_buf
 buffer for shared memory
 
int * m_cfg_sta
 buffer for shared memory
 

Protected Types

enum  {
  COPPER = 1 ,
  ROPC = 2
}
 

Protected Member Functions

double getTimeSec ()
 store time info.
 
void recordTime (int event, double *array)
 store time info.
 
virtual void def_initialize ()
 Wrappers to make the methods without "def_" prefix callable from Python.
 
virtual void def_beginRun ()
 Wrapper method for the virtual function beginRun() that has the implementation to be used in a call from Python.
 
virtual void def_event ()
 Wrapper method for the virtual function event() that has the implementation to be used in a call from Python.
 
virtual void def_endRun ()
 This method can receive that the current run ends as a call from the Python side.
 
virtual void def_terminate ()
 Wrapper method for the virtual function terminate() that has the implementation to be used in a call from Python.
 
void setDescription (const std::string &description)
 Sets the description of the module.
 
void setType (const std::string &type)
 Set the module type.
 
template<typename T >
void addParam (const std::string &name, T &paramVariable, const std::string &description, const T &defaultValue)
 Adds a new parameter to the module.
 
template<typename T >
void addParam (const std::string &name, T &paramVariable, const std::string &description)
 Adds a new enforced parameter to the module.
 
void setReturnValue (int value)
 Sets the return value for this module as integer.
 
void setReturnValue (bool value)
 Sets the return value for this module as bool.
 
void setParamList (const ModuleParamList &params)
 Replace existing parameter list.
 

Protected Attributes

int BUF_SIZE_WORD
 size of buffer for one event (word)
 
int m_compressionLevel
 Compression parameter.
 
int n_basf2evt
 No. of sent events.
 
int * m_buffer
 
std::string m_hostname_local
 Destination Host.
 
int m_port_to
 Destination port.
 
int m_socket
 Socket ID.
 
EvtSocketSendm_sock
 EvtSocket.
 
double m_start_time
 
double m_prev_time
 
unsigned int m_prev_nevt
 
double m_prev_totbytes
 
double time_array0 [1000]
 
double time_array1 [1000]
 
double time_array2 [1000]
 
std::string p_method
 How to handle data.
 
int p_method_val
 
CprErrorMessage print_err
 error message program
 
unsigned long long m_totbytes
 sent data size
 
int m_start_flag
 start flag
 
RawHeader_latest tmp_header
 which format is used
 

Private Member Functions

std::list< ModulePtrgetModules () const override
 no submodules, return empty list
 
std::string getPathString () const override
 return the module name.
 
void setParamPython (const std::string &name, const boost::python::object &pyObj)
 Implements a method for setting boost::python objects.
 
void setParamPythonDict (const boost::python::dict &dictionary)
 Implements a method for reading the parameter values from a boost::python dictionary.
 

Private Attributes

std::string m_name
 The name of the module, saved as a string (user-modifiable)
 
std::string m_type
 The type of the module, saved as a string.
 
std::string m_package
 Package this module is found in (may be empty).
 
std::string m_description
 The description of the module.
 
unsigned int m_propertyFlags
 The properties of the module as bitwise or (with |) of EModulePropFlags.
 
LogConfig m_logConfig
 The log system configuration of the module.
 
ModuleParamList m_moduleParamList
 List storing and managing all parameter of the module.
 
bool m_hasReturnValue
 True, if the return value is set.
 
int m_returnValue
 The return value.
 
std::vector< ModuleConditionm_conditions
 Module condition, only non-null if set.
 

Detailed Description

A class definition of an input module for Sequential ROOT I/O.

Definition at line 35 of file Serializer.h.

Member Typedef Documentation

◆ EAfterConditionPath

Forward the EAfterConditionPath definition from the ModuleCondition.

Definition at line 88 of file Module.h.

Member Enumeration Documentation

◆ anonymous enum

anonymous enum
protected

Definition at line 96 of file Serializer.h.

96 {
97 COPPER = 1,
98 ROPC = 2
99 };

◆ EModulePropFlags

enum EModulePropFlags
inherited

Each module can be tagged with property flags, which indicate certain features of the module.

Enumerator
c_Input 

This module is an input module (reads data).

c_Output 

This module is an output module (writes data).

c_ParallelProcessingCertified 

This module can be run in parallel processing mode safely (All I/O must be done through the data store, in particular, the module must not write any files.)

c_HistogramManager 

This module is used to manage histograms accumulated by other modules.

c_InternalSerializer 

This module is an internal serializer/deserializer for parallel processing.

c_TerminateInAllProcesses 

When using parallel processing, call this module's terminate() function in all processes().

This will also ensure that there is exactly one process (single-core if no parallel modules found) or at least one input, one main and one output process.

c_DontCollectStatistics 

No statistics is collected for this module.

Definition at line 77 of file Module.h.

77 {
78 c_Input = 1,
79 c_Output = 2,
85 };
@ c_HistogramManager
This module is used to manage histograms accumulated by other modules.
Definition: Module.h:81
@ c_Input
This module is an input module (reads data).
Definition: Module.h:78
@ c_DontCollectStatistics
No statistics is collected for this module.
Definition: Module.h:84
@ c_ParallelProcessingCertified
This module can be run in parallel processing mode safely (All I/O must be done through the data stor...
Definition: Module.h:80
@ c_InternalSerializer
This module is an internal serializer/deserializer for parallel processing.
Definition: Module.h:82
@ c_Output
This module is an output module (writes data).
Definition: Module.h:79
@ c_TerminateInAllProcesses
When using parallel processing, call this module's terminate() function in all processes().
Definition: Module.h:83

Constructor & Destructor Documentation

◆ SerializerModule()

Constructor / Destructor.

Definition at line 35 of file Serializer.cc.

35 : Module()
36{
37 //Set module properties
38 setDescription("Encode DataStore into RingBuffer");
39 addParam("DestPort", m_port_to, "Destination port", BASE_PORT_ROPC_COPPER);
40 addParam("LocalHostName", m_hostname_local, "local host", string(""));
41#ifdef DUMMY
42 addParam("EventDataBufferWords", BUF_SIZE_WORD, "DataBuffer words per event", 4800);
43#endif
44 addParam("use Shared Memory", m_shmflag, "m_shmflag", 0);
45
46 m_start_flag = 0;
47 n_basf2evt = -1;
49
50 //Parameter definition
51 B2INFO("Tx: Constructor done.");
52
53}
void setDescription(const std::string &description)
Sets the description of the module.
Definition: Module.cc:214
Module()
Constructor.
Definition: Module.cc:30
int m_port_to
Destination port.
Definition: Serializer.h:118
std::string m_hostname_local
Destination Host.
Definition: Serializer.h:115
int m_start_flag
start flag
Definition: Serializer.h:155
int BUF_SIZE_WORD
size of buffer for one event (word)
Definition: Serializer.h:102
int n_basf2evt
No. of sent events.
Definition: Serializer.h:108
int m_shmflag
Use shared memory.
Definition: Serializer.h:64
int m_compressionLevel
Compression parameter.
Definition: Serializer.h:105
void addParam(const std::string &name, T &paramVariable, const std::string &description, const T &defaultValue)
Adds a new parameter to the module.
Definition: Module.h:560

◆ ~SerializerModule()

~SerializerModule ( )
virtual

Definition at line 57 of file Serializer.cc.

58{
59}

Member Function Documentation

◆ Accept()

void Accept ( )
virtual

Definition at line 356 of file Serializer.cc.

357{
358
359 //
360 // Connect to cprtb01
361 //
362
363 struct hostent* host;
364 host = gethostbyname(m_hostname_local.c_str());
365 if (host == NULL) {
366 char temp_buf[500];
367 sprintf(temp_buf, "[FATAL] hostname(%s) cannot be resolved(%s). Check /etc/hosts. Exiting...\n",
368 m_hostname_local.c_str(), strerror(errno));
369 print_err.PrintError(temp_buf, __FILE__, __PRETTY_FUNCTION__, __LINE__);
370 sleep(1234567);
371 exit(1);
372 }
373
374
375
376
377 //
378 // Bind and listen
379 //
380 int fd_listen;
381 struct sockaddr_in sock_listen;
382 sock_listen.sin_family = AF_INET;
383 sock_listen.sin_addr.s_addr = *(unsigned int*)host->h_addr_list[0];
384
385 socklen_t addrlen = sizeof(sock_listen);
386 sock_listen.sin_port = htons(m_port_to);
387 fd_listen = socket(PF_INET, SOCK_STREAM, 0);
388
389 int flags = 1;
390 int ret = setsockopt(fd_listen, SOL_SOCKET, SO_REUSEADDR, &flags, (socklen_t)sizeof(flags));
391 if (ret < 0) {
392 perror("Failed to set REUSEADDR");
393 }
394
395 if (bind(fd_listen, (struct sockaddr*)&sock_listen, sizeof(struct sockaddr)) < 0) {
396 char temp_char[500];
397 sprintf(temp_char, "[FATAL] Failed to bind.(%s) Maybe other programs have already occupied this port(%d). Exiting...",
398 strerror(errno), m_port_to);
399 print_err.PrintError(temp_char, __FILE__, __PRETTY_FUNCTION__, __LINE__);
400 exit(1);
401 }
402
403 int val1 = 0;
404 setsockopt(fd_listen, IPPROTO_TCP, TCP_NODELAY, &val1, (socklen_t)sizeof(val1));
405 int backlog = 1;
406 if (listen(fd_listen, backlog) < 0) {
407 char err_buf[500];
408 sprintf(err_buf, "[FATAL] Failed in listen(%s). Exting...", strerror(errno));
409 print_err.PrintError(err_buf, __FILE__, __PRETTY_FUNCTION__, __LINE__);
410 exit(-1);
411 }
412
413 //
414 // Accept
415 //
416 int fd_accept;
417 struct sockaddr_in sock_accept;
418 // printf( "[DEBUG] Accepting... : port %d server %s\n", m_port_to, m_hostname_local.c_str());
419 // fflush(stderr);
420 // B2INFO("Accepting... : port " << m_port_to << " server " << m_hostname_local.c_str() );
421 B2INFO("Accepting...");
422 if ((fd_accept = accept(fd_listen, (struct sockaddr*) & (sock_accept), &addrlen)) == 0) {
423 char err_buf[500];
424 sprintf(err_buf, "[FATAL] Failed to accept(%s). Exiting...", strerror(errno));
425 print_err.PrintError(err_buf, __FILE__, __PRETTY_FUNCTION__, __LINE__);
426 exit(-1);
427 } else {
428 // B2INFO("Connection is established: port " << htons(sock_accept.sin_port) << " address " << sock_accept.sin_addr.s_addr );
429 B2INFO("Done.");
430
431 // set timepout option
432 struct timeval timeout;
433 timeout.tv_sec = 1;
434 timeout.tv_usec = 0;
435 ret = setsockopt(fd_accept, SOL_SOCKET, SO_SNDTIMEO, &timeout, (socklen_t)sizeof(timeout));
436 if (ret < 0) {
437 char temp_char[100] = "[FATAL] Failed to set TIMEOUT. Exiting...";
438 print_err.PrintError(temp_char, __FILE__, __PRETTY_FUNCTION__, __LINE__);
439 exit(-1);
440 }
441 }
442 close(fd_listen);
443
444 // int flag = 1;
445 // ret = setsockopt(fd_accept, IPPROTO_TCP, TCP_NODELAY, (char*)&flag, sizeof(flag) );
446 m_socket = fd_accept;
447 RunInfoBuffer& status(DeSerializerModule::getStatus());
448 if (status.isAvailable()) {
449 //status.setOutputPort(ntohs(sock_accept.sin_port));
450 //status.setOutputAddress(sock_accept.sin_addr.s_addr);
451 status.setOutputPort(ntohs(sock_listen.sin_port));
452 status.setOutputAddress(sock_listen.sin_addr.s_addr);
453 printf("%d %x\n", (int)ntohs(sock_listen.sin_port), (int)sock_listen.sin_addr.s_addr);
454 }
455
456 return;
457
458}
int m_socket
Socket ID.
Definition: Serializer.h:121
CprErrorMessage print_err
error message program
Definition: Serializer.h:149

◆ beginRun()

void beginRun ( void  )
overridevirtual

Module functions to be called from event process.

Reimplemented from Module.

Definition at line 102 of file Serializer.cc.

103{
104 B2INFO("beginRun called.");
105}

◆ calcXORChecksum()

unsigned int calcXORChecksum ( int *  buf,
int  nwords 
)

calculate checksum

Definition at line 477 of file Serializer.cc.

478{
479 unsigned int checksum = 0;
480 for (int i = 0; i < nwords; i++) {
481 checksum = checksum ^ buf[ i ];
482 }
483 return checksum;
484}

◆ clone()

std::shared_ptr< PathElement > clone ( ) const
overridevirtualinherited

Create an independent copy of this module.

Note that parameters are shared, so changing them on a cloned module will also affect the original module.

Implements PathElement.

Definition at line 179 of file Module.cc.

180{
182 newModule->m_moduleParamList.setParameters(getParamList());
183 newModule->setName(getName());
184 newModule->m_package = m_package;
185 newModule->m_propertyFlags = m_propertyFlags;
186 newModule->m_logConfig = m_logConfig;
187 newModule->m_conditions = m_conditions;
188
189 return newModule;
190}
std::shared_ptr< Module > registerModule(const std::string &moduleName, std::string sharedLibPath="") noexcept(false)
Creates an instance of a module and registers it to the ModuleManager.
static ModuleManager & Instance()
Exception is thrown if the requested module could not be created by the ModuleManager.
const ModuleParamList & getParamList() const
Return module param list.
Definition: Module.h:363
const std::string & getName() const
Returns the name of the module.
Definition: Module.h:187
const std::string & getType() const
Returns the type of the module (i.e.
Definition: Module.cc:41
unsigned int m_propertyFlags
The properties of the module as bitwise or (with |) of EModulePropFlags.
Definition: Module.h:512
LogConfig m_logConfig
The log system configuration of the module.
Definition: Module.h:514
std::vector< ModuleCondition > m_conditions
Module condition, only non-null if set.
Definition: Module.h:521
std::string m_package
Package this module is found in (may be empty).
Definition: Module.h:510
std::shared_ptr< Module > ModulePtr
Defines a pointer to a module object as a boost shared pointer.
Definition: Module.h:43

◆ def_beginRun()

virtual void def_beginRun ( )
inlineprotectedvirtualinherited

Wrapper method for the virtual function beginRun() that has the implementation to be used in a call from Python.

Reimplemented in PyModule.

Definition at line 426 of file Module.h.

426{ beginRun(); }
virtual void beginRun()
Called when entering a new run.
Definition: Module.h:147

◆ def_endRun()

virtual void def_endRun ( )
inlineprotectedvirtualinherited

This method can receive that the current run ends as a call from the Python side.

For regular C++-Modules that forwards the call to the regular endRun() method.

Reimplemented in PyModule.

Definition at line 439 of file Module.h.

439{ endRun(); }
virtual void endRun()
This method is called if the current run ends.
Definition: Module.h:166

◆ def_event()

virtual void def_event ( )
inlineprotectedvirtualinherited

Wrapper method for the virtual function event() that has the implementation to be used in a call from Python.

Reimplemented in PyModule.

Definition at line 432 of file Module.h.

432{ event(); }
virtual void event()
This method is the core of the module.
Definition: Module.h:157

◆ def_initialize()

virtual void def_initialize ( )
inlineprotectedvirtualinherited

Wrappers to make the methods without "def_" prefix callable from Python.

Overridden in PyModule. Wrapper method for the virtual function initialize() that has the implementation to be used in a call from Python.

Reimplemented in PyModule.

Definition at line 420 of file Module.h.

420{ initialize(); }
virtual void initialize()
Initialize the Module.
Definition: Module.h:109

◆ def_terminate()

virtual void def_terminate ( )
inlineprotectedvirtualinherited

Wrapper method for the virtual function terminate() that has the implementation to be used in a call from Python.

Reimplemented in PyModule.

Definition at line 445 of file Module.h.

445{ terminate(); }
virtual void terminate()
This method is called at the end of the event processing.
Definition: Module.h:176

◆ endRun()

void endRun ( void  )
overridevirtual

This method is called if the current run ends.

Use this method to store information, which should be aggregated over one run.

This method can be implemented by subclasses.

Reimplemented from Module.

Definition at line 110 of file Serializer.cc.

111{
112 //fill Run data
113 B2INFO("endRun done.");
114}

◆ evalCondition()

bool evalCondition ( ) const
inherited

If at least one condition was set, it is evaluated and true returned if at least one condition returns true.

If no condition or result value was defined, the method returns false. Otherwise, the condition is evaluated and true returned, if at least one condition returns true. To speed up the evaluation, the condition strings were already parsed in the method if_value().

Returns
True if at least one condition and return value exists and at least one condition expression was evaluated to true.

Definition at line 96 of file Module.cc.

97{
98 if (m_conditions.empty()) return false;
99
100 //okay, a condition was set for this Module...
101 if (!m_hasReturnValue) {
102 B2FATAL("A condition was set for '" << getName() << "', but the module did not set a return value!");
103 }
104
105 for (const auto& condition : m_conditions) {
106 if (condition.evaluate(m_returnValue)) {
107 return true;
108 }
109 }
110 return false;
111}
int m_returnValue
The return value.
Definition: Module.h:519
bool m_hasReturnValue
True, if the return value is set.
Definition: Module.h:518

◆ event()

void event ( void  )
overridevirtual

This method is the core of the module.

This method is called for each event. All processing of the event has to take place in this method.

This method can be implemented by subclasses.

Reimplemented from Module.

Definition at line 595 of file Serializer.cc.

596{
597
598#ifdef NONSTOP
599 if (g_run_pause == 1) {
600#ifdef NONSTOP_DEBUG
601 printf("\033[31m");
602 printf("###########(Ser) Go back to Deseializer() ###############\n");
603 fflush(stdout);
604 printf("\033[0m");
605#endif
606 return; // Nothing to do here
607 } else if (g_run_resuming == 1) {
608#ifdef NONSTOP_DEBUG
609 printf("\033[31m");
610 printf("###########(Ser) Run resuming...() ###############\n");
611 fflush(stdout);
612 printf("\033[0m");
613#endif
614 resumeRun();
615 return;
616 }
617#endif
618
619 if (m_start_flag == 0) {
620 m_start_time = getTimeSec();
621 n_basf2evt = 0;
622 }
623
624#ifdef TIME_MONITOR
625 recordTime(n_basf2evt, time_array0);
626#endif
627
628 // StoreArray<RawCOPPER> rawcprarray;
629 StoreArray<RawDataBlock> raw_dblkarray;
630
631
632 for (int j = 0; j < raw_dblkarray.getEntries(); j++) {
633 //
634 // Send data
635 //
636 if (m_start_flag == 0) {
637 B2INFO("SerializerPC: Sending the 1st packet...");
638 }
639
640 try {
641 m_totbytes += sendByWriteV(raw_dblkarray[ j ]);
642 // } catch (string err_str) {
643 } catch (const string& err_str) {
644
645#ifdef NONSTOP
646 if (err_str == "RUN_PAUSE" || err_str == "RUN_ERROR") {
647 return; // Go to DeSerializer***() to wait for run-resume.
648 }
649#endif
650 print_err.PrintError((char*)(err_str.c_str()), __FILE__, __PRETTY_FUNCTION__, __LINE__);
651 exit(1);
652 }
653 if (m_start_flag == 0) {
654 B2INFO("Done. ");
655 m_start_flag = 1;
656 }
657 }
658
659
660 //
661 // Print current status
662 //
663 if (n_basf2evt % 1000 == 0) {
664 // double cur_time = getTimeSec();
665 // double total_time = cur_time - m_start_time;
666 // double interval = cur_time - m_prev_time;
667 // if (n_basf2evt != 0) {
668 // double multieve = (1. / interval);
669 // if (multieve > 2.) multieve = 2.;
670 // }
671 // time_t timer;
672 // struct tm* t_st;
673 // time(&timer);
674 // t_st = localtime(&timer);
675 // printf( "[DEBUG] Event %d TotSent %.1lf [MB] ElapsedTime %.1lf [s] RcvdRate %.2lf [MB/s] %s",
676 // n_basf2evt, m_totbytes / 1.e6, total_time, (m_totbytes - m_prev_totbytes) / interval / 1.e6, asctime(t_st));
677 // fflush(stderr);
678 // m_prev_time = cur_time;
679 // m_prev_totbytes = m_totbytes;
680 // m_prev_nevt = n_basf2evt;
681 }
682 n_basf2evt++;
683 RunInfoBuffer& status(DeSerializerModule::getStatus());
684 if (status.isAvailable()) {
685 status.setOutputNBytes(m_totbytes);
686 status.addOutputCount(raw_dblkarray.getEntries());
687 }
688
689}
unsigned long long m_totbytes
sent data size
Definition: Serializer.h:152
void recordTime(int event, double *array)
store time info.
Definition: Serializer.cc:468
double getTimeSec()
store time info.
Definition: Serializer.cc:460
Accessor to arrays stored in the data store.
Definition: StoreArray.h:113
int getEntries() const
Get the number of objects in the array.
Definition: StoreArray.h:216

◆ exposePythonAPI()

void exposePythonAPI ( )
staticinherited

Exposes methods of the Module class to Python.

Definition at line 325 of file Module.cc.

326{
327 // to avoid confusion between std::arg and boost::python::arg we want a shorthand namespace as well
328 namespace bp = boost::python;
329
330 docstring_options options(true, true, false); //userdef, py sigs, c++ sigs
331
332 void (Module::*setReturnValueInt)(int) = &Module::setReturnValue;
333
334 enum_<Module::EAfterConditionPath>("AfterConditionPath",
335 R"(Determines execution behaviour after a conditional path has been executed:
336
337.. attribute:: END
338
339 End processing of this path after the conditional path. (this is the default for if_value() etc.)
340
341.. attribute:: CONTINUE
342
343 After the conditional path, resume execution after this module.)")
344 .value("END", Module::EAfterConditionPath::c_End)
345 .value("CONTINUE", Module::EAfterConditionPath::c_Continue)
346 ;
347
348 /* Do not change the names of >, <, ... we use them to serialize conditional pathes */
349 enum_<Belle2::ModuleCondition::EConditionOperators>("ConditionOperator")
356 ;
357
358 enum_<Module::EModulePropFlags>("ModulePropFlags",
359 R"(Flags to indicate certain low-level features of modules, see :func:`Module.set_property_flags()`, :func:`Module.has_properties()`. Most useful flags are:
360
361.. attribute:: PARALLELPROCESSINGCERTIFIED
362
363 This module can be run in parallel processing mode safely (All I/O must be done through the data store, in particular, the module must not write any files.)
364
365.. attribute:: HISTOGRAMMANAGER
366
367 This module is used to manage histograms accumulated by other modules
368
369.. attribute:: TERMINATEINALLPROCESSES
370
371 When using parallel processing, call this module's terminate() function in all processes. This will also ensure that there is exactly one process (single-core if no parallel modules found) or at least one input, one main and one output process.
372)")
373 .value("INPUT", Module::EModulePropFlags::c_Input)
374 .value("OUTPUT", Module::EModulePropFlags::c_Output)
375 .value("PARALLELPROCESSINGCERTIFIED", Module::EModulePropFlags::c_ParallelProcessingCertified)
376 .value("HISTOGRAMMANAGER", Module::EModulePropFlags::c_HistogramManager)
377 .value("INTERNALSERIALIZER", Module::EModulePropFlags::c_InternalSerializer)
378 .value("TERMINATEINALLPROCESSES", Module::EModulePropFlags::c_TerminateInAllProcesses)
379 ;
380
381 //Python class definition
382 class_<Module, PyModule> module("Module", R"(
383Base class for Modules.
384
385A module is the smallest building block of the framework.
386A typical event processing chain consists of a Path containing
387modules. By inheriting from this base class, various types of
388modules can be created. To use a module, please refer to
389:func:`Path.add_module()`. A list of modules is available by running
390``basf2 -m`` or ``basf2 -m package``, detailed information on parameters is
391given by e.g. ``basf2 -m RootInput``.
392
393The 'Module Development' section in the manual provides detailed information
394on how to create modules, setting parameters, or using return values/conditions:
395https://xwiki.desy.de/xwiki/rest/p/f4fa4/#HModuleDevelopment
396
397)");
398 module
399 .def("__str__", &Module::getPathString)
400 .def("name", &Module::getName, return_value_policy<copy_const_reference>(),
401 "Returns the name of the module. Can be changed via :func:`set_name() <Module.set_name()>`, use :func:`type() <Module.type()>` for identifying a particular module class.")
402 .def("type", &Module::getType, return_value_policy<copy_const_reference>(),
403 "Returns the type of the module (i.e. class name minus 'Module')")
404 .def("set_name", &Module::setName, args("name"), R"(
405Set custom name, e.g. to distinguish multiple modules of the same type.
406
407>>> path.add_module('EventInfoSetter')
408>>> ro = path.add_module('RootOutput', branchNames=['EventMetaData'])
409>>> ro.set_name('RootOutput_metadata_only')
410>>> print(path)
411[EventInfoSetter -> RootOutput_metadata_only]
412
413)")
414 .def("description", &Module::getDescription, return_value_policy<copy_const_reference>(),
415 "Returns the description of this module.")
416 .def("package", &Module::getPackage, return_value_policy<copy_const_reference>(),
417 "Returns the package this module belongs to.")
418 .def("available_params", &_getParamInfoListPython,
419 "Return list of all module parameters as `ModuleParamInfo` instances")
420 .def("has_properties", &Module::hasProperties, (bp::arg("properties")),
421 R"DOCSTRING(Allows to check if the module has the given properties out of `ModulePropFlags` set.
422
423>>> if module.has_properties(ModulePropFlags.PARALLELPROCESSINGCERTIFIED):
424>>> ...
425
426Parameters:
427 properties (int): bitmask of `ModulePropFlags` to check for.
428)DOCSTRING")
429 .def("set_property_flags", &Module::setPropertyFlags, args("property_mask"),
430 "Set module properties in the form of an OR combination of `ModulePropFlags`.");
431 {
432 // python signature is too crowded, make ourselves
433 docstring_options subOptions(true, false, false); //userdef, py sigs, c++ sigs
434 module
435 .def("if_value", &Module::if_value,
436 (bp::arg("expression"), bp::arg("condition_path"), bp::arg("after_condition_path")= Module::EAfterConditionPath::c_End),
437 R"DOCSTRING(if_value(expression, condition_path, after_condition_path=AfterConditionPath.END)
438
439Sets a conditional sub path which will be executed after this
440module if the return value set in the module passes the given ``expression``.
441
442Modules can define a return value (int or bool) using ``setReturnValue()``,
443which can be used in the steering file to split the Path based on this value, for example
444
445>>> module_with_condition.if_value("<1", another_path)
446
447In case the return value of the ``module_with_condition`` for a given event is
448less than 1, the execution will be diverted into ``another_path`` for this event.
449
450You could for example set a special return value if an error occurs, and divert
451the execution into a path containing :b2:mod:`RootOutput` if it is found;
452saving only the data producing/produced by the error.
453
454After a conditional path has executed, basf2 will by default stop processing
455the path for this event. This behaviour can be changed by setting the
456``after_condition_path`` argument.
457
458Parameters:
459 expression (str): Expression to determine if the conditional path should be executed.
460 This should be one of the comparison operators ``<``, ``>``, ``<=``,
461 ``>=``, ``==``, or ``!=`` followed by a numerical value for the return value
462 condition_path (Path): path to execute in case the expression is fulfilled
463 after_condition_path (AfterConditionPath): What to do once the ``condition_path`` has been executed.
464)DOCSTRING")
465 .def("if_false", &Module::if_false,
466 (bp::arg("condition_path"), bp::arg("after_condition_path")= Module::EAfterConditionPath::c_End),
467 R"DOC(if_false(condition_path, after_condition_path=AfterConditionPath.END)
468
469Sets a conditional sub path which will be executed after this module if
470the return value of the module evaluates to False. This is equivalent to
471calling `if_value` with ``expression=\"<1\"``)DOC")
472 .def("if_true", &Module::if_true,
473 (bp::arg("condition_path"), bp::arg("after_condition_path")= Module::EAfterConditionPath::c_End),
474 R"DOC(if_true(condition_path, after_condition_path=AfterConditionPath.END)
475
476Sets a conditional sub path which will be executed after this module if
477the return value of the module evaluates to True. It is equivalent to
478calling `if_value` with ``expression=\">=1\"``)DOC");
479 }
480 module
481 .def("has_condition", &Module::hasCondition,
482 "Return true if a conditional path has been set for this module "
483 "using `if_value`, `if_true` or `if_false`")
484 .def("get_all_condition_paths", &_getAllConditionPathsPython,
485 "Return a list of all conditional paths set for this module using "
486 "`if_value`, `if_true` or `if_false`")
487 .def("get_all_conditions", &_getAllConditionsPython,
488 "Return a list of all conditional path expressions set for this module using "
489 "`if_value`, `if_true` or `if_false`")
490 .add_property("logging", make_function(&Module::getLogConfig, return_value_policy<reference_existing_object>()),
@ c_GE
Greater or equal than: ">=".
@ c_SE
Smaller or equal than: "<=".
@ c_GT
Greater than: ">"
@ c_NE
Not equal: "!=".
@ c_EQ
Equal: "=" or "=="
@ c_ST
Smaller than: "<"
Base class for Modules.
Definition: Module.h:72
LogConfig & getLogConfig()
Returns the log system configuration.
Definition: Module.h:225
void if_value(const std::string &expression, const std::shared_ptr< Path > &path, EAfterConditionPath afterConditionPath=EAfterConditionPath::c_End)
Add a condition to the module.
Definition: Module.cc:79
void setPropertyFlags(unsigned int propertyFlags)
Sets the flags for the module properties.
Definition: Module.cc:208
void if_true(const std::shared_ptr< Path > &path, EAfterConditionPath afterConditionPath=EAfterConditionPath::c_End)
A simplified version to set the condition of the module.
Definition: Module.cc:90
void setReturnValue(int value)
Sets the return value for this module as integer.
Definition: Module.cc:220
void setLogConfig(const LogConfig &logConfig)
Set the log system configuration.
Definition: Module.h:230
const std::string & getDescription() const
Returns the description of the module.
Definition: Module.h:202
void if_false(const std::shared_ptr< Path > &path, EAfterConditionPath afterConditionPath=EAfterConditionPath::c_End)
A simplified version to add a condition to the module.
Definition: Module.cc:85
bool hasCondition() const
Returns true if at least one condition was set for the module.
Definition: Module.h:311
const std::string & getPackage() const
Returns the package this module is in.
Definition: Module.h:197
void setName(const std::string &name)
Set the name of the module.
Definition: Module.h:214
bool hasProperties(unsigned int propertyFlags) const
Returns true if all specified property flags are available in this module.
Definition: Module.cc:160
std::string getPathString() const override
return the module name.
Definition: Module.cc:192

◆ fillSendHeaderTrailer()

void fillSendHeaderTrailer ( SendHeader hdr,
SendTrailer trl,
RawDataBlock rawdblk 
)
virtual

Definition at line 166 of file Serializer.cc.

168{
169
170 int total_send_nwords =
171 hdr->GetHdrNwords() +
172 rawdblk->TotalBufNwords() +
173 // rawhdr.GetNwords() +
174 trl->GetTrlNwords();
175
176 hdr->SetNwords(total_send_nwords);
177 hdr->SetNumEventsinPacket(rawdblk->GetNumEvents());
178 hdr->SetNumNodesinPacket(rawdblk->GetNumNodes());
179
180 //
181 // For bug check
182 //
183 if (rawdblk->GetNumEntries() == 1) {
184 if (total_send_nwords != (rawdblk->GetBuffer(0))[ 0 ] + 8) {
185 char err_buf[500];
186 sprintf(err_buf, "[FATAL] Length error. total length %d rawdblk length %d. Exting...\n",
187 total_send_nwords, (rawdblk->GetBuffer(0))[ 0 ]);
188 printData(rawdblk->GetBuffer(0), rawdblk->TotalBufNwords());
189 print_err.PrintError(err_buf, __FILE__, __PRETTY_FUNCTION__, __LINE__);
190 sleep(1234567);
191 exit(-1);
192 }
193 }
194
195
196 for (int i = 0; i < rawdblk->GetNumEntries(); i++) {
197
198 //copy event # from a tonp COPPER block
199 if (!(rawdblk->CheckFTSWID(i)) && !(rawdblk->CheckTLUID(i))) {
200 tmp_header.SetBuffer(rawdblk->GetBuffer(i));
201 hdr->SetEventNumber(tmp_header.GetEveNo());
202 hdr->SetNodeID(tmp_header.GetNodeID());
203 hdr->SetExpRunWord(tmp_header.GetExpRunSubrun());
204 break;
205 }
206
207 //Error if you cannot find any COPPER block
208 if (i == (rawdblk->GetNumEntries() - 1)) {
209 printf("[DEBUG] i= %d : num entries %d : Tot words %d\n", i, rawdblk->GetNumEntries(), rawdblk->TotalBufNwords());
210 printData(rawdblk->GetBuffer(0), rawdblk->TotalBufNwords());
211
212 char err_buf[500] = "[FATAL] CORRUPTED DATA: No COPPER blocks in RawDataBlock. Exiting...";
213 print_err.PrintError(err_buf, __FILE__, __PRETTY_FUNCTION__, __LINE__);
214 sleep(1234567);
215 exit(-1);
216 }
217 }
218 return;
219}
virtual int * GetBuffer(int n)
get nth buffer pointer
Definition: RawDataBlock.h:53
virtual int CheckFTSWID(int n)
get FTSW ID to check whether this data block is FTSW data or not
Definition: RawDataBlock.h:101
virtual int GetNumEntries()
get # of data blocks = (# of nodes)*(# of events)
Definition: RawDataBlock.h:67
virtual int GetNumNodes()
get # of data sources(e.g. # of COPPER boards) in m_buffer
Definition: RawDataBlock.h:74
virtual int CheckTLUID(int n)
get FTSW ID to check whether this data block is FTSW data or not
Definition: RawDataBlock.h:108
virtual int GetNumEvents()
get # of events in m_buffer
Definition: RawDataBlock.h:81
virtual int TotalBufNwords()
Get total length of m_buffer.
Definition: RawDataBlock.h:39
void SetBuffer(int *bufin)
set buffer
void SetNumEventsinPacket(int num_events)
set contents of Header
Definition: SendHeader.cc:61
int GetHdrNwords()
get contents of Header
Definition: SendHeader.cc:124
void SetNwords(int total_data_nwords)
initialize Header
Definition: SendHeader.cc:51
void printData(int *buf, int nwords)
print data contents
Definition: Serializer.cc:487
RawHeader_latest tmp_header
which format is used
Definition: Serializer.h:176
unsigned int GetEveNo()
get restart #(8bit)
unsigned int GetNodeID()
get contents of header
unsigned int GetExpRunSubrun()
get contents of header

◆ getAfterConditionPath()

Module::EAfterConditionPath getAfterConditionPath ( ) const
inherited

What to do after the conditional path is finished.

(defaults to c_End if no condition is set)

Definition at line 133 of file Module.cc.

134{
135 if (m_conditions.empty()) return EAfterConditionPath::c_End;
136
137 //okay, a condition was set for this Module...
138 if (!m_hasReturnValue) {
139 B2FATAL("A condition was set for '" << getName() << "', but the module did not set a return value!");
140 }
141
142 for (const auto& condition : m_conditions) {
143 if (condition.evaluate(m_returnValue)) {
144 return condition.getAfterConditionPath();
145 }
146 }
147
148 return EAfterConditionPath::c_End;
149}

◆ getAllConditionPaths()

std::vector< std::shared_ptr< Path > > getAllConditionPaths ( ) const
inherited

Return all condition paths currently set (no matter if the condition is true or not).

Definition at line 150 of file Module.cc.

151{
152 std::vector<std::shared_ptr<Path>> allConditionPaths;
153 for (const auto& condition : m_conditions) {
154 allConditionPaths.push_back(condition.getPath());
155 }
156
157 return allConditionPaths;
158}

◆ getAllConditions()

const std::vector< ModuleCondition > & getAllConditions ( ) const
inlineinherited

Return all set conditions for this module.

Definition at line 324 of file Module.h.

325 {
326 return m_conditions;
327 }

◆ getCondition()

const ModuleCondition * getCondition ( ) const
inlineinherited

Return a pointer to the first condition (or nullptr, if none was set)

Definition at line 314 of file Module.h.

315 {
316 if (m_conditions.empty()) {
317 return nullptr;
318 } else {
319 return &m_conditions.front();
320 }
321 }

◆ getConditionPath()

std::shared_ptr< Path > getConditionPath ( ) const
inherited

Returns the path of the last true condition (if there is at least one, else reaturn a null pointer).


Definition at line 113 of file Module.cc.

114{
115 PathPtr p;
116 if (m_conditions.empty()) return p;
117
118 //okay, a condition was set for this Module...
119 if (!m_hasReturnValue) {
120 B2FATAL("A condition was set for '" << getName() << "', but the module did not set a return value!");
121 }
122
123 for (const auto& condition : m_conditions) {
124 if (condition.evaluate(m_returnValue)) {
125 return condition.getPath();
126 }
127 }
128
129 // if none of the conditions were true, return a null pointer.
130 return p;
131}
std::shared_ptr< Path > PathPtr
Defines a pointer to a path object as a boost shared pointer.
Definition: Path.h:35

◆ getDescription()

const std::string & getDescription ( ) const
inlineinherited

Returns the description of the module.

Definition at line 202 of file Module.h.

202{return m_description;}
std::string m_description
The description of the module.
Definition: Module.h:511

◆ getFileNames()

virtual std::vector< std::string > getFileNames ( bool  outputFiles)
inlinevirtualinherited

Return a list of output filenames for this modules.

This will be called when basf2 is run with "--dry-run" if the module has set either the c_Input or c_Output properties.

If the parameter outputFiles is false (for modules with c_Input) the list of input filenames should be returned (if any). If outputFiles is true (for modules with c_Output) the list of output files should be returned (if any).

If a module has sat both properties this member is called twice, once for each property.

The module should return the actual list of requested input or produced output filenames (including handling of input/output overrides) so that the grid system can handle input/output files correctly.

This function should return the same value when called multiple times. This is especially important when taking the input/output overrides from Environment as they get consumed when obtained so the finalized list of output files should be stored for subsequent calls.

Reimplemented in RootInputModule, StorageRootOutputModule, and RootOutputModule.

Definition at line 134 of file Module.h.

135 {
136 return std::vector<std::string>();
137 }

◆ getLogConfig()

LogConfig & getLogConfig ( )
inlineinherited

Returns the log system configuration.

Definition at line 225 of file Module.h.

225{return m_logConfig;}

◆ getModules()

std::list< ModulePtr > getModules ( ) const
inlineoverrideprivatevirtualinherited

no submodules, return empty list

Implements PathElement.

Definition at line 506 of file Module.h.

506{ return std::list<ModulePtr>(); }

◆ getName()

const std::string & getName ( ) const
inlineinherited

Returns the name of the module.

This can be changed via e.g. set_name() in the steering file to give more useful names if there is more than one module of the same type.

For identifying the type of a module, using getType() (or type() in Python) is recommended.

Definition at line 187 of file Module.h.

187{return m_name;}
std::string m_name
The name of the module, saved as a string (user-modifiable)
Definition: Module.h:508

◆ getPackage()

const std::string & getPackage ( ) const
inlineinherited

Returns the package this module is in.

Definition at line 197 of file Module.h.

197{return m_package;}

◆ getParamInfoListPython()

std::shared_ptr< boost::python::list > getParamInfoListPython ( ) const
inherited

Returns a python list of all parameters.

Each item in the list consists of the name of the parameter, a string describing its type, a python list of all default values and the description of the parameter.

Returns
A python list containing the parameters of this parameter list.

Definition at line 279 of file Module.cc.

280{
282}
std::shared_ptr< boost::python::list > getParamInfoListPython() const
Returns a python list of all parameters.
ModuleParamList m_moduleParamList
List storing and managing all parameter of the module.
Definition: Module.h:516

◆ getParamList()

const ModuleParamList & getParamList ( ) const
inlineinherited

Return module param list.

Definition at line 363 of file Module.h.

363{ return m_moduleParamList; }

◆ getPathString()

std::string getPathString ( ) const
overrideprivatevirtualinherited

return the module name.

Implements PathElement.

Definition at line 192 of file Module.cc.

193{
194
195 std::string output = getName();
196
197 for (const auto& condition : m_conditions) {
198 output += condition.getString();
199 }
200
201 return output;
202}

◆ getReturnValue()

int getReturnValue ( ) const
inlineinherited

Return the return value set by this module.

This value is only meaningful if hasReturnValue() is true

Definition at line 381 of file Module.h.

381{ return m_returnValue; }

◆ getTimeSec()

double getTimeSec ( )
protected

store time info.

Definition at line 460 of file Serializer.cc.

461{
462 struct timeval t;
463 gettimeofday(&t, NULL);
464 return (t.tv_sec + t.tv_usec * 1.e-6);
465}

◆ getType()

const std::string & getType ( ) const
inherited

Returns the type of the module (i.e.

class name minus 'Module')

Definition at line 41 of file Module.cc.

42{
43 if (m_type.empty())
44 B2FATAL("Module type not set for " << getName());
45 return m_type;
46}
std::string m_type
The type of the module, saved as a string.
Definition: Module.h:509

◆ hasCondition()

bool hasCondition ( ) const
inlineinherited

Returns true if at least one condition was set for the module.

Definition at line 311 of file Module.h.

311{ return not m_conditions.empty(); };

◆ hasProperties()

bool hasProperties ( unsigned int  propertyFlags) const
inherited

Returns true if all specified property flags are available in this module.

Parameters
propertyFlagsOred EModulePropFlags which should be compared with the module flags.

Definition at line 160 of file Module.cc.

161{
162 return (propertyFlags & m_propertyFlags) == propertyFlags;
163}

◆ hasReturnValue()

bool hasReturnValue ( ) const
inlineinherited

Return true if this module has a valid return value set.

Definition at line 378 of file Module.h.

378{ return m_hasReturnValue; }

◆ hasUnsetForcedParams()

bool hasUnsetForcedParams ( ) const
inherited

Returns true and prints error message if the module has unset parameters which the user has to set in the steering file.

Definition at line 166 of file Module.cc.

167{
169 std::string allMissing = "";
170 for (const auto& s : missing)
171 allMissing += s + " ";
172 if (!missing.empty())
173 B2ERROR("The following required parameters of Module '" << getName() << "' were not specified: " << allMissing <<
174 "\nPlease add them to your steering file.");
175 return !missing.empty();
176}
std::vector< std::string > getUnsetForcedParams() const
Returns list of unset parameters (if they are required to have a value.

◆ if_false()

void if_false ( const std::shared_ptr< Path > &  path,
EAfterConditionPath  afterConditionPath = EAfterConditionPath::c_End 
)
inherited

A simplified version to add a condition to the module.

Please note that successive calls of this function will add more than one condition to the module. If more than one condition results in true, only the last of them will be used.

Please be careful: Avoid creating cyclic paths, e.g. by linking a condition to a path which is processed before the path where this module is located in.

It is equivalent to the if_value() method, using the expression "<1". This method is meant to be used together with the setReturnValue(bool value) method.

Parameters
pathShared pointer to the Path which will be executed if the return value is false.
afterConditionPathWhat to do after executing 'path'.

Definition at line 85 of file Module.cc.

86{
87 if_value("<1", path, afterConditionPath);
88}

◆ if_true()

void if_true ( const std::shared_ptr< Path > &  path,
EAfterConditionPath  afterConditionPath = EAfterConditionPath::c_End 
)
inherited

A simplified version to set the condition of the module.

Please note that successive calls of this function will add more than one condition to the module. If more than one condition results in true, only the last of them will be used.

Please be careful: Avoid creating cyclic paths, e.g. by linking a condition to a path which is processed before the path where this module is located in.

It is equivalent to the if_value() method, using the expression ">=1". This method is meant to be used together with the setReturnValue(bool value) method.

Parameters
pathShared pointer to the Path which will be executed if the return value is true.
afterConditionPathWhat to do after executing 'path'.

Definition at line 90 of file Module.cc.

91{
92 if_value(">=1", path, afterConditionPath);
93}

◆ if_value()

void if_value ( const std::string &  expression,
const std::shared_ptr< Path > &  path,
EAfterConditionPath  afterConditionPath = EAfterConditionPath::c_End 
)
inherited

Add a condition to the module.

Please note that successive calls of this function will add more than one condition to the module. If more than one condition results in true, only the last of them will be used.

See https://xwiki.desy.de/xwiki/rest/p/a94f2 or ModuleCondition for a description of the syntax.

Please be careful: Avoid creating cyclic paths, e.g. by linking a condition to a path which is processed before the path where this module is located in.

Parameters
expressionThe expression of the condition.
pathShared pointer to the Path which will be executed if the condition is evaluated to true.
afterConditionPathWhat to do after executing 'path'.

Definition at line 79 of file Module.cc.

80{
81 m_conditions.emplace_back(expression, path, afterConditionPath);
82}

◆ initialize()

void initialize ( void  )
overridevirtual

Module functions to be called from main process.

Reimplemented from Module.

Definition at line 61 of file Serializer.cc.

62{
63 signal(SIGPIPE, SIG_IGN);
64
65#ifdef DUMMY
66 m_buffer = new int[ BUF_SIZE_WORD ];
67#endif
68
69
70 if (m_shmflag != 0) {
71 char temp_char1[100] = "/cpr_config";
72 char temp_char2[100] = "/cpr_status";
73 shmOpen(temp_char1, temp_char2);
74 // Status format : status_flag
77 m_cfg_sta[ 0 ] = 1; // Status bit is 1 : ready before accept()
78 }
79
80 // Create Message Handler
81 memset(time_array0, 0, sizeof(time_array0));
82 memset(time_array1, 0, sizeof(time_array1));
83 memset(time_array2, 0, sizeof(time_array2));
84
85 RunInfoBuffer& status(DeSerializerModule::getStatus());
86 if (status.isAvailable()) {
87 status.setOutputNBytes(0);
88 status.setOutputCount(0);
89 }
90
91 Accept();
92
93#ifdef NONSTOP
94 openRunPauseNshm();
95#endif
96
97 B2INFO("Tx initialized.");
98}
void shmOpen(char *path_cfg, char *path_sta)
open shared memory
Definition: Serializer.cc:136
int * shmGet(int fd, int size_words)
Get shared memory.
Definition: Serializer.cc:130
int m_shmfd_cfg
file descripter for shm
Definition: Serializer.h:82
int * m_cfg_buf
buffer for shared memory
Definition: Serializer.h:88
int m_shmfd_sta
file descripter for shm
Definition: Serializer.h:85
int * m_cfg_sta
buffer for shared memory
Definition: Serializer.h:91

◆ printData()

void printData ( int *  buf,
int  nwords 
)

print data contents

Definition at line 487 of file Serializer.cc.

488{
489 printf("[DEBUG]");
490 for (int i = 0; i < nwords; i++) {
491 printf("%.8x ", buf[ i ]);
492 if (i % 10 == 9) printf("\n[DEBUG]");
493 }
494 printf("\n[DEBUG]");
495 printf("\n");
496 return;
497}

◆ recordTime()

void recordTime ( int  event,
double *  array 
)
protected

store time info.

Definition at line 468 of file Serializer.cc.

469{
470 if (event >= 50000 && event < 50500) {
471 array[ event - 50000 ] = getTimeSec() - m_start_time;
472 }
473 return;
474}
void event() override
This method is the core of the module.
Definition: Serializer.cc:595

◆ Send()

int Send ( int  socket,
char *  buf,
int  size_bytes 
)

send buffer

Definition at line 322 of file Serializer.cc.

323{
324 int sent_bytes = 0;
325 while (true) {
326 int ret = 0;
327 if ((ret = send(socket, buf + sent_bytes, size_bytes - sent_bytes, MSG_NOSIGNAL)) < 0) {
328 if (errno == EINTR) {
329 continue;
330 } else if (errno == EAGAIN || errno == EWOULDBLOCK) {
331#ifdef NONSTOP
332 string err_str;
333 callCheckRunPause(err_str);
334#endif
335 continue;
336 } else {
337 char err_buf[500];
338 sprintf(err_buf, "[ERROR] Send Error. (%s) : %s %s %d", strerror(errno), __FILE__, __PRETTY_FUNCTION__, __LINE__);
339#ifdef NONSTOP
340 g_run_error = 1;
341 B2ERROR(err_buf);
342 string err_str = "RUN_ERROR";
343 throw (err_str);
344#else
345 print_err.PrintError(err_buf, __FILE__, __PRETTY_FUNCTION__, __LINE__);
346 exit(1);
347#endif
348 }
349 }
350 sent_bytes += ret;
351 if (sent_bytes == size_bytes) break;
352 }
353 return sent_bytes;
354}

◆ sendByWriteV()

int sendByWriteV ( RawDataBlock rawdblk)
virtual

Definition at line 222 of file Serializer.cc.

223{
224 SendHeader send_header;
225 SendTrailer send_trailer;
226 fillSendHeaderTrailer(&send_header, &send_trailer, rawdblk);
227
228 enum {
229 NUM_BUFFER = 3
230 };
231 struct iovec iov[ NUM_BUFFER ];
232
233 // check Body data size
234 int rawcopper_nwords = rawdblk->TotalBufNwords();
235
236 //Fill iov info.
237 iov[0].iov_base = (char*)send_header.GetBuffer();
238 iov[0].iov_len = sizeof(int) * send_header.GetHdrNwords();
239
240 iov[1].iov_base = (char*)rawdblk->GetWholeBuffer();
241 iov[1].iov_len = sizeof(int) * rawcopper_nwords;
242
243 iov[2].iov_base = (char*)send_trailer.GetBuffer();
244 iov[2].iov_len = sizeof(int) * send_trailer.GetTrlNwords();
245
246
247 // Send Multiple buffers
248 int n = 0;
249
250 while (true) {
251 if ((n = writev(m_socket, iov, NUM_BUFFER)) < 0) {
252 if (errno == EINTR) {
253 continue;
254 } else if (errno == EAGAIN || errno == EWOULDBLOCK) {
255
256#ifdef NONSTOP
257 // check run-pause request
258 string err_str;
259 callCheckRunPause(err_str);
260#endif
261 continue;
262 } else {
263 char err_buf[500];
264 sprintf(err_buf, "[WARNING] WRITEVa error.(%s) : sent %d bytes, header %lu bytes body %lu trailer %lu : %s %s %d\n",
265 strerror(errno), n, iov[0].iov_len, iov[1].iov_len, iov[2].iov_len,
266 __FILE__, __PRETTY_FUNCTION__, __LINE__);
267#ifdef NONSTOP
268 g_run_error = 1;
269 B2ERROR(err_buf);
270 string err_str = "RUN_ERROR";
271 throw (err_str); // Go to DeSerializer** and wait for run-resume.
272#else
273 print_err.PrintError(err_buf, __FILE__, __PRETTY_FUNCTION__, __LINE__);
274 exit(1);
275#endif
276 }
277 }
278 break;
279 }
280
281#ifdef DEBUG
282 printf("[DEBUG] *******BODY**********\n");
283 printf("[DEBUG] \n%.8d : ", 0);
284 printData((int*)(iov[1].iov_base), iov[1].iov_len);
285#endif
286
287
288 int total_send_bytes = sizeof(int) * send_header.GetTotalNwords();
289
290
291 //
292 // Retry sending
293 //
294 if (n != total_send_bytes) {
295 B2WARNING("Serializer: Sent byte(" << n << "bytes) is not same as the event size (" << total_send_bytes << "bytes). Retryring...");
296 double retry_start = getTimeSec();
297
298 // Send Header
299 if (n < (int)(iov[ 0 ].iov_len)) {
300 n += Send(m_socket, (char*)iov[ 0 ].iov_base + n, iov[ 0 ].iov_len - n);
301 }
302
303 if (n < (int)(iov[ 0 ].iov_len + iov[ 1 ].iov_len)) {
304 n += Send(m_socket, (char*)iov[ 1 ].iov_base + (n - iov[ 0 ].iov_len), iov[ 1 ].iov_len - (n - iov[ 0 ].iov_len));
305 }
306
307 if (n < (int)(iov[ 0 ].iov_len + iov[ 1 ].iov_len + iov[ 2 ].iov_len)) {
308 n += Send(m_socket, (char*)iov[ 2 ].iov_base + (n - iov[ 0 ].iov_len - iov[ 1 ].iov_len),
309 iov[ 2 ].iov_len - (n - iov[ 0 ].iov_len - iov[ 1 ].iov_len));
310 }
311
312 double retry_end = getTimeSec();
313 B2WARNING("Resending ends. It takes " << retry_end - retry_start << "(s)");
314 }
315
316 return total_send_bytes;
317
318}
virtual int * GetWholeBuffer()
get pointer to buffer(m_buffer)
Definition: RawDataBlock.h:60
int * GetBuffer(void)
Get Header contents.
Definition: SendHeader.cc:32
int Send(int socket, char *buf, int size_bytes)
send buffer
Definition: Serializer.cc:322

◆ setAbortLevel()

void setAbortLevel ( int  abortLevel)
inherited

Configure the abort log level.

Definition at line 67 of file Module.cc.

68{
69 m_logConfig.setAbortLevel(static_cast<LogConfig::ELogLevel>(abortLevel));
70}
ELogLevel
Definition of the supported log levels.
Definition: LogConfig.h:26
void setAbortLevel(ELogLevel abortLevel)
Configure the abort level.
Definition: LogConfig.h:112

◆ setDebugLevel()

void setDebugLevel ( int  debugLevel)
inherited

Configure the debug messaging level.

Definition at line 61 of file Module.cc.

62{
63 m_logConfig.setDebugLevel(debugLevel);
64}
void setDebugLevel(int debugLevel)
Configure the debug messaging level.
Definition: LogConfig.h:98

◆ setDescription()

void setDescription ( const std::string &  description)
protectedinherited

Sets the description of the module.

Parameters
descriptionA description of the module.

Definition at line 214 of file Module.cc.

215{
216 m_description = description;
217}

◆ setLogConfig()

void setLogConfig ( const LogConfig logConfig)
inlineinherited

Set the log system configuration.

Definition at line 230 of file Module.h.

230{m_logConfig = logConfig;}

◆ setLogInfo()

void setLogInfo ( int  logLevel,
unsigned int  logInfo 
)
inherited

Configure the printed log information for the given level.

Parameters
logLevelThe log level (one of LogConfig::ELogLevel)
logInfoWhat kind of info should be printed? ORed combination of LogConfig::ELogInfo flags.

Definition at line 73 of file Module.cc.

74{
75 m_logConfig.setLogInfo(static_cast<LogConfig::ELogLevel>(logLevel), logInfo);
76}
void setLogInfo(ELogLevel logLevel, unsigned int logInfo)
Configure the printed log information for the given level.
Definition: LogConfig.h:127

◆ setLogLevel()

void setLogLevel ( int  logLevel)
inherited

Configure the log level.

Definition at line 55 of file Module.cc.

56{
57 m_logConfig.setLogLevel(static_cast<LogConfig::ELogLevel>(logLevel));
58}
void setLogLevel(ELogLevel logLevel)
Configure the log level.
Definition: LogConfig.cc:25

◆ setName()

void setName ( const std::string &  name)
inlineinherited

Set the name of the module.

Note
The module name is set when using the REG_MODULE macro, but the module can be renamed before calling process() using the set_name() function in your steering file.
Parameters
nameThe name of the module

Definition at line 214 of file Module.h.

214{ m_name = name; };

◆ setParamList()

void setParamList ( const ModuleParamList params)
inlineprotectedinherited

Replace existing parameter list.

Definition at line 501 of file Module.h.

501{ m_moduleParamList = params; }

◆ setParamPython()

void setParamPython ( const std::string &  name,
const boost::python::object &  pyObj 
)
privateinherited

Implements a method for setting boost::python objects.

The method supports the following types: list, dict, int, double, string, bool The conversion of the python object to the C++ type and the final storage of the parameter value is done in the ModuleParam class.

Parameters
nameThe unique name of the parameter.
pyObjThe object which should be converted and stored as the parameter value.

Definition at line 234 of file Module.cc.

235{
236 LogSystem& logSystem = LogSystem::Instance();
237 logSystem.updateModule(&(getLogConfig()), getName());
238 try {
240 } catch (std::runtime_error& e) {
241 throw std::runtime_error("Cannot set parameter '" + name + "' for module '"
242 + m_name + "': " + e.what());
243 }
244
245 logSystem.updateModule(nullptr);
246}
Class for logging debug, info and error messages.
Definition: LogSystem.h:46
void updateModule(const LogConfig *moduleLogConfig=nullptr, const std::string &moduleName="")
Sets the log configuration to the given module log configuration and sets the module name This method...
Definition: LogSystem.h:191
static LogSystem & Instance()
Static method to get a reference to the LogSystem instance.
Definition: LogSystem.cc:31
void setParamPython(const std::string &name, const PythonObject &pyObj)
Implements a method for setting boost::python objects.

◆ setParamPythonDict()

void setParamPythonDict ( const boost::python::dict &  dictionary)
privateinherited

Implements a method for reading the parameter values from a boost::python dictionary.

The key of the dictionary has to be the name of the parameter and the value has to be of one of the supported parameter types.

Parameters
dictionaryThe python dictionary from which the parameter values are read.

Definition at line 249 of file Module.cc.

250{
251
252 LogSystem& logSystem = LogSystem::Instance();
253 logSystem.updateModule(&(getLogConfig()), getName());
254
255 boost::python::list dictKeys = dictionary.keys();
256 int nKey = boost::python::len(dictKeys);
257
258 //Loop over all keys in the dictionary
259 for (int iKey = 0; iKey < nKey; ++iKey) {
260 boost::python::object currKey = dictKeys[iKey];
261 boost::python::extract<std::string> keyProxy(currKey);
262
263 if (keyProxy.check()) {
264 const boost::python::object& currValue = dictionary[currKey];
265 setParamPython(keyProxy, currValue);
266 } else {
267 B2ERROR("Setting the module parameters from a python dictionary: invalid key in dictionary!");
268 }
269 }
270
271 logSystem.updateModule(nullptr);
272}
void setParamPython(const std::string &name, const boost::python::object &pyObj)
Implements a method for setting boost::python objects.
Definition: Module.cc:234

◆ setPropertyFlags()

void setPropertyFlags ( unsigned int  propertyFlags)
inherited

Sets the flags for the module properties.

Parameters
propertyFlagsbitwise OR of EModulePropFlags

Definition at line 208 of file Module.cc.

209{
210 m_propertyFlags = propertyFlags;
211}

◆ setReturnValue() [1/2]

void setReturnValue ( bool  value)
protectedinherited

Sets the return value for this module as bool.

The bool value is saved as an integer with the convention 1 meaning true and 0 meaning false. The value can be used in the steering file to divide the analysis chain into several paths.

Parameters
valueThe value of the return value.

Definition at line 227 of file Module.cc.

228{
229 m_hasReturnValue = true;
230 m_returnValue = value;
231}

◆ setReturnValue() [2/2]

void setReturnValue ( int  value)
protectedinherited

Sets the return value for this module as integer.

The value can be used in the steering file to divide the analysis chain into several paths.

Parameters
valueThe value of the return value.

Definition at line 220 of file Module.cc.

221{
222 m_hasReturnValue = true;
223 m_returnValue = value;
224}

◆ setType()

void setType ( const std::string &  type)
protectedinherited

Set the module type.

Only for use by internal modules (which don't use the normal REG_MODULE mechanism).

Definition at line 48 of file Module.cc.

49{
50 if (!m_type.empty())
51 B2FATAL("Trying to change module type from " << m_type << " is not allowed, the value is assumed to be fixed.");
52 m_type = type;
53}

◆ shmGet()

int * shmGet ( int  fd,
int  size_words 
)

Get shared memory.

Definition at line 130 of file Serializer.cc.

131{
132 int offset = 0;
133 return (int*)mmap(NULL, size_words * sizeof(int), PROT_READ | PROT_WRITE, MAP_SHARED, fd, offset);
134}

◆ shmOpen()

void shmOpen ( char *  path_cfg,
char *  path_sta 
)

open shared memory

Definition at line 136 of file Serializer.cc.

137{
138 errno = 0;
139 m_shmfd_cfg = shm_open(path_cfg, O_RDWR, 0666);
140 if (m_shmfd_cfg < 0) {
141 char err_buf[500];
142 sprintf(err_buf, "[FATAL] Failed to shm_open (%s). Exiting... : path %s\n",
143 strerror(errno), path_cfg);
144 print_err.PrintError(err_buf, __FILE__, __PRETTY_FUNCTION__, __LINE__);
145 sleep(1234567);
146 exit(1);
147 }
148
149 m_shmfd_sta = shm_open(path_sta, O_RDWR, 0666);
150 if (m_shmfd_sta < 0) {
151 char err_buf[500];
152 sprintf(err_buf, "[FATAL] Failed to shm_open (%s). Exiting... : path %s\n",
153 strerror(errno), path_sta);
154 print_err.PrintError(err_buf, __FILE__, __PRETTY_FUNCTION__, __LINE__);
155 sleep(1234567);
156 exit(1);
157 }
158
159 int size = 4 * sizeof(int);
160 ftruncate(m_shmfd_cfg, size);
161 ftruncate(m_shmfd_sta, size);
162}

◆ terminate()

void terminate ( void  )
overridevirtual

This method is called at the end of the event processing.

This method is called only once after the event processing finished. Use this method for cleaning up, closing files, etc.

This method can be implemented by subclasses.

Reimplemented from Module.

Definition at line 117 of file Serializer.cc.

118{
119 B2INFO("terminate called");
120}

Member Data Documentation

◆ BUF_SIZE_WORD

int BUF_SIZE_WORD
protected

size of buffer for one event (word)

Definition at line 102 of file Serializer.h.

◆ m_buffer

int* m_buffer
protected

Definition at line 110 of file Serializer.h.

◆ m_cfg_buf

int* m_cfg_buf

buffer for shared memory

Definition at line 88 of file Serializer.h.

◆ m_cfg_sta

int* m_cfg_sta

buffer for shared memory

Definition at line 91 of file Serializer.h.

◆ m_compressionLevel

int m_compressionLevel
protected

Compression parameter.

Definition at line 105 of file Serializer.h.

◆ m_conditions

std::vector<ModuleCondition> m_conditions
privateinherited

Module condition, only non-null if set.

Definition at line 521 of file Module.h.

◆ m_description

std::string m_description
privateinherited

The description of the module.

Definition at line 511 of file Module.h.

◆ m_hasReturnValue

bool m_hasReturnValue
privateinherited

True, if the return value is set.

Definition at line 518 of file Module.h.

◆ m_hostname_local

std::string m_hostname_local
protected

Destination Host.

Definition at line 115 of file Serializer.h.

◆ m_logConfig

LogConfig m_logConfig
privateinherited

The log system configuration of the module.

Definition at line 514 of file Module.h.

◆ m_moduleParamList

ModuleParamList m_moduleParamList
privateinherited

List storing and managing all parameter of the module.

Definition at line 516 of file Module.h.

◆ m_name

std::string m_name
privateinherited

The name of the module, saved as a string (user-modifiable)

Definition at line 508 of file Module.h.

◆ m_package

std::string m_package
privateinherited

Package this module is found in (may be empty).

Definition at line 510 of file Module.h.

◆ m_port_to

int m_port_to
protected

Destination port.

Definition at line 118 of file Serializer.h.

◆ m_prev_nevt

unsigned int m_prev_nevt
protected

Definition at line 130 of file Serializer.h.

◆ m_prev_time

double m_prev_time
protected

Definition at line 128 of file Serializer.h.

◆ m_prev_totbytes

double m_prev_totbytes
protected

Definition at line 132 of file Serializer.h.

◆ m_propertyFlags

unsigned int m_propertyFlags
privateinherited

The properties of the module as bitwise or (with |) of EModulePropFlags.

Definition at line 512 of file Module.h.

◆ m_returnValue

int m_returnValue
privateinherited

The return value.

Definition at line 519 of file Module.h.

◆ m_shmfd_cfg

int m_shmfd_cfg

file descripter for shm

Definition at line 82 of file Serializer.h.

◆ m_shmfd_sta

int m_shmfd_sta

file descripter for shm

Definition at line 85 of file Serializer.h.

◆ m_shmflag

int m_shmflag

Use shared memory.

Definition at line 64 of file Serializer.h.

◆ m_sock

EvtSocketSend* m_sock
protected

EvtSocket.

Definition at line 124 of file Serializer.h.

◆ m_socket

int m_socket
protected

Socket ID.

Definition at line 121 of file Serializer.h.

◆ m_start_flag

int m_start_flag
protected

start flag

Definition at line 155 of file Serializer.h.

◆ m_start_time

double m_start_time
protected

Definition at line 126 of file Serializer.h.

◆ m_totbytes

unsigned long long m_totbytes
protected

sent data size

Definition at line 152 of file Serializer.h.

◆ m_type

std::string m_type
privateinherited

The type of the module, saved as a string.

Definition at line 509 of file Module.h.

◆ n_basf2evt

int n_basf2evt
protected

No. of sent events.

Definition at line 108 of file Serializer.h.

◆ p_method

std::string p_method
protected

How to handle data.

Definition at line 139 of file Serializer.h.

◆ p_method_val

int p_method_val
protected

Definition at line 140 of file Serializer.h.

◆ print_err

CprErrorMessage print_err
protected

error message program

Definition at line 149 of file Serializer.h.

◆ time_array0

double time_array0[1000]
protected

Definition at line 134 of file Serializer.h.

◆ time_array1

double time_array1[1000]
protected

Definition at line 135 of file Serializer.h.

◆ time_array2

double time_array2[1000]
protected

Definition at line 136 of file Serializer.h.

◆ tmp_header

RawHeader_latest tmp_header
protected

which format is used

Definition at line 176 of file Serializer.h.


The documentation for this class was generated from the following files: