class TPacketizer: public TVirtualPacketizer
TPacketizer This class generates packets to be processed on PROOF worker servers. A packet is an event range (begin entry and number of entries) or object range (first object and number of objects) in a TTree (entries) or a directory (objects) in a file. Packets are generated taking into account the performance of the remote machine, the time it took to process a previous packet on the remote machine, the locality of the database files, etc.
Function Members (Methods)
public:
protected:
| virtual void | TObject::DoError(int level, const char* location, const char* fmt, va_list va) const |
| Long64_t | TVirtualPacketizer::GetEntries(Bool_t tree, TDSetElement* e) |
| void | TObject::MakeZombie() |
private:
| TPacketizer() | |
| TPacketizer(const TPacketizer&) | |
| TPacketizer::TFileStat* | GetNextActive() |
| TPacketizer::TFileStat* | GetNextUnAlloc(TPacketizer::TFileNode* node = 0) |
| TPacketizer::TFileNode* | NextActiveNode() |
| TPacketizer::TFileNode* | NextUnAllocNode() |
| void | operator=(const TPacketizer&) |
| void | RemoveActive(TPacketizer::TFileStat* file) |
| void | RemoveActiveNode(TPacketizer::TFileNode*) |
| void | RemoveUnAllocNode(TPacketizer::TFileNode*) |
| void | Reset() |
| void | ValidateFiles(TDSet* dset, TList* slaves) |
Data Members
private:
| enum TVirtualPacketizer::EUseEstOpt { | kEstOff | |
| kEstCurrent | ||
| kEstAverage | ||
| }; | ||
| enum TVirtualPacketizer::EStatusBits { | kIsInitializing | |
| kIsDone | ||
| }; | ||
| enum TObject::EStatusBits { | kCanDelete | |
| kMustCleanup | ||
| kObjInCanvas | ||
| kIsReferenced | ||
| kHasUUID | ||
| kCannotPick | ||
| kNoContextMenu | ||
| kInvalidObject | ||
| }; | ||
| enum TObject::[unnamed] { | kIsOnHeap | |
| kNotDeleted | ||
| kZombie | ||
| kBitMask | ||
| kSingleKey | ||
| kOverwrite | ||
| kWriteDelete | ||
| }; |
protected:
| Bool_t | TVirtualPacketizer::fStop | Termination of Process() requested? |
| Bool_t | TVirtualPacketizer::fValid | Constructed properly? |
private:
| TList* | fActive | nodes with unfinished files |
| TList* | fFileNodes | nodes with files |
| Int_t | fMaxPerfIdx | maximum of our slaves' performance index |
| Long_t | fMaxSlaveCnt | maximum number of workers per filenode (Long_t to avoid |
| Int_t | fPacketAsAFraction | used to calculate the packet size |
| Long64_t | fPacketSize | global base packet size |
| TList* | fPackets | all processed packets |
| TMap* | fSlaveStats | slave status, keyed by correspondig TSlave |
| TList* | fUnAllocated | nodes with unallocated files |
Class Charts
Function documentation
TPacketizer(TDSet* dset, TList* slaves, Long64_t first, Long64_t num, TList* input, TProofProgressStatus* st)
Constructor
void ValidateFiles(TDSet* dset, TList* slaves)
Check existence of file/dir/tree an get number of entries. Assumes the files have been setup.
TPacketizer()
fPacketSize = fTotalEntries / (fPacketAsAFraction * nslaves) fPacketAsAFraction can be interpreted as follows: assuming all slaves have equal processing rate, packet size is (#events processed by 1 slave) / fPacketSizeAsAFraction. It can be set with PROOF_PacketAsAFraction in input list.
TPacketizer(const TPacketizer& )
void operator=(const TPacketizer& )
TFileNode * NextUnAllocNode()
TFileNode * NextActiveNode()
TFileStat * GetNextUnAlloc(TPacketizer::TFileNode* node = 0)
TFileStat * GetNextActive()