[root] Log of /trunk/proof/proofplayer/src/TPacketizerFile.cxx

Revision 48992 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Thu Mar 28 15:26:26 2013 UTC (21 months, 3 weeks ago) by rdm
File length: 16767 byte(s)
Diff to previous 44010

From Lifeng Sun:
The attached patchset fixes a bunch of typo in the source:
0001-succes-success.patch
0002-preceed-preced.patch
0003-informations-information.patch
0004-childs-children.patch
0005-avaliable-available.patch
0006-writeable-writable.patch
0007-comand-command.patch
0008-unkown-unknown.patch
0009-wierd-weird.patch
0010-wheter-whether.patch
0011-unecessary-unnecessary.patch
0012-splitted-split.patch
0013-registerd-registered.patch
0014-recieve-receive.patch
0015-processsing-processing.patch
0016-ouput-output.patch
0017-mutiple-multiple.patch
0018-lenght-length.patch
0019-interupted-interrupted.patch
0020-independant-independent.patch
0021-inconsistant-inconsistent.patch
0022-expresion-expression.patch
0023-explicitely-explicitly.patch
0024-enviroment-environment.patch
0025-deafult-default.patch
0026-continous-continuous.patch
0027-completly-completely.patch
0028-commited-committed.patch
0029-choosen-chosen.patch
0030-backgroud-background.patch
0031-auxilliary-auxiliary.patch
0032-authentification-authentication.patch
0033-appropiate-appropriate.patch
0034-an-other-another.patch
0035-environement-environment.patch
0036-targetting-targeting.patch
0037-suppported-supported.patch
0038-paramater-parameter.patch

Revision 44010 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Sun Apr 29 23:07:48 2012 UTC (2 years, 8 months ago) by ganis
File length: 16768 byte(s)
Diff to previous 42882

  Several optimizations in the low level PROOF event loop (TProofPlayer::Process):
  - Per-event calls to TEventIter::GetNextEvent are replaced by per-packet calls
    to a new function TEventIter::GetNextPacket and a for loop over the returned
    range;
  - Progress information is filled in on per-packet pace just before asking for
    a new packet, instead of being filled for each event;
  - In TProofProgressStatus, the relevant setters in were inlined, and the (expensive)
    calls to SetLastUpdate() reduced to the minimum required;
  - Status of objects is checked using bits instead of functions calls;
  - Check whether to dump memory info is done before calling CheckMemUsage.
  These optimizations allow to reduce dramatically the overhead introduced by the
  operations PROOF needs to perform during the event loop. A measurement of the
  overhead can be obtained from a very light computational task, for example,
  generating one random number and filling one histogram; executing this task
  within a PROOF-Lite session with 1 worker now takes only 1.8 times the time
  required by a straight loop in the parent ROOT session; the same number before
  was about 13. 

  The patch also introduces a couple of small changes enabling the use of
  TProofPlayerLocal to process selectors in the local session using the PROOF
  iteration mechanism; this is very useful for optimizations studies.

  Finally, a couple of missing protections were added in TProofPlayer.

Revision 42882 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Mon Feb 6 11:10:21 2012 UTC (2 years, 11 months ago) by ganis
File length: 16678 byte(s)
Diff to previous 39152


    From Sangsu Ryu and me.
    Add support for paralell dataset verification. This is implemented via a dedicated
    TSelector (TSelVerifyDataSet) which is run over the list of files in the dataset via
    TPacketizerFile. The file order is preserved using the recently introduced index in
    TFileInfo.
    Parallel verification is the now the default. For test and comparison purposes it is
    still possible to verify datasets serially by specifying 'S' in the option field of
    VerifyDataSet and RegisterDataSet .

    To avoid/reduce code duplication some of the static functions in TDataSetManager have
    refactorized. The overall behavior should be unchanged.

Revision 39152 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Tue May 10 10:14:41 2011 UTC (3 years, 8 months ago) by ganis
File length: 16137 byte(s)
Diff to previous 37968

  - In TPacketizerFile, make sure that key names use always the host FQDN; improves
    solidity of the match.
  - In TVirtualPacketizer, stop and destroy the progress timer when processing is done.

Revision 36876 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Tue Nov 23 11:45:47 2010 UTC (4 years, 2 months ago) by ganis
File length: 15607 byte(s)
Diff to previous 35967

  In TPacketizerFile:
  - Extend flexibility of the input map content by adding support for lists of TFileInfo, maps of
    TFileCollections and urls as key valus; this allows to run directly on the output of
    TFileCollection::GetFilesPerServer.
  - Add option to not process the files not assigned to any worker; this allows to write selectors
    to perform a given action only on files local to workers.

Revision 33642 - (view) (download) (as text) (annotate) - [select for diffs]
Added Fri May 28 14:12:11 2010 UTC (4 years, 7 months ago) by ganis
File length: 14041 byte(s)

   Add new packetizer TPacketizerFile generating packets which contain a single file path
   to be used in processing single files. Used, for example, in tasks generating files,
   like in the forthcoming PROOF bench or the "friends" tutorial.
   The files are specified into a TMap - named 'PROOF_FilesToProcess' - containing the list
   of files to be generated per host (the key is the host name, the value the TList of
   TObjString with the files names).
   Workers are first assigned files belonging to the list with host name matching the worker
   name.
   The map is distributed to the master via the input list.

This form allows you to request diffs between any two revisions of this file. For each of the two "sides" of the diff, enter a numeric revision.

Links to HEAD:	(view) (download) (as text) (annotate)
Sticky Revision: