Log of /trunk/proof/proof/inc/TProofOutputFile.h
Parent Directory
Revision
45367 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Fri Aug 3 09:22:00 2012 UTC (2 years, 5 months ago) by
ganis
File length: 6119 byte(s)
Diff to
previous 45283
In TProofOutputFile, add a status bit to indicate that the file is the result of the automatic
save-to-file output handling. This allows a better interplay between client-side and server-side
settings.
In TProof::HandleOutputOptions, fix issue with local object saving.
Revision
45283 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Mon Jul 30 10:42:38 2012 UTC (2 years, 5 months ago) by
ganis
File length: 5952 byte(s)
Copied from:
trunk/proof/proofplayer/inc/TProofOutputFile.h revision 45216
Diff to
previous 43251
Patch automatizing the usage of the file-based technology to handle outputs.
After this patch PROOF users can define as an option to Process an output file for their results
and choose if the merging goes via file or in memory. User can also decide to save theit results
in a set of files identified by a name (dataset).
Administrators can force merging-via-file or can make it conditional to the resident memory exceeding
a given threshold.
The new options are documented at
http://root.cern.ch/drupal/content/handling-outputs
Since TProofOutputFile is now used by TProof, the class has been moved from proof/proofplayer
(libProofPlayer) to proof/proof (libProof).
The selector tutorials/proof/ProofSimple.h,.C has been modified to allo testing the new options,
and a new test has been added to stressProof.
Revision
30648 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Fri Oct 9 12:51:35 2009 UTC (5 years, 3 months ago) by
ganis
Original Path:
trunk/proof/proofplayer/inc/TProofOutputFile.h
File length: 4933 byte(s)
Diff to
previous 30174
Fix a few issues reported by ALICE:
- Do not drop anchors and options from the file path, if any
- In dataset mode, also add an URL with the redirector in TFileInfos when the
redirector URL is available (rootrc variable ProofServ.PoolUrl). This is needed
by the logic of the dataset stager daemon.
The elements of the datasets created this way will therefore have three URLs:
1. The URL pointing to the data server on the machine
2. The same URL but with the redirector protocol, user, host and port
3. The special 'file:' URL with the local path on the machine used for cleaning
Revision
30174 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Tue Sep 15 14:24:56 2009 UTC (5 years, 4 months ago) by
ganis
Original Path:
trunk/proof/proofplayer/inc/TProofOutputFile.h
File length: 4762 byte(s)
Diff to
previous 29650
Patch to support automatic creation of a dataset out of files created on the
worker nodes by worker processes. The implementation is an extension of the
functionality of the class TProofOutputFile used for merging via file.
TProofOutputFile:
- Add options to steer the creation of a dataset; the extemded meaning of the
constructor arguments and anew constructor are described in
http://root.cern.ch/drupal/content/handling-large-outputs-root-files
The dataset (i.e. TFileCollection) assembing happens on the master via the
Merge method. Information about the node location of the file is happended
to the relevant TFileInfo as a special "file:" url with option "node=<host-fqdn>:<port>"
This information is needed to facilitate the cleaning of the files once they
are not needed anymore.
The dataset can be just created and returned in the output list, or registered
and/or verified.
TProofPlayerRemote::MergeOutputFiles:
- Correctly transmit the dataset object into the output list
TProofServ:
- Create the new subdirectory 'data' either in the sandbox or followinf ProofServ.DataDir .
- Register and verify the created dataset if required
TProof:
- Implement two new methods:
- ShowData(), to show the content of the assigned 'data' directory
- ClearData(UInt_t what, const char *dsname), to clear all or a subset of the files
in the assigned 'data' directory
Additional changes:
- TProofPlayer:
- Correctly handle the feedback canvas
- Set the drawing attributes
- TProofServ:
- Replace all 'Form("...")' with TString::Format("...") .
- Use the new tag kCollect in debug statements where relevant
- TProof:
- Use the new tag kCollect in debug statements where relevant
Revision
29491 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Thu Jul 16 15:12:51 2009 UTC (5 years, 6 months ago) by
ganis
Original Path:
trunk/proof/proofplayer/inc/TProofOutputFile.h
File length: 3464 byte(s)
Diff to
previous 25949
Fix several issues in TProofOutputFile:
- Remove the 'mode' parameter as the 'SEQUENTIAL' mode was not really an option
for the cases when this merging technique is needed
- Fix a problem with the determination of the fDir member; this problem affects
mostly PROOF-Lite and it appeared after the change #25949 .
- Make sure the the local server information is correctly included in AdoptFile()
- Fix a serious issue with the 'CENTRAL' mode whose net effect was to delete the
outputfile just after having open it
In TProofPlayer and XrdProofdProofServMgr
- Cope with the changes in TProofOutputFile
Revision
25949 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Fri Oct 24 18:03:49 2008 UTC (6 years, 3 months ago) by
ganis
Original Path:
trunk/proof/proofplayer/inc/TProofOutputFile.h
File length: 3596 byte(s)
Diff to
previous 25875
Add possibility to adopt a file already open. Instead of opening the unique file via
TFile *TProofOutputFile::OpenFile(const char *mode) one can open do
TFile *f = TFile::Open("<file>", "<mode>")
TProofOutputFile *outputfile = new TProofOutputFile("analysis");
outputfile->AdoptFile(f);
fOutput->Add(outputfile);
This is useful in cases one wants to merge files open in other places.
Revision
20307 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Thu Oct 11 10:58:50 2007 UTC (7 years, 3 months ago) by
ganis
Original Path:
trunk/proofplayer/inc/TProofFile.h
File length: 3072 byte(s)
Copied from:
branches/dev/proof/proofplayer/inc/TProofFile.h revision 20306
Diff to
previous 20296
Import branches/dev/proof r20306
Summary (see branch logs for more details):
- Set of changes related to CPU quota control including
- broadcast of centrally determined priorities
- mechanism to renice processes in a quantitative way
- New packetizer for non-tree based analysis and related API in TProof (from L. Tran-Thanh)
- Support for merging output objects saved in files on the workers (from L. Tran-Thanh and me)
- Improve version binary compatibility checks using also the SVN revision number
(when available) to define the running version.
- Extend the version binary compatibility checks also to the cached selector binaries.
- Extend TDSet::Lookup so that in case of missing files, it can remove them from the
dataset (option removeMissing must be set).
- Move the data set lookup to the TProofPlayerRemote::Process.
- Handle properly the case of incomple datasets: if the file is not found in the lookup
don't try to validate it; add it, instead, to a 'missingFiles' list returned in the
output list (fixing bug #28800 in Savannah).
This form allows you to request diffs between any two revisions of this file.
For each of the two "sides" of the diff,
enter a numeric revision.
