[root] Log of /trunk/proof/proof/src/TSlaveLite.cxx

Revision 44683 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Thu Jun 14 09:27:40 2012 UTC (2 years, 7 months ago) by ganis
File length: 6378 byte(s)
Diff to previous 37976

   First version of the final patch enabling multi-workers on single node using
   PROOF-Lite. This is supposed to improved scalability for large number of workers
   (>300-400) and is currently available only for non-data driven tasks.
   The new setup configuration is enabled by the directive 'xpd.remoteplite 1' in
   the xproofd configuration file.

Revision 37976 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Fri Feb 4 11:43:16 2011 UTC (3 years, 11 months ago) by ganis
File length: 6369 byte(s)
Diff to previous 31598

  In TProofLite::Load
  - Extend to this overload support for a comma-separated list of macros (cfr #37942) 
  In TSlave and related classes
  - Add member for the unique session tag
  - Fix worker name in TSlaveLite

Revision 31598 - (view) (download) (as text) (annotate) - [select for diffs]
Modified Mon Dec 7 15:21:47 2009 UTC (5 years, 1 month ago) by rdm
File length: 6193 byte(s)
Diff to previous 27186

From Gerri:
Fix a few pending issues in PROOF-Lite:
  - Source the env file before running 'proofserv'; this allows to run valgrind
    or other wrapper scripts (e.g. experiment-specific environment initializers)
    before proofserv, as in normal PROOF
  - Fix a problem with Load()
  - Add the possibility for the administrator to control the number of workers
    for PROOF-Lite or eventually to forbid the use of it (request on the forum).
    The rootrc variable ProofLite.MaxWorkers is read out of /etc/system.rootrc
    and cannot be overwritten by users.

Improve handling of Ctrl-C:
  - Fix a problem in TMonitor affecting the effectiveness of interrupts.
  - Do not send the results from workers to masters if the query has been
    aborted.

Miscellanea:
  - Make sure that the size of the cache sent back to the packetizer by the
    workers is meaningful in case the defaults are used (i.e. not -1).
  - Make the current processed element available to selectors via the
    input list; this allows to write a more simple and effective packetizers
    for tasks where the entry is a file (e.g., dataset generation in the
    benchmark suite).

Revision 25918 - (view) (download) (as text) (annotate) - [select for diffs]
Added Wed Oct 22 15:00:04 2008 UTC (6 years, 3 months ago) by ganis
File length: 5882 byte(s)

   First version of PROOFLite, a 2-tier realization of PROOF intended for multi-core
   machines. In PROOFLite the client start directly the workers; no daemon is required.

   Currently this works on Unix only. Some issues with the internal connection still need
   to be sorted out on Windows.

   To start a session just use

            TProof::Open("")  or TProof::Open("lite")

   From there on everything should be as in normal PROOF. To start a standard PROOF
   session (i.e. via daemons) on the localhost use TProof::Open("localhost").
   (The default meaning of "" in TProof::Open() is controlled via the rc value
    'Proof.LocalDefault').

   To run stressProof with PROOFLite pas the argument 'lite':

            ./stressProof lite

   By default, PROOFLite sets the number of workers equal to the number of cores.
   The number of workers is controlled by the rc variable 'ProofLite.Workers'; it can
   also be set on the fly with the option "workers=<n>", e.g. TProof::Open("lite?workers=2").

   This patch also introduces the rc variable 'Proof.Sandbox' to control the local location
   of the sandboxes. The default has been changed from "~/proof" to "~/.proof" to avoid
   interferences with possible users' working areas. The sandbox contains the directory
   'packages' (with the clients packages; used by standard PROOF and PROOF Lite),
   and some directories used only by PROOFLite: 'cache' (binary cache) and 'datasets' with 
   the datasets. The location of these directories is controlled by the rc variables
   'Proof.PackageDir', 'Proof.CacheDir' and 'Proof.DataSetDir'.
   The working directory for PROOFLite is in the form workdir=<sandbox>/path-to-current-dir where
   ~/path/to/current/dir is the directory from where the session in launched. The directory
   <workdir> contains the session working dirs (in the form 'session-<host>-<time>-<pid>'),
   with the symlink 'last-lite-session' pointing to the last started session, and the 'queries'
   directory, with the results of queries started from the current directory.

This form allows you to request diffs between any two revisions of this file. For each of the two "sides" of the diff, enter a numeric revision.

Links to HEAD:	(view) (download) (as text) (annotate)
Sticky Revision: