Log of /trunk/net/netx/src/TXNetSystem.cxx
Parent Directory
Revision
48060 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Sat Dec 15 18:53:16 2012 UTC (2 years, 1 month ago) by
ganis
File length: 24600 byte(s)
Diff to
previous 44408
From Dario: patch introducing an improved dataset management model where the PROOF (ROOT)
dataset manager is a light frontend to the experiment file catalogs; TDataSetManagerFile
is still used as local cache of the experiment information or to store the work-in-progress
status of the dataset manager daemon. This model is expected to solve the scalability issues
observed currently at AAFs.
The patch includes the new class TDataSetManagerAliEn with the first concrete implementation
of experiment catallog interface. The equivalent for ATLAS will follow.
Revision
43295 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Thu Mar 8 15:01:08 2012 UTC (2 years, 10 months ago) by
ganis
File length: 24540 byte(s)
Diff to
previous 41550
- Re-arrage usage of xrootd-related entities in such a way that internal headers are
not needed by 'netx' headers
- Remove external support for very old xrootd versions (older than 4 years)
Revision
36055 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Mon Oct 4 12:55:19 2010 UTC (4 years, 3 months ago) by
ganis
File length: 25015 byte(s)
Diff to
previous 35126
In TXNetSystem::GetPathInfo, save the effective endpoint path in the new field FileStat_t::fUrl.
This allows to shortcut two calls (GetPathInfo+Locate) in one during dataset validation.
Revision
30844 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Fri Oct 23 12:09:31 2009 UTC (5 years, 3 months ago) by
ganis
File length: 24691 byte(s)
Diff to
previous 30361
Implement TXNetSystem::IsOnline via GetPathInfo instead of a call to
XrdClientAdmin::SysStatX with vector size 1. This is more efficient
for one file and allows to circumvent a problem with the xrootd dCache
door.
Revision
30361 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Tue Sep 22 16:21:03 2009 UTC (5 years, 4 months ago) by
rdm
File length: 25499 byte(s)
Diff to
previous 30170
From Gerri:
don't block when trying to open a connection to an (x)rootd which is down
(you do not want fault tolerance for admin operations ...)
Revision
30170 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Tue Sep 15 13:35:35 2009 UTC (5 years, 4 months ago) by
rdm
File length: 25169 byte(s)
Diff to
previous 23091
From Gerri:
Fixes for path locality checks:
- Retrieve the correct local file name (inclusive of prefix) in TFile::Open()
- Allow for protocol-driven implementations of TSystem::IsPathLocal()
- Implement TXNetSystem::IsPathLocal() checking for the type of server: the
locality check is applied only if the server is a data-server (redirectors
do not serve files and could redirect to a real remote server even if running
on the local machine)
- Check locality of the path when initializing a TFileStager: this allows to
avoid blocking when opening a local path with "root://" protocol
Revision
23091 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Wed Apr 9 15:04:27 2008 UTC (6 years, 9 months ago) by
rdm
File length: 24480 byte(s)
Diff to
previous 23032
moving the follwing directories to "net":
alien, auth, glite, globusauth, krb5auth, ldap, monalisa, net, netx,
rootd, rpdutils, srputils, xrootd
Revision
20682 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Tue Nov 6 15:51:59 2007 UTC (7 years, 2 months ago) by
ganis
Original Path:
trunk/netx/src/TXNetSystem.cxx
File length: 20753 byte(s)
Diff to
previous 20397
Import branches/dev/proof r20654
Summary:
+ Improvements
- Add support for SSH SOCKS4 tunnelling; the local port for the tunnel can be specified
in the master URL, e.g. TProof::Open("master/?tunnel:8000")
- Add the possibility to plot the estimated instantaneous rate
- Add "PROOF_ForceLocal" parameter to the !TPacketizerAdaptive; if set to 1, all the data
are processed locally.
- Add support for remote grep functionality while retrieving logs (needed by the forthcoming
memory monitor)
+ Bug fixes
- Several small fixes to revive the multi-master mode.
- XrdProofdProtocol:
- add missing lock to the client instance in SendMsg to avoid screwing up requests from
workers on the same machine
- lock the mutex of the requester when setting prorities
- add notification during Reset
- fix problem with the detection of the 'allow' directive
- fix problem with the parsing of the return value from XrdProofServProxy::TerminateProofServ()
- always use the effective user to retrieve info fom another server
(XrdProofdManager::GetProofConn is now used)
- fix possible dead-locks from debug notifications done after hard-killing a session
- re-enable the garbage collector thread of the connection manager in XrdProofConn to
fix a problem with closing physical connections;
- fix a problem with !CleanupProofServ in the case of a non-privileged daemon running
in multi-user mode
- introduce a timeout when waiting for the startup of a 'proofserv'.
- XrdProofConn: init mutex in the ctor; lock in SendRecv
- XrdProofSched: add support for using the priorities defined in the group manager to define
the number of workers for sessions
- TProof:
- Broadcast priorities to unique nodes only
- timeout after 5 mins the initial Collect to avoid clients getting stuck at this stage
- add support for generic timeout in Collect (disabled by default)
- fix a problem with SendFile.
- TXProofServ: add a call to !TProof::InterruptCurrentMonitor() in Terminate() to stop
infinite loops in Collect
- TXSocket:
- Implement a flag to interrupt a TXSocket while waiting for messages
- Split the session creation timeout in 4 attempts: the total timeout is the same but
it may circumvent occasional forking problems.
- XROOTD:
- fix a potential (possibly accademic) memory leak in the client
- fix a access permission problem with Kerberos ticket forwarding
- fix bug preventing 'locate' to work properly
- re-enable optimized 'locate'
Revision
18640 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Thu May 3 11:52:09 2007 UTC (7 years, 8 months ago) by
rdm
Original Path:
trunk/netx/src/TXNetSystem.cxx
File length: 20537 byte(s)
Diff to
previous 18194
From Gerri:
netx/src/TXNetSystem.h, .cxx
- New method Prepare for bulk prepare requests
- Improved error logging
- Instantiate XrdClientAdmin via the new static interface to optimize
the connections
net/inc/TFileStager.h, .cxx
- Use TCollection instead of TList
- Add static method GetPathName(TObject *o) to extract the path name
from supported objects TFileInfo, TUrl, TObjString
netx/inc/TXNetFileStager.h, .cxx
- Use TCollection instead of TList
xrootd-20060928-1600.src.tgz
- Improved Admin interface functionality
Revision
18194 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Thu Mar 8 12:09:09 2007 UTC (7 years, 10 months ago) by
rdm
Original Path:
trunk/netx/src/TXNetSystem.cxx
File length: 17222 byte(s)
Diff to
previous 17962
From Gerri:
This patch introduces TFileStager::Locate and uses it to improve lookup
performances in TDSetElement::Lookup and TChain::Lookup.
There is a further optimization to be done in XrdClientAdmin under discussion
with Fabrizio. But that should have no (or very little) impact on this
implementation.
Revision
17962 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Wed Feb 14 18:25:22 2007 UTC (7 years, 11 months ago) by
rdm
Original Path:
trunk/netx/src/TXNetSystem.cxx
File length: 16383 byte(s)
Diff to
previous 17475
From Gerri and Andreas Peters:
provide a new file stager interface via an abstract class TFileStager,
placed in 'net', with TXNetFileStager as concrete implementation in netx.
The plug-in manager takes care of loading libNetx (or any other future
stager plug-in, like SRM (?)).
The Stage(TList *) is currently implemented in net/src/TFileStager.cxx
as it goes through the list issuing the requests one by one. I have,
however, made it virtual so that, as soon as the bug with block submission
in xrootd is fixed, we can implement it in TXNetFileStager.
To issue a stage (prepare) request one has to do the following
root[] stg = TFileStager::Open("root://lxb6046.cern.ch")
root[] stg->Stage("/alice/sim/2006/pp_minbias/121/168/root_archive.zip")
root[] stg->IsStaged("/alice/sim/2006/pp_minbias/121/168/root_archive.zip")
the protocol/host specification is cached at initialization so it is not
needed anymore for the commands; but it will not harm: this will also work:
root[] stg = TFileStager::Open()
root[] stg->Stage("root://lxb6046.cern.ch//alice/sim/2006/pp_minbias/121/168/root_archive.zip")
root[] stg->IsStaged("root://lxb6046.cern.ch//alice/sim/2006/pp_minbias/121/168/root_archive.zip")
Revision
16473 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Sat Oct 7 18:06:11 2006 UTC (8 years, 3 months ago) by
rdm
Original Path:
trunk/netx/src/TXNetSystem.cxx
File length: 14688 byte(s)
Diff to
previous 16379
From Gerri:
This is an optimization in TXNetSystem to avoid recording (and looping over)
too many helpers in TSystem::fHelper.
After this change, only the helper to the redirector is recorded, and the right
connection is searched inside.
Also added:
- an implementation of Unlink, which is useful to delete files on the cluster
(activation of helper search in TUnixSystem::Unlink and TWinNTSystem::Unlink)
Does not work (yet) with dirs, but this is a server side problem; Andy aware.
- a bit in EFileModeMask to flag 'offline' files, i.e. files existing but
(temporarly) not available ... xrootd has the concept, for files to be
staged, for example; the bit 0110000 was unused and it did fit, conceptually.
Revision
15507 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Wed Jun 21 16:18:27 2006 UTC (8 years, 7 months ago) by
rdm
Original Path:
trunk/netx/src/TXNetSystem.cxx
File length: 12293 byte(s)
Diff to
previous 14865
From Gerri:
The patch implements the following new functionality:
- Shutdown of idle sessions when quitting ROOT; if not idle the session
is shutdown as soon as processing terminates; it is possible to delay
the automatic shutdown by a tunable amount of time via a new directive
in the xrootd config file 'xpd.shutdown' (see xpd.cf.example).
- New static method TProof::Reset(const char *url) to hard-cleanup an
user area (implemented for Xproofd only); this implied quite some
additions in XrdProofdProtocol.
- Possibility to temporary remove / re-insert a worker from the active list
TProof::DeactivateWorker(const char *ord)
TProof::ActivateWorker(const char *ord)
with 'ord' the ordinal numer, e.g. "0.3" .
- A default url for the disk pool
const char *TVirtualProof::GetDataPoolUrl()
It is set by default to a string send back by the master, but it can
be changed via
void TVirtualProof::SetDataPoolUrl(const char *url)
Jan should then adapt his code to use this as default.
- Posibility to timeout Collect; for now this is only used at forced
termination.
The patch includes many small changes and bug fixes. One of the most important
is in TXNetSystem (a bug preventing correct treatment of multiple request
to the same redirector).
Revision
14336 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Mon Mar 20 21:43:44 2006 UTC (8 years, 10 months ago) by
pcanal
Original Path:
trunk/netx/src/TXNetSystem.cxx
File length: 16740 byte(s)
Diff to
previous 14282
Reduce direct dependencies on TClass.h, TROOT.h and TStreamerInfo.h.
Warning: This means that some file that relied on the indirect
inclusion of these header file might now fail to compile with
an error message mention that gROOT is no known or that TClass,
TROOT or TStreamerInfo is incompletely defined. Simply add the
proper include directive.
Revision
14282 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Thu Mar 16 09:08:09 2006 UTC (8 years, 10 months ago) by
rdm
Original Path:
trunk/netx/src/TXNetSystem.cxx
File length: 16721 byte(s)
Diff to
previous 14111
From Gerri:
Latest tag of xrootd with the new features needed for PROOF.
The changes in the various classes are mostly because the string class
has been renamed to XrdOucString instead of XrdClientString.
The changes in XrdProofd to use the new features in here will follow shortly.
Revision
14111 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Modified
Sun Feb 26 16:13:38 2006 UTC (8 years, 10 months ago) by
rdm
Original Path:
trunk/netx/src/TXNetSystem.cxx
File length: 16725 byte(s)
Diff to
previous 14074
From Gerri and Jan:
TXNetSystem::MakeDirectory:
send request for the path name and not for the full URL
TXNetSystem::ConsistentWith:
redirect to TNetSystem::ConsistentWith instead of TSystem::ConsistentWith
TNetSystem::ConsistentWith:
check also the port number
TNetSystem::InitRemoteEntity (new)
fill in user, host, port with the appropriate checks
Revision
13044 -
(
view)
(
download)
(
as text)
(
annotate)
-
[select for diffs]
Added
Thu Oct 27 16:36:38 2005 UTC (9 years, 2 months ago) by
rdm
Original Path:
trunk/netx/src/TXNetSystem.cxx
File length: 17018 byte(s)
From Gerri:
This is the patch to import the new XROOTD and to enable TXNetSystem.
Three files:
- 'adds-netx.tgz' contains the new class TXNetSystem;
- 'xrootd-20051026-1709.src.tgz' is the tagged version of XROOTD
- 'cvs-patch' the modifications needed to integrate the two things in ROOT:
- config/rootrc.in:
add plugin info for TXNetSystem
- base/src/TSystem.cxx:
fix the number of arguments in loading the TXNetSystem plugin
- netx/inc/TXNetFile.h, .cxx:
make a couple of generic auxilliary methods static so that they can be
used by TXNetSystem
- net/inc/TNetFile.h, .cxx:
add Create method in TNetSystem, used by TXNetSystem to re-use the
open connection in case of rootd
- net/inc/TFTP.h, .cxx:
additional 'TSocket *' argument in the constructor to allow re-using an
open connection; default behaviour not changed
- netx/inc/LinkDef.h:
add pragma statement for TXNetSystem
- netx/Module.mk:
add support for building on an external XROOTD distribution
- xrootd/Module.mk:
changes to use the new version; still using the 'classic' configure
script:
will move to autoconf with the next patch
This form allows you to request diffs between any two revisions of this file.
For each of the two "sides" of the diff,
enter a numeric revision.
