Hi Edward, I've fixed the behaviour of TChain::Add(). The files with dot's were seen as wildcards. This resulted in opening the RFIO directory and reading all directory entries to make the match. Reading these large directories using RFIO is very slow. With the fix the files are not anymore considered as containing wildcards and the addition should be instantaneous. Try the cvs version. Cheers, Fons. On Fri, 2003-09-12 at 16:53, Edward Moyse wrote: > > Also, you are using castor. Maybe some of your files are not staged when > > you stage them, so castor first has to retreive them from tape. > > No, they are definitely staged. > > Network performance may well be an issue - what I was really asking is, in > practice, is it better to have a few very large files, or lots of smaller > files. It's easier for me to have many small files, but at the moment the > code is unbearably slow. > > Rene's suggestion to use AddFile has dramatically sped up the chaining stage > (it's all completed in <2s as opposed to 2 hours!!!!) but the filenames are > wrong, and nothing is processed. > > Cheers, > > Ed -- Org: CERN, European Laboratory for Particle Physics. Mail: 1211 Geneve 23, Switzerland E-Mail: Fons.Rademakers@cern.ch Phone: +41 22 7679248 WWW: http://www.rademakers.org/fons/ Fax: +41 22 7679480
This archive was generated by hypermail 2b29 : Thu Jan 01 2004 - 17:50:15 MET