Thanks Fons, I have put in a 1GB swap area and ran over 4.2M events successfully. I am now trying 58M events... - John Fons Rademakers wrote: >Hi John, > > the current version of the MySQL interface reads the complete result >set from the DB server into the client memory, so you must have enough >RAM and swap. > >Cheers, Fons. > > >On Tue, 2003-07-08 at 21:15, Dr. John Krane wrote: > > >>Hi, >> >>I need to run over many millions of events in an SQL database. From the >>way my tree-making code is behaving, it looks like TSQLServer.Query() >>pulls over all the information at once and stores it in memory, then my >>code runs over the TSQLResult from that memory. It is unclear to me if >>the memory is disk-resident but I think it must be. >> >>Is there some buffer size limit or is this TSQLResult written to an >>intermediate file or ??? I'm really having difficulty with my system >>freezing if I request more than 3 million events. Less than 3M and I do >>not freeze. Could somebody please explain how TSQLServer.Query handles >>large results? My disk drive is enormous so I really can't run out of >>disk space if I am allowed to define a buffer area. I might be in >>trouble if it is hard-wired to /tmp on my Linux box. >> >> - John >> >>
This archive was generated by hypermail 2b29 : Thu Jan 01 2004 - 17:50:13 MET