3 Dec 2002 21:47
Re: Selecting X-Report-Spam renders background images
Samuel Liddicott <sam <at> liddicott.com>
2002-12-03 20:47:17 GMT
2002-12-03 20:47:17 GMT
"Lars Magne Ingebrigtsen" <larsi <at> gnus.org> wrote in message news:m3isyasyom.fsf <at> quimbies.gnus.org... > "Samuel Liddicott" <sam <at> liddicott.com> writes: > > > It does scale very well if you scale the hardware too. It generally > > requires enough RAM to hold half the DB if you want to handle many > > simultaneous queries well, but is good with less than this if you stripe > > heavily. At Orange we run with 8GB RAM on a 4 CPU box (4x 700 Mhz) and > > between half a million and one million documents but it can go much higher - > > but we only want 30 days worth of news. We add about 20,000 documents a day, > > on a big database the add limit can come down to a max of 30,000-40,000 > > documents a day (depending on hardware). > > That definitely sounds interesting. I've got a 2GB 2xMP1900+ for the > search engine machine, so that sounds roughly similar, actually. > (Except for having a quarter of the RAM.Yeah, well the 8GB turne out to be overkill for us as the DB size was cut since, so we end up buffering the whole DB and never use swap!! But we also use it as a power-postgres box for dynamic TV listings at http://www.ananova.com/tv_listings/_tv_full_listings.html?menu=tv.personalis edlistings It also runs our web spider fetching back 20,000 stories per day, so I reckon 2GB will do you fine. > If the search engine I'm working on doesn't work out, this definitely > sounds like a candidate. Jolly; I hope yours goes well, but I like xapian cos it has a host of other people working on it too.
Sam
Yeah, well the 8GB turne out to be overkill for us as the DB size was cut
since, so we end up buffering the whole DB and never use swap!!
But we also use it as a power-postgres box for dynamic TV listings at
RSS Feed