Re: creating 2.5GB share list takes about 5 minutes

Reply to 20050102195102.43d761cb.h.sokolowski <at> wsisiz.edu.pl
Sent: Sun, 2 Jan 2005 19:51:02 +0100

Hubert wrote:
> On Sun, 2 Jan 2005 20:36:52 +0200
> ghrt <ghrt <at> dial.kappa.ro> wrote:
> 
> > Pe data de Dum 02 Ian 2005 20:16, Hubert Soko³owski a scris:
> > > Hi!
> > >
> > > I share some mp3s,movies and some apps. everything takes about
> > > 2.5GB. it takes for valknut to recreate a share filelist about 5
> > > minutes and my hard disk is used very intesively. the number of
> > > files is about 100. is it normal? I tried using option disable
> > > hash list but no difference. my system is AMD Athlon XP 2600+,
> > > 256MB of RAM, hard disk is 5400 rpm, DMA for hard disk is on.
> > 
> > pretty normal. the number of files matter, not size. CPU is heavily 
> > used when computing hashes. it seems that valknut is using hashes 
> > even if you disable "use hash list" (0.3.3).
> > keep the same files in the share so you won't have to recreate 
> > filelist too often.
> 
> I removed a directory with windows apps (only installable exe files)
> and now the problem is solved, recreating share list takes about 3
> seconds. I removed only about 20 files from my share list. it looks
> like not only number of files matter but also its type.

I can't see why computing a hash on a .exe file would be any different
from any other type of file. Are these files stored on a windows
partition? FAT32 is suboptimal for many operations and the little I've
played with NTFS under Linux showed that the implementation wasn't
exactly fast. I'm assuming you are using Linux from your X-Mailer mail
header.

I've also found that Valknut doesn't seem to handle creating hashes for
files stored on NFS shares terribly well - not suprising really. :/

Zair

--

-- 
Paul Ficinski
pplfichi <at> lineone.net