Eric | 11 Apr 2006 23:01
Picon
Favicon

Re: We need a Bittorrent style hash file

that sounds reasonable... 

I know that Jason investigated the tiger-tree hash and
said it was fairly complex... 

this would at least speed things up some.. 

--- Nate <fileman <at> fastmail.fm> wrote:

> To properly do multisource we are going to need to
> have a Bittorrent
> style hash file.
> 
> The way things are set up now, one small glitch in a
> file and you have
> to wait until the final hash check to find out your
> file is corrupted.
> 
> I suggest that each 1MB section of a file have a
> simple 16 bit CRC
> generated. When asking for info on a file, a list of
> all the CRCs are
> sent back so the downloader can check each 1MB
> section as it comes in.
> 
> If one of the 1MB sections is found to be bad, the
> client can retry from
> that source again and/or switch to a different
> source to obtain a
> correct section.
> 
> Later on there could be a verified list of files and
> their CRC lists put
> up on some web site out there to weed out the bad
> files. Until then
> there will always be the possibility that the first
> source you find for
> a file may have a corrupted CRC list and the client
> would just keep on
> trying until you manually pick a new initial source.
> 
> If the info file format was kept simple, like the
> CRC in hex (four
> characters) and then a comma, then the next CRC, for
> a 600MB file the
> info file packet would only be about 3K. I suggest a
> CRC because it's
> very fast to generate and check on the fly. A
> complete hash check is
> always done when finished, like we do now.
> 
> -- 
> http://www.fastmail.fm - A no graphics, no pop-ups
> email service
> 
> 
> 
>
-------------------------------------------------------
> This SF.Net email is sponsored by xPML, a
> groundbreaking scripting language
> that extends applications into web and mobile media.
> Attend the live webcast
> and join the prime developer group breaking into
> this new coding territory!
>
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642
> _______________________________________________
> MUTE-net-Discuss mailing list
> MUTE-net-Discuss <at> lists.sourceforge.net
>
https://lists.sourceforge.net/lists/listinfo/mute-net-discuss
> 

__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
http://mail.yahoo.com 

-------------------------------------------------------
This SF.Net email is sponsored by xPML, a groundbreaking scripting language
that extends applications into web and mobile media. Attend the live webcast
and join the prime developer group breaking into this new coding territory!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642

Gmane