11 Apr 2006 23:01
Re: We need a Bittorrent style hash file
Eric <jrocnuck <at> yahoo.com>
2006-04-11 21:01:33 GMT
2006-04-11 21:01:33 GMT
that sounds reasonable... I know that Jason investigated the tiger-tree hash and said it was fairly complex... this would at least speed things up some.. --- Nate <fileman <at> fastmail.fm> wrote: > To properly do multisource we are going to need to > have a Bittorrent > style hash file. > > The way things are set up now, one small glitch in a > file and you have > to wait until the final hash check to find out your > file is corrupted. > > I suggest that each 1MB section of a file have a > simple 16 bit CRC > generated. When asking for info on a file, a list of > all the CRCs are > sent back so the downloader can check each 1MB > section as it comes in. > > If one of the 1MB sections is found to be bad, the > client can retry from > that source again and/or switch to a different > source to obtain a > correct section. > > Later on there could be a verified list of files and > their CRC lists put > up on some web site out there to weed out the bad > files. Until then > there will always be the possibility that the first > source you find for > a file may have a corrupted CRC list and the client > would just keep on > trying until you manually pick a new initial source. > > If the info file format was kept simple, like the > CRC in hex (four > characters) and then a comma, then the next CRC, for > a 600MB file the > info file packet would only be about 3K. I suggest a > CRC because it's > very fast to generate and check on the fly. A > complete hash check is > always done when finished, like we do now. > > -- > http://www.fastmail.fm - A no graphics, no pop-ups > email service > > > > ------------------------------------------------------- > This SF.Net email is sponsored by xPML, a > groundbreaking scripting language > that extends applications into web and mobile media. > Attend the live webcast > and join the prime developer group breaking into > this new coding territory! > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642 > _______________________________________________ > MUTE-net-Discuss mailing list > MUTE-net-Discuss <at> lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/mute-net-discuss > __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com ------------------------------------------------------- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnk&kid=110944&bid=241720&dat=121642
RSS Feed