Thank you all.
I think TFile is very similar to what I am trying to do.
One issue of TFile is that it stores all meta and indices in its tail
which in turn means that if the writing process suddenly crashes for
some reason (e.g. hardware issue or something not related to our
process) then file will be of incomplete format and it won't be
possible to read it or even recover it.

/Roman

On 17 май, 10:28, Eyal Farago <eyal.far... <at> gmail.com> wrote:
> you can use an approach like HADDOP's TFilehttps://issues.apache.org/jira/secure/attachment/12396286/TFile%20Spe...

>
> basically they store compressed chunks in a file, and at the end of the
> file (hence T(ail)File) they store come kind of a sparse index to
> the chunks.
>
> Eyal.
>
>
>

> - Скрыть цитируемый текст -
>
> - Показать цитируемый текст -

--
You received this message because you are subscribed to the Google Groups "Protocol Buffers" group.

To post to this group, send email to protobuf <at> googlegroups.com.
To unsubscribe from this group, send email to protobuf+unsubscribe <at> googlegroups.com.
For more options, visit this group at http://groups.google.com/group/protobuf?hl=en.