2 Feb 13:49
Optimal usage of xapian-compact for merging
Henry C. <henka <at> cityweb.co.za>
2010-02-02 12:49:46 GMT
2010-02-02 12:49:46 GMT
Greets, I've been wondering, what's the sane/optimal use of xapian-compact when merging many indexes with a view to maximum merging performance? The obvious: - only use -F on the final db. - use -m since I'm merging more than 3 dbs. Best strategy? a) loop: merge batches (of say 50, where the individual db's are small) into a temp index, then merge the (larger) temp into the final product... end-loop b) loop: merge batches (of say 50, where the individual db's are small) into many temp indexes... end-loop Then merge those (larger) temps into the final product. Finally, presumably it's best to use the same blocksize (-b) as the underlying filesystem? I see the default is 8K, but the default blocksize on (eg) ext3 is 4k... or am I way off here? Thanks Henry
RSS Feed