109
edits
Line 4: | Line 4: | ||
* Finalizing ZIM file format | * Finalizing ZIM file format | ||
** ZIM file header: | ** ZIM file header: | ||
*** add Pointer to UrlPointerList (IndexPointerList will be named "TitlePointerList") | *** add Pointer to UrlPointerList (IndexPointerList will be named "TitlePointerList") - DONE | ||
*** add Pointer to MimeTypeList | *** add Pointer to MimeTypeList - DONE | ||
** ZIM file structure: | ** ZIM file structure: | ||
*** add UrlPointerList (article list ordered by URL) | *** add UrlPointerList (article list ordered by URL) - DONE | ||
*** add MimeTypeList to store MimeTypes in a zero-terminated list | *** add MimeTypeList to store MimeTypes in a zero-terminated list - DONE | ||
*** make new integer compression (UTF-8 compression / ZInt compression) | *** make new integer compression (UTF-8 compression / ZInt compression) - DONE | ||
*** break version number into major / minor number | *** break version number into major / minor number | ||
** Directory Entry: | ** Directory Entry: | ||
*** drop QUnicode on article titles | *** drop QUnicode on article titles - DONE | ||
*** add URL | *** add URL - DONE | ||
*** add rev_id int compressed | *** add rev_id int compressed - DONE (not int compressed) | ||
** Index Namespace (X) | ** Index Namespace (X) | ||
*** switch to new int compression | *** switch to new int compression - DONE | ||
;Later | ;Later | ||
Line 28: | Line 28: | ||
* Cluster compression | * Cluster compression | ||
** add LZMA compression | ** add LZMA compression - DONE [[LZMA compression]] | ||
** switch to compression streaming (only keep in memory what is really needed) | ** switch to compression streaming (only keep in memory what is really needed) | ||