Roadmap

From openZIM
Revision as of 23:20, 1 January 2010 by Tntnet (talk | contribs)
Jump to navigation Jump to search
The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

See also current Status and next steps.

Until end of 2009
  • Finalizing ZIM file format
    • ZIM file header:
      • add Pointer to UrlPointerList (IndexPointerList will be named "TitlePointerList") - DONE
      • add Pointer to MimeTypeList - DONE
    • ZIM file structure:
      • add UrlPointerList (article list ordered by URL) - DONE
      • add MimeTypeList to store MimeTypes in a zero-terminated list - DONE
      • make new integer compression (UTF-8 compression / ZInt compression) - DONE
      • break version number into major / minor number
    • Directory Entry:
      • drop QUnicode on article titles - DONE
      • add URL - DONE
      • add rev_id int compressed - DONE (not int compressed)
    • Index Namespace (X)
      • switch to new int compression - DONE
Later
  • Layout Namespace (A / B)
    • A - HTML body
    • B - HTML header template
    • reader sets flag when loading library if it wants to get HTML body or full layout using header template
    • MIME types used
      • html-body
      • html-layout
  • Cluster compression
    • add LZMA compression - DONE LZMA compression
    • switch to compression streaming (only keep in memory what is really needed)
  • Packaging
    • Debian maintainer, contact by Tommi
    • RPM? - maybe openSuSE buildservice
    • static binaries should be updated regularly
    • Emmanuel adds Microsoft Visual Studio project file to SVN
  • Category Namespace (U / V)
    • U contains standard article text
    • V contains article pointers to articles within that category
  • Metadata Namespace (M) - these fields should be available as variables for layout templates
    • "language" - ISO Code 639-3
    • "creator"
    • "date" - YYYYMMDD
    • "description"
    • "relation"
    • "source" - URL
  • ZIM export running on http://download.wikimedia.org/ This is not likely to happen until after the WMF fundraiser finishes which will be after 1/2010 Tomasz 15:06, 22 November 2009 (UTC)
    • work in MW API
    • dumper has to add license name and link to the HTML content
  • Updating
    • tool to merge two ZIM files
April 2009