Jump to content

Incremental dumps/Compression

From mediawiki.org
tenwiki-pages-meta-history tenwiki-pages-meta-current trwiki-pages-meta-history
.xml 99.8 MB 4.45 MB 97.3 GB
.xml.7z 2.04 MB 1.34 GB
.xml.bz2 888 kB
LZMA separate 35.7 MB 1.79 MB > 18 GB
zdelta 1 4.50 MB
zdelta N 1 4.52 MB 1.76 MB
zdelta N 1 (skip empty) 4.47 MB
zdelta N 4 4.27 MB 3.06 GB
LZMA first + zdelta N 4 4.27 MB
zdelta N 4, groups per 100 4.61 MB 1.73 MB
zdelta N 4, groups per 10 7.28 MB
LZMA, one big group 3.29 MB
LZMA, groups per 256 3.66 MB 1.29 MB 2.32 GB
LZMA, groups per page per 256 4.15 MB
LZMA, groups per page per 100 4.30 MB

Detailed break up of “LZMA, groups per page per 256” for tenwiki-pages-meta-history:

  • total: 4247 kB
    • file header and site info: 0 kB
    • indexes: 444 kB
    • metadata: 1976 kB
      • pages: 183 kB
      • revisions: 1792 kB
    • compressed texts: 1827 kB

Breakup for tenwiki-pages-meta-current:

  • total: 1318 kB
    • file header and site info: 0 kB
    • indexes: 136 kB
    • metadata: 444 kB
      • pages: 114 kB
      • revisions: 329 kB
    • compressed texts: 737 kB

trwiki-pages-meta-history:

  • total: 2 383 MB
    • file header and site info: 0 MB
    • indexes: 193 MB
    • metadata: 1 184 MB
      • pages: 81 MB
      • revisions: 1 102 MB
        • comments: 510 MB
        • users: 136 MB
        • SHA1s: 233 MB
        • rest: 222 MB
    • compressed texts: 1 005 MB
elnews-20130814 elnews-20130824 elnews-20130814-20130824 increase
LZMA groups per 256 12 489 kB 12 500 kB 12 535 kB 35 kB
zdelta N 4 16 145 kB 16 169 kB 16 209 kB 40 kB