Wratislavia XML Corpus

There was no publicly available and widely respected XML file set so we decided to create the Wratislavia XML Corpus. It was developed specifically for testing and comparing new XML compression algorithms. It contains 7 files with size from 2 MB up to 151 MB. It's 471 MB in total. The collection will not be changed in the future. The files were selected based on their ability to provide representative performance results, so we refrained from using e.g. artificially generated XMark and partially encrypted Treebank. Nevertheless the Wratislavia XML Corpus contains widely used DBLP, Shakespeare, SwissProt and TPC-H files.


Filename	Description	Year	Download	Source	Elements	Attributes	Max-depth
dblp.xml	Digital Bibliography Library Project database - bibliographic information on major computer science journals and proceedings	Oct 2002	.rar (13 MB) .gz (23 MB)	Swiss-Prot	3 332 130	404 276	6
enwikibooks.xml	A collection of free content textbooks from English Wikipedia	Dec 2006	.rar (31 MB)	Wikipedia	533 698	49 115	5
enwikinews.xml	A news collection from English Wikipedia	Dec 2006	.rar (8 MB)	Wikipedia	278 670	24 607	5
lineitem.xml	The biggest file from TPC-H Relational Database Benchmark (Converted to XML by Zack Ives)	2002	.rar (1 MB) .gz (2 MB)	TPC	1 022 976	1	3
Shakespeare.xml	All Shakespeare's plays converted to XML	Oct 2002	.rar (1 MB) .xml (7 MB)	NIAGARA Query Engine	179 690	0	7
SwissProt.xml	A protein sequence database	1998	.rar (8 MB) .gz (13 MB)	Swiss-Prot	2 977 031	2 189 859	5
uwm.xml	Course data derived from university websites	1999	.rar (103 KB) .gz (157 KB)	AnHai Doan	66 729	6	5
Sum	Some files can be downloaded also from XML Data Repository.		471 MB (uncompressed)		7 367 948	2 667 864

Compression ratio (in bpc)


file	gzip	XMill 0.9 zip	XWRT -l2 (gzip)	LZMA -a1	XWRT -l6 (LZMA)	PPMdJ -o8 -m64	XMill 0.9 PPMd	XMLPPM -l 9	SCMPPM -l 9	XWRT -l9 (PPM)	FastPAQ8 74 MB	XWRT -l11 (FastPAQ8)
dblp	1,463	1,250	0,865	0,943	0,747	0,724	0,940	0,802	0,693	0,690	0,659	0,597
enwikibooks	2,339	2,295	1,742	1,686	1,504	1,565	1,838	1,621	1,621	1,481	1,357	1,269
enwikinews	2,248	2,198	1,597	1,462	1,301	1,291	1,746	1,379	1,398	1,202	1,172	1,090
lineitem	0,721	0,380	0,276	0,421	0,243	0,359	0,270	0,261	0,242	0,243	0,236	0,226
Shakespeare	2,182	2,044	1,481	1,646	1,349	1,245	1,584	1,295	1,293	1,204	1,220	1,185
SwissProt	0,985	0,619	0,475	0,478	0,388	0,490	0,477	0,416	0,417	0,363	0,395	0,313
uwm	0,553	0,382	0,315	0,368	0,278	0,426	0,310	0,259	0,274	0,240	0,254	0,228
average	1,499	1,310	0,964	1,001	0,830	0,871	1,024	0,862	0,848	0,775	0,756	0,701