W2C – Web to Corpus – Corpora

W2C – Web to Corpus – Corpora

LINDAT / CLARIAH-CZ

Authors: Majliš, Martin

Item identifier: http://hdl.handle.net/11858/00-097C-0000-0022-6133-9

Date issued: 2011-12-20

Type: corpus, text

Size: 55 gb

Language(s): Afrikaans , Albanian , Amharic , Arabic , Aragonese , Armenian , Asturian , Azerbaijani , Basque , Belarusian , Bengali , Bishnupriya , Bosnian , Breton , Buginese , Bulgarian , Burmese , Catalan , Cebuano , Chinese , Chuvash , Corsican , Croatian , Czech , Danish , Dimli (individual language) , Dutch , Egyptian Arabic , English , Esperanto , Estonian , Faroese , Fiji Hindi , Finnish , French , Galician , GanChinese , Georgian , German , Gilaki , Gujarati , Haitian , Hebrew , Hindi , Hungarian , Icelandic , Ido , Indonesian , Interlingua (International Auxiliary Language Association) , Irish , Italian , Japanese , Javanese , Kannada , Kazakh , Korean , Kurdish , Latin , Latvian , Limburgan , Lithuanian , Lombard , LowGerman , Luxembourgish , Macedonian , Malagasy , Malay (macrolanguage) , Malayalam , Maori , Marathi , Modern Greek (1453-) , Mongolian , Neapolitan , Nepali , Newari , Norwegian , Norwegian Nynorsk , Occitan(post 1500) , Ossetian , Pampanga , Persian , Piemontese , Polish , Portuguese , Quechua , Romanian , Russian , Scots , ScottishGaelic , Serbian , Serbo-Croatian , Sicilian , Slovak , Slovenian , Spanish , Sundanese , Swahili(macrolanguage) , Swedish , Tagalog , Tajik , Tamil , Tatar , Telugu , Thai , ToskAlbanian , Turkish , Ukrainian , UpperSorbian , Urdu , Uzbek , Venetian , Vietnamese , Volapük , Walloon , Waray (Philippines) , Welsh , WesternFrisian , Yakut , Yiddish , Yoruba

Description: A set of corpora for 120 languages automatically collected from wikipedia and the web. Collected using the W2C toolset: http://hdl.handle.net/11858/00-097C-0000-0022-60D6-1

Publisher: Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)

Subject(s): multilingual corpora

Collection(s): LINDAT / CLARIAH-CZ Data & Tools

Show full item record

Files in this item

This item is

Publicly Available

and licensed under:
Attribution-ShareAlike 3.0 Unported (CC BY-SA 3.0)

Name: afr.txt.gz
Size: 188.37 MB
Format: application/x-gzip
Description: Afrikaans corpus
MD5: c349e9df68bcb1dd92d52295ace4e87c

Name: als.txt.gz
Size: 19.75 MB
Format: application/x-gzip
Description: Unknown
MD5: ba55ee6da793a214b5002bfd72774caf

Name: amh.txt.gz
Size: 34.52 KB
Format: application/x-gzip
Description: Unknown
MD5: 5dc21737e88fa280c2047063b4238a53

Name: ara.txt.gz
Size: 295.5 MB
Format: application/x-gzip
Description: Unknown
MD5: 415bbeb8368d771c46861688011605ee

Name: arg.txt.gz
Size: 3.7 MB
Format: application/x-gzip
Description: Unknown
MD5: 14149b4d9d830335f8beb4da8c63e57c

Name: arz.txt.gz
Size: 8.8 MB
Format: application/x-gzip
Description: Unknown
MD5: efed381f6156853b9697363bba635578

Name: ast.txt.gz
Size: 24.81 MB
Format: application/x-gzip
Description: Unknown
MD5: df897198872120a815115c47f7de97ab

Name: aze.txt.gz
Size: 103.05 MB
Format: application/x-gzip
Description: Unknown
MD5: e023798fcd724b4359f82e47e86076df

Name: bcl.txt.gz
Size: 57 bytes
Format: application/x-gzip
Description: Unknown
MD5: 51117ee5951930dba89979d1322bdeb0

Name: bel.txt.gz
Size: 202.23 MB
Format: application/x-gzip
Description: Unknown
MD5: 16f0ffa68565f7e427a55462e28a3201

Name: ben.txt.gz
Size: 129.08 MB
Format: application/x-gzip
Description: Unknown
MD5: 1d5564053fb1e1cb6c26402284ad069c

Name: bos.txt.gz
Size: 349.1 MB
Format: application/x-gzip
Description: Unknown
MD5: b953de5c62a90718789d526cf0183d77

Name: bpy.txt.gz
Size: 9.45 MB
Format: application/x-gzip
Description: Unknown
MD5: ab69ad8924341f54229806806ca4c0e3

Name: bre.txt.gz
Size: 15.22 MB
Format: application/x-gzip
Description: Unknown
MD5: 2db780c60ff060e552f1cdcf04543781

Name: bug.txt.gz
Size: 266.68 KB
Format: application/x-gzip
Description: Unknown
MD5: 9b4da47d277de5202476de6471327102

Name: bul.txt.gz
Size: 201.58 MB
Format: application/x-gzip
Description: Unknown
MD5: d14bea93aa3d9902d2485be4c20ce830

Name: cat.txt.gz
Size: 230.57 MB
Format: application/x-gzip
Description: Unknown
MD5: 527fb507ee25d0245b7442d66702e48a

Name: ceb.txt.gz
Size: 501.38 KB
Format: application/x-gzip
Description: Unknown
MD5: 0fd132f4bf55d3fc2ececb55870cd605

Name: ces.txt.gz
Size: 454.39 MB
Format: application/x-gzip
Description: Unknown
MD5: aa9074d2db3e00f689987b5dce1c325a

Name: chv.txt.gz
Size: 43.25 KB
Format: application/x-gzip
Description: Unknown
MD5: e94c9feacd4562c2ab0b488f57e98469

Name: cos.txt.gz
Size: 7.36 MB
Format: application/x-gzip
Description: Unknown
MD5: b0cd0081425ca77a1888018576cdbb55

Name: cym.txt.gz
Size: 102.98 MB
Format: application/x-gzip
Description: Unknown
MD5: 63af9dfa77a1c726f1145abc71a4cf63

Name: dan.txt.gz
Size: 200.12 MB
Format: application/x-gzip
Description: Unknown
MD5: 7c1c54a0a5d890078c3b76ec980238a5

Name: deu.txt.gz
Size: 293.91 MB
Format: application/x-gzip
Description: Unknown
MD5: 97f7328cc765cbcffd118a3b55cad780

Name: diq.txt.gz
Size: 819.19 KB
Format: application/x-gzip
Description: Unknown
MD5: e7ea43efaa8063cb9434c820373c24b8

Name: ell.txt.gz
Size: 354.54 MB
Format: application/x-gzip
Description: Unknown
MD5: afa4a66427197a60992aa9057a641cb3

Name: eng.txt.gz
Size: 1.93 GB
Format: application/x-gzip
Description: Unknown
MD5: 3c1cfa575a9a3a8abd627bca43451257

Name: epo.txt.gz
Size: 95.3 MB
Format: application/x-gzip
Description: Unknown
MD5: 026fdcb24f7c6c4c754089440642a825

Name: est.txt.gz
Size: 256.24 MB
Format: application/x-gzip
Description: Unknown
MD5: c9378facb82fd0e35b5543c1aa080df0

Name: eus.txt.gz
Size: 196.78 MB
Format: application/x-gzip
Description: Unknown
MD5: 5c54b93a9c51687ddf681b4a89e337fe

Name: fao.txt.gz
Size: 40.59 MB
Format: application/x-gzip
Description: Unknown
MD5: 052b2163c93bc158976ca79f2cd41f9f

Name: fas.txt.gz
Size: 269.35 MB
Format: application/x-gzip
Description: Unknown
MD5: 5fda10b791ffad94534bcd40469875a7

Name: fin.txt.gz
Size: 336.27 MB
Format: application/x-gzip
Description: Unknown
MD5: 81e1bddfed499a04ecc1e151fc6303ad

Name: fra.txt.gz
Size: 324.96 MB
Format: application/x-gzip
Description: Unknown
MD5: 57de21e165e127a84427209b43e3271a

Name: fry.txt.gz
Size: 30.34 MB
Format: application/x-gzip
Description: Unknown
MD5: ebfd424d7945186d6f9905a0bf9a6335

Name: gan.txt.gz
Size: 58.28 KB
Format: application/x-gzip
Description: Unknown
MD5: 4dcff8cc41be704a9bfb6b5f1f5cb8dc

Name: gla.txt.gz
Size: 14.97 MB
Format: application/x-gzip
Description: Unknown
MD5: dd3b41a3dffcd9f2035d6d6be83c6458

Name: gle.txt.gz
Size: 209.18 MB
Format: application/x-gzip
Description: Unknown
MD5: 4bd744481758e9ed202adadd87e0a3b9

Name: glg.txt.gz
Size: 91.9 MB
Format: application/x-gzip
Description: Unknown
MD5: 85066276644dd742c3ad6e05f4eb71e9

Name: glk.txt.gz
Size: 1.36 MB
Format: application/x-gzip
Description: Unknown
MD5: a2bca05c943d9e0fd29cb1bdb37f561c

Name: guj.txt.gz
Size: 131.21 MB
Format: application/x-gzip
Description: Unknown
MD5: 6fe772628ae06dfdfcad99f8f14ffdaa

Name: hat.txt.gz
Size: 31.27 MB
Format: application/x-gzip
Description: Unknown
MD5: 589bd25a1f9f561719924bcb63d5780a

Name: hbs.txt.gz
Size: 318.16 MB
Format: application/x-gzip
Description: Unknown
MD5: 176a4198ee942e77fe84f93355f7c016

Name: heb.txt.gz
Size: 198.92 MB
Format: application/x-gzip
Description: Unknown
MD5: 928f2e153d5c348c3c8c1560537318b7

Name: hif.txt.gz
Size: 29.61 MB
Format: application/x-gzip
Description: Unknown
MD5: 85a2f7ae23a356fa8262e0a54abfca75

Name: hin.txt.gz
Size: 123.08 MB
Format: application/x-gzip
Description: Unknown
MD5: a2b1b47f839034c1102ba67c0599fb2f

Name: hrv.txt.gz
Size: 291.81 MB
Format: application/x-gzip
Description: Unknown
MD5: 58fc7b1869ea5920355f2847b5930b80

Name: hsb.txt.gz
Size: 270.26 KB
Format: application/x-gzip
Description: Unknown
MD5: b70029e510b7f256b82208f266ebf2d1

Name: hun.txt.gz
Size: 305.96 MB
Format: application/x-gzip
Description: Unknown
MD5: 0f009c5f3d17bade7243a43370eafb59

Name: hye.txt.gz
Size: 99.92 MB
Format: application/x-gzip
Description: Unknown
MD5: 50cec8619981cf7c40fd9ff65ae89aea

Name: ido.txt.gz
Size: 617.9 KB
Format: application/x-gzip
Description: Unknown
MD5: caee88b4ee3c73368604a55801de76a7

Name: ina.txt.gz
Size: 11.48 MB
Format: application/x-gzip
Description: Unknown
MD5: 93f589fa872bb7777855e94810221650

Name: ind.txt.gz
Size: 390.09 MB
Format: application/x-gzip
Description: Unknown
MD5: 02be2e205599a8aa19473b177e0ef3a4

Name: isl.txt.gz
Size: 223.17 MB
Format: application/x-gzip
Description: Unknown
MD5: 20bfc182c7b68728a76b2b7187a26464

Name: ita.txt.gz
Size: 351.03 MB
Format: application/x-gzip
Description: Unknown
MD5: 96cbb01dcddad009ce010f0f1ff76358

Name: jav.txt.gz
Size: 5 MB
Format: application/x-gzip
Description: Unknown
MD5: 83e1d3dd888d371743053ab3921c619f

Name: jpn.txt.gz
Size: 859.16 MB
Format: application/x-gzip
Description: Unknown
MD5: 2e408b86c2c9644530416fa079443af8

Name: kan.txt.gz
Size: 90.77 MB
Format: application/x-gzip
Description: Unknown
MD5: 87cf2f7e257585f3c5cd1e08b594681d

Name: kat.txt.gz
Size: 156.18 MB
Format: application/x-gzip
Description: Unknown
MD5: a2976141a955b7fc632e45f32e3281eb

Name: kaz.txt.gz
Size: 139.66 MB
Format: application/x-gzip
Description: Unknown
MD5: 2d0c03ec7cf3002ac73bf8beafc0f6c1

Name: kor.txt.gz
Size: 219.53 MB
Format: application/x-gzip
Description: Unknown
MD5: 63cbe1edc978285544f449c86f1319a3

Name: kur.txt.gz
Size: 114.93 MB
Format: application/x-gzip
Description: Unknown
MD5: 234c6806d06949cf73b481ad7a2bf066

Name: lat.txt.gz
Size: 97.24 MB
Format: application/x-gzip
Description: Unknown
MD5: 6b847fc6c55a2b53c0f3367cd026e938

Name: lav.txt.gz
Size: 442.74 MB
Format: application/x-gzip
Description: Unknown
MD5: fae5935cd9a35c4ea50eaac2f8707df9

Name: lim.txt.gz
Size: 9.03 MB
Format: application/x-gzip
Description: Unknown
MD5: 94fcee20cabb8f76d4b3b9b221036f9e

Name: lit.txt.gz
Size: 310.5 MB
Format: application/x-gzip
Description: Unknown
MD5: 49295b3be6d8b629609743e9e08c8842

Name: lmo.txt.gz
Size: 10.33 MB
Format: application/x-gzip
Description: Unknown
MD5: 0583d13df2052c4a8a1da14c77a90451

Name: ltz.txt.gz
Size: 34.46 MB
Format: application/x-gzip
Description: Unknown
MD5: 28fece75d874d00ba6ea642cc21de311

Name: mal.txt.gz
Size: 180.27 MB
Format: application/x-gzip
Description: Unknown
MD5: 6c224513aa374b8ac711d035e3e7e78c

Name: mar.txt.gz
Size: 207.66 MB
Format: application/x-gzip
Description: Unknown
MD5: 876c7c603fa77abc2dc2f484e62877ca

Name: mkd.txt.gz
Size: 195.55 MB
Format: application/x-gzip
Description: Unknown
MD5: 32ea0d443ad99da3709a60ad2f3a8be1

Name: mlg.txt.gz
Size: 22.34 MB
Format: application/x-gzip
Description: Unknown
MD5: 5d4123fe4207958784a909616d70f940

Name: mon.txt.gz
Size: 213.89 MB
Format: application/x-gzip
Description: Unknown
MD5: ac7ca5b410880137f911c9deeefdd1cf

Name: mri.txt.gz
Size: 31.34 MB
Format: application/x-gzip
Description: Unknown
MD5: b5777268f826d99a44e9e5b3bec150c3

Name: msa.txt.gz
Size: 195.84 MB
Format: application/x-gzip
Description: Unknown
MD5: 00d50959dcb528a3fd0b0b73ec947c1b

Name: mya.txt.gz
Size: 220.14 MB
Format: application/x-gzip
Description: Unknown
MD5: 088dce9e81b638ab5bd01f3bc7c204b9

Name: nap.txt.gz
Size: 737.23 KB
Format: application/x-gzip
Description: Unknown
MD5: c49ebdc9abe2c707882f9829c892de11

Name: nds.txt.gz
Size: 10.89 MB
Format: application/x-gzip
Description: Unknown
MD5: 5eae3c36643270274dddef8913850804

Name: nep.txt.gz
Size: 143.07 MB
Format: application/x-gzip
Description: Unknown
MD5: 00c99261ecd955daf8e5a180e1f9f289

Name: new.txt.gz
Size: 272.55 KB
Format: application/x-gzip
Description: Unknown
MD5: 2cbb8150f7e4274211a3f736a884344f

Name: nld.txt.gz
Size: 330.73 MB
Format: application/x-gzip
Description: Unknown
MD5: 4fb5a6f55a2486a9ccdf92817341a873

Name: nno.txt.gz
Size: 19.28 MB
Format: application/x-gzip
Description: Unknown
MD5: 78bdcd5ce761c684b7d9143c54354def

Name: nor.txt.gz
Size: 280.36 MB
Format: application/x-gzip
Description: Unknown
MD5: 7148fa19c3009cd1969285f9fdf0f77f

Name: oci.txt.gz
Size: 30.88 MB
Format: application/x-gzip
Description: Unknown
MD5: 168fe308100a43a28bb522e0cf0a0225

Name: oss.txt.gz
Size: 266.99 KB
Format: application/x-gzip
Description: Unknown
MD5: 3fbd5a8b9e5feccd8a894227013ccd43

Name: pam.txt.gz
Size: 44.01 MB
Format: application/x-gzip
Description: Unknown
MD5: ff7c8b89443b2c24d88712c9dab2b3fa

Name: pms.txt.gz
Size: 983.12 KB
Format: application/x-gzip
Description: Unknown
MD5: c5e19439965b7459cbbe337f01781281

Name: pnb.txt.gz
Size: 57 bytes
Format: application/x-gzip
Description: Unknown
MD5: 92a484bec94f7fc76115e22e3ceb3f09

Name: pol.txt.gz
Size: 281.19 MB
Format: application/x-gzip
Description: Unknown
MD5: 57f708b66448da335397f8a41a668cf9

Name: por.txt.gz
Size: 214.78 MB
Format: application/x-gzip
Description: Unknown
MD5: fb4232ec385e184b421bce796648e55a

Name: que.txt.gz
Size: 1.35 MB
Format: application/x-gzip
Description: Unknown
MD5: fc0396412bf72d2e0cfb51e3a7144413

Name: ron.txt.gz
Size: 410.99 MB
Format: application/x-gzip
Description: Unknown
MD5: c17cc94905077042dbea6e62aa696d9a

Name: rus.txt.gz
Size: 148.73 MB
Format: application/x-gzip
Description: Unknown
MD5: b676e8efd98e62000189cf13219de01c

Name: sah.txt.gz
Size: 89.63 MB
Format: application/x-gzip
Description: Unknown
MD5: 8b08153fd1ba4c1154121cb0a0a73bcb

Name: scn.txt.gz
Size: 8.32 MB
Format: application/x-gzip
Description: Unknown
MD5: 4afe58ad2ce1645f8b2124464a3be05e

Name: sco.txt.gz
Size: 15.18 MB
Format: application/x-gzip
Description: Unknown
MD5: aba4fad682fbf5c03196cfa056f68b07

Name: slk.txt.gz
Size: 243.81 MB
Format: application/x-gzip
Description: Unknown
MD5: ec9bbb3af1e3adc8ce210a58267ceecf

Name: slv.txt.gz
Size: 247.31 MB
Format: application/x-gzip
Description: Unknown
MD5: 4d7ba3c7c02b795f9790a51bad216ea2

Name: spa.txt.gz
Size: 580.37 MB
Format: application/x-gzip
Description: Unknown
MD5: 1c60112a5c20ea94ed4c69c2bc49040e

Name: sqi.txt.gz
Size: 192.12 MB
Format: application/x-gzip
Description: Unknown
MD5: 134436d6e4497278113e924ba7007bca

Name: srp.txt.gz
Size: 260.09 MB
Format: application/x-gzip
Description: Unknown
MD5: 2ba8af1a15ea5b2153aa88f9a24dfa00

Name: sun.txt.gz
Size: 797.99 KB
Format: application/x-gzip
Description: Unknown
MD5: 6c18529ee9aa1339a910e4d619bd6fd8

Name: swa.txt.gz
Size: 92.86 MB
Format: application/x-gzip
Description: Unknown
MD5: 1919c56057369609f677a6b4c011ec92

Name: swe.txt.gz
Size: 250.59 MB
Format: application/x-gzip
Description: Unknown
MD5: b51e6e0f3cf1d4554e0684c84c2f503a

Name: tam.txt.gz
Size: 221.87 MB
Format: application/x-gzip
Description: Unknown
MD5: 901aa45b0e00ca77d077dc50001c2ddd

Name: tat.txt.gz
Size: 37.8 MB
Format: application/x-gzip
Description: Unknown
MD5: ee2c36f4e5dcd7dbc85647fbbe385b0f

Name: tel.txt.gz
Size: 106.9 MB
Format: application/x-gzip
Description: Unknown
MD5: 32947d631f2fd571f5f282b2840d7b95

Name: tgk.txt.gz
Size: 98.98 MB
Format: application/x-gzip
Description: Unknown
MD5: 5001d933f92853fc66ca0ba8b87a54eb

Name: tgl.txt.gz
Size: 116.64 MB
Format: application/x-gzip
Description: Unknown
MD5: cc55f792c456e042a0669a2790b5b56b

Name: tha.txt.gz
Size: 514.12 MB
Format: application/x-gzip
Description: Unknown
MD5: 03329bea378ad7e10fe69522c121cc33

Name: tur.txt.gz
Size: 327.86 MB
Format: application/x-gzip
Description: Unknown
MD5: b0ffae87cd83cc9ba496635541326158

Name: ukr.txt.gz
Size: 258.26 MB
Format: application/x-gzip
Description: Unknown
MD5: 128b86a5d5f72ceb36b15043e81c0519

Name: urd.txt.gz
Size: 164.22 MB
Format: application/x-gzip
Description: Unknown
MD5: e5488b9dbb83a033ef242ea4d6dea75b

Name: uzb.txt.gz
Size: 71.5 MB
Format: application/x-gzip
Description: Unknown
MD5: 2f0f3fe35d45fd92073d6d0c15b58b8d

Name: vec.txt.gz
Size: 5.69 MB
Format: application/x-gzip
Description: Unknown
MD5: 51c49ca87ee9f1c6b94c67d7358454c1

Name: vie.txt.gz
Size: 191.28 MB
Format: application/x-gzip
Description: Unknown
MD5: b5d6a4eb9c5e5010cb8a3eda972b5a4f

Name: vol.txt.gz
Size: 834.49 KB
Format: application/x-gzip
Description: Unknown
MD5: c84441e70c413e4744f4424c61aa228a

Name: war.txt.gz
Size: 1.79 MB
Format: application/x-gzip
Description: Unknown
MD5: b93497ec80765f3030b5186e2cb321ae

Name: wln.txt.gz
Size: 394.39 KB
Format: application/x-gzip
Description: Unknown
MD5: 84926ea5a6c18c9c0a0820cc1deb9208

Name: yid.txt.gz
Size: 33.56 MB
Format: application/x-gzip
Description: Unknown
MD5: 0ab03f6f58483852b815c523d3d32037

Name: yor.txt.gz
Size: 3.58 MB
Format: application/x-gzip
Description: Unknown
MD5: 473d04a31942d978ccffac6dda634310

Name: zho.txt.gz
Size: 8.64 MB
Format: application/x-gzip
Description: Unknown
MD5: 9f20ed81c0872bf8cad674bd212f41c1