Skip to content

Latest commit

 

History

History
108 lines (105 loc) · 30.9 KB

higher.md

File metadata and controls

108 lines (105 loc) · 30.9 KB

Tatoeba Challenge Data - v2021-08-07

This is the "higher" sub-set of the Tatoeba data. Download the data files from the link in the table below. There is a total of

  • 98 language pairs in this sub-set
lang-pair test dev train
Afrikaans - German afr-deu 1583 1 5404300
Afrikaans - Dutch afr-nld 1056 4086174
Afrikaans - Russian afr-rus 228 1652781
Afrikaans - Spanish afr-spa 448 2000987
Arabic - Esperanto ara-epo 753 94 1234097
Azerbaijani - English aze-eng 2659 1012 3233365
Azerbaijani - Turkish aze-tur 1150 15 2598020
Belarusian - German bel-deu 551 1 1322056
Belarusian - English bel-eng 2500 4265 3641197
Belarusian - Polish bel-pol 287 2948821
Belarusian - Russian bel-rus 2500 2754 4782456
Belarusian - Ukrainian bel-ukr 2355 1021 1816968
Breton - English bre-eng 383 1020160
Bulgarian - Esperanto bul-epo 570 1 1450480
Bulgarian - Japanese bul-jpn 321 2 8114217
Catalan - German cat-deu 723 2 2266984
Catalan - Esperanto cat-epo 772 7 1217119
Catalan - Dutch cat-nld 578 2 2036970
Catalan - Ukrainian cat-ukr 456 2241110
Cebuano - German ceb-deu 903 1278923
Cebuano - English ceb-eng 378 1279479
Czech - Esperanto ces-epo 3471 1058 2124218
Czech - Ukrainian ces-ukr 1787 1114 7651457
Welsh - English cym-eng 818 19 2343465
Danish - Danish dan-dan 212 4700694
Danish - Esperanto dan-epo 11069 19236 1597423
Danish - Japanese dan-jpn 904 10 8199889
German - German deu-deu 2500 2115 4574760
German - Esperanto deu-epo 13439 221681 5266759
German - Basque deu-eus 456 1027193
German - Icelandic deu-isl 969 19 7534706
German - Tagalog deu-tgl 326 3265457
Modern Greek (1453-) - Esperanto ell-epo 604 5 1610179
English - Irish eng-gle 1913 27 4076822
English - Armenian eng-hye 1121 1000 1393027
English - Iloko eng-ilo 1093 1000 1259734
English - Javanese eng-jav 262 2 1993438
English - Georgian eng-kat 984 18 2026943
English - Kazakh eng-kaz 403 3 1060530
English - Latin eng-lat 10298 14036 1103779
English - Luxembourgish eng-ltz 293 4 9546015
English - Malayalam eng-mal 802 9071279
English - Marathi eng-mar 10396 43058 4475328
English - Maltese eng-mlt 203 1 8482666
English - Occitan (post 1500) eng-oci 841 1532613
English - Swahili (macrolanguage) eng-swa 387 3 9366710
English - Tamil eng-tam 311 9461564
English - Telugu eng-tel 261 1089331
English - Tagalog eng-tgl 2500 4796 8656962
English - Urdu eng-urd 1663 1 8949903
Esperanto - Persian epo-fas 2514 7430 1137027
Esperanto - Finnish epo-fin 2862 1047 1534419
Esperanto - French epo-fra 12168 287548 5959738
Esperanto - Serbo-Croatian epo-hbs 2500 2802 2612660
Esperanto - Hebrew epo-heb 10368 19607 1255873
Esperanto - Hungarian epo-hun 10094 28756 1613081
Esperanto - Italian epo-ita 10303 40619 3027527
Esperanto - Lithuanian epo-lit 11511 10429 1093148
Esperanto - Dutch epo-nld 12841 80837 2619413
Esperanto - Norwegian epo-nor 3158 1011 1594667
Esperanto - Romanian epo-ron 3820 1319 1757517
Esperanto - Slovenian epo-slv 302 1 1280982
Esperanto - Spanish epo-spa 10735 65096 6339446
Esperanto - Swedish epo-swe 1757 68 2197206
Esperanto - Ukrainian epo-ukr 2500 4559 1111500
Finnish - Finnish fin-fin 1000 349 6186357
Finnish - Japanese fin-jpn 9934 10917 8394554
Finnish - Korean fin-kor 422 5290932
French - Occitan (post 1500) fra-oci 806 1135954
French - Tagalog fra-tgl 836 3423526
Hebrew - Ukrainian heb-ukr 966 10 3464693
Hindi - Urdu hin-urd 240 2 1743382
Hindi - Chinese hin-zho 324 1 3253101
Hungarian - Japanese hun-jpn 2499 3660 9245122
Hungarian - Korean hun-kor 271 5989312
Hungarian - Ukrainian hun-ukr 473 3 6090583
Icelandic - Italian isl-ita 236 3421479
Icelandic - Spanish isl-spa 238 4407442
Italian - Ukrainian ita-ukr 5000 8775 6367168
Japanese - Lithuanian jpn-lit 246 4908812
Japanese - Norwegian jpn-nor 1047 15 7341127
Japanese - Ukrainian jpn-ukr 457 21 4579311
Japanese - Vietnamese jpn-vie 1097 585 7050251
Georgian - Russian kat-rus 642 6 1003339
Korean - Chinese kor-zho 411 7031075
Macedonian - Spanish mkd-spa 217 3 9309474
Dutch - Ukrainian nld-ukr 10000 5065 6836455
Norwegian - Norwegian nor-nor 982 272 1504286
Norwegian - Ukrainian nor-ukr 670 5357328
Norwegian - Chinese nor-zho 201 8971831
Portuguese - Tagalog por-tgl 1777 2 2382839
Portuguese - Ukrainian por-ukr 3372 1025 9373491
Russian - Russian rus-rus 2500 1406 3698653
Slovenian - Ukrainian slv-ukr 915 49 6741900
Spanish - Tagalog spa-tgl 631 15 2543036
Swedish - Swedish swe-swe 1022 6434320
Turkish - Ukrainian tur-ukr 2520 6722 5628900
Ukrainian - Chinese ukr-zho 1575 1 3910208