This is the "higher" sub-set of the Tatoeba data. Download the data files from the link in the table below. There is a total of
- 98 language pairs in this sub-set
lang-pair | test | dev | train |
---|---|---|---|
Afrikaans - German afr-deu | 1583 | 1 | 5404300 |
Afrikaans - Dutch afr-nld | 1056 | 4086174 | |
Afrikaans - Russian afr-rus | 228 | 1652781 | |
Afrikaans - Spanish afr-spa | 448 | 2000987 | |
Arabic - Esperanto ara-epo | 753 | 94 | 1234097 |
Azerbaijani - English aze-eng | 2659 | 1012 | 3233365 |
Azerbaijani - Turkish aze-tur | 1150 | 15 | 2598020 |
Belarusian - German bel-deu | 551 | 1 | 1322056 |
Belarusian - English bel-eng | 2500 | 4265 | 3641197 |
Belarusian - Polish bel-pol | 287 | 2948821 | |
Belarusian - Russian bel-rus | 2500 | 2754 | 4782456 |
Belarusian - Ukrainian bel-ukr | 2355 | 1021 | 1816968 |
Breton - English bre-eng | 383 | 1020160 | |
Bulgarian - Esperanto bul-epo | 570 | 1 | 1450480 |
Bulgarian - Japanese bul-jpn | 321 | 2 | 8114217 |
Catalan - German cat-deu | 723 | 2 | 2266984 |
Catalan - Esperanto cat-epo | 772 | 7 | 1217119 |
Catalan - Dutch cat-nld | 578 | 2 | 2036970 |
Catalan - Ukrainian cat-ukr | 456 | 2241110 | |
Cebuano - German ceb-deu | 903 | 1278923 | |
Cebuano - English ceb-eng | 378 | 1279479 | |
Czech - Esperanto ces-epo | 3471 | 1058 | 2124218 |
Czech - Ukrainian ces-ukr | 1787 | 1114 | 7651457 |
Welsh - English cym-eng | 818 | 19 | 2343465 |
Danish - Danish dan-dan | 212 | 4700694 | |
Danish - Esperanto dan-epo | 11069 | 19236 | 1597423 |
Danish - Japanese dan-jpn | 904 | 10 | 8199889 |
German - German deu-deu | 2500 | 2115 | 4574760 |
German - Esperanto deu-epo | 13439 | 221681 | 5266759 |
German - Basque deu-eus | 456 | 1027193 | |
German - Icelandic deu-isl | 969 | 19 | 7534706 |
German - Tagalog deu-tgl | 326 | 3265457 | |
Modern Greek (1453-) - Esperanto ell-epo | 604 | 5 | 1610179 |
English - Irish eng-gle | 1913 | 27 | 4076822 |
English - Armenian eng-hye | 1121 | 1000 | 1393027 |
English - Iloko eng-ilo | 1093 | 1000 | 1259734 |
English - Javanese eng-jav | 262 | 2 | 1993438 |
English - Georgian eng-kat | 984 | 18 | 2026943 |
English - Kazakh eng-kaz | 403 | 3 | 1060530 |
English - Latin eng-lat | 10298 | 14036 | 1103779 |
English - Luxembourgish eng-ltz | 293 | 4 | 9546015 |
English - Malayalam eng-mal | 802 | 9071279 | |
English - Marathi eng-mar | 10396 | 43058 | 4475328 |
English - Maltese eng-mlt | 203 | 1 | 8482666 |
English - Occitan (post 1500) eng-oci | 841 | 1532613 | |
English - Swahili (macrolanguage) eng-swa | 387 | 3 | 9366710 |
English - Tamil eng-tam | 311 | 9461564 | |
English - Telugu eng-tel | 261 | 1089331 | |
English - Tagalog eng-tgl | 2500 | 4796 | 8656962 |
English - Urdu eng-urd | 1663 | 1 | 8949903 |
Esperanto - Persian epo-fas | 2514 | 7430 | 1137027 |
Esperanto - Finnish epo-fin | 2862 | 1047 | 1534419 |
Esperanto - French epo-fra | 12168 | 287548 | 5959738 |
Esperanto - Serbo-Croatian epo-hbs | 2500 | 2802 | 2612660 |
Esperanto - Hebrew epo-heb | 10368 | 19607 | 1255873 |
Esperanto - Hungarian epo-hun | 10094 | 28756 | 1613081 |
Esperanto - Italian epo-ita | 10303 | 40619 | 3027527 |
Esperanto - Lithuanian epo-lit | 11511 | 10429 | 1093148 |
Esperanto - Dutch epo-nld | 12841 | 80837 | 2619413 |
Esperanto - Norwegian epo-nor | 3158 | 1011 | 1594667 |
Esperanto - Romanian epo-ron | 3820 | 1319 | 1757517 |
Esperanto - Slovenian epo-slv | 302 | 1 | 1280982 |
Esperanto - Spanish epo-spa | 10735 | 65096 | 6339446 |
Esperanto - Swedish epo-swe | 1757 | 68 | 2197206 |
Esperanto - Ukrainian epo-ukr | 2500 | 4559 | 1111500 |
Finnish - Finnish fin-fin | 1000 | 349 | 6186357 |
Finnish - Japanese fin-jpn | 9934 | 10917 | 8394554 |
Finnish - Korean fin-kor | 422 | 5290932 | |
French - Occitan (post 1500) fra-oci | 806 | 1135954 | |
French - Tagalog fra-tgl | 836 | 3423526 | |
Hebrew - Ukrainian heb-ukr | 966 | 10 | 3464693 |
Hindi - Urdu hin-urd | 240 | 2 | 1743382 |
Hindi - Chinese hin-zho | 324 | 1 | 3253101 |
Hungarian - Japanese hun-jpn | 2499 | 3660 | 9245122 |
Hungarian - Korean hun-kor | 271 | 5989312 | |
Hungarian - Ukrainian hun-ukr | 473 | 3 | 6090583 |
Icelandic - Italian isl-ita | 236 | 3421479 | |
Icelandic - Spanish isl-spa | 238 | 4407442 | |
Italian - Ukrainian ita-ukr | 5000 | 8775 | 6367168 |
Japanese - Lithuanian jpn-lit | 246 | 4908812 | |
Japanese - Norwegian jpn-nor | 1047 | 15 | 7341127 |
Japanese - Ukrainian jpn-ukr | 457 | 21 | 4579311 |
Japanese - Vietnamese jpn-vie | 1097 | 585 | 7050251 |
Georgian - Russian kat-rus | 642 | 6 | 1003339 |
Korean - Chinese kor-zho | 411 | 7031075 | |
Macedonian - Spanish mkd-spa | 217 | 3 | 9309474 |
Dutch - Ukrainian nld-ukr | 10000 | 5065 | 6836455 |
Norwegian - Norwegian nor-nor | 982 | 272 | 1504286 |
Norwegian - Ukrainian nor-ukr | 670 | 5357328 | |
Norwegian - Chinese nor-zho | 201 | 8971831 | |
Portuguese - Tagalog por-tgl | 1777 | 2 | 2382839 |
Portuguese - Ukrainian por-ukr | 3372 | 1025 | 9373491 |
Russian - Russian rus-rus | 2500 | 1406 | 3698653 |
Slovenian - Ukrainian slv-ukr | 915 | 49 | 6741900 |
Spanish - Tagalog spa-tgl | 631 | 15 | 2543036 |
Swedish - Swedish swe-swe | 1022 | 6434320 | |
Turkish - Ukrainian tur-ukr | 2520 | 6722 | 5628900 |
Ukrainian - Chinese ukr-zho | 1575 | 1 | 3910208 |