List of languages in development

[rkcosmos]

I will update/edit this issue to track development process of new language. The current list is

Group 1 (Arabic script)

• Arabic (DONE, August, 5 2020)
• Uyghur (DONE, August, 5 2020)
• Persian (DONE, August, 5 2020)
• Urdu (DONE, August, 5 2020)

Group 2 (Latin script)

• Serbian-latin (DONE, July,12 2020)
• Occitan (DONE, July,12 2020)

Group 3 (Devanagari)

• Hindi (DONE, July,24 2020)
• Marathi (DONE, July,24 2020)
• Nepali (DONE, July,24 2020)
• Rajasthani (NEED HELP)
• Awadhi, Haryanvi, Sanskrit (if possible)

Group 4 (Cyrillic script)

• Russian (DONE, July,29 2020)
• Serbian-cyrillic (DONE, July,29 2020)
• Bulgarian (DONE, July,29 2020)
• Ukranian (DONE, July,29 2020)
• Mongolian (DONE, July,29 2020)
• Belarusian (DONE, July,29 2020)
• Tajik (DONE, April,20 2021)
• Kyrgyz (NEED HELP)

Group 5

• Telugu (DONE, November,17 2020)
• Kannada (DONE, November,17 2020)

Group 6 (Language that doesn't share characters with others)

• Tamil (DONE, August, 10 2020)
• Hebrew (ready to train)
• Malayalam (ready to train)
• Bengali + Assamese (DONE, August, 23 2020)
• Punjabi (ready to train)
• Abkhaz (ready to train)

Group 7 (Improvement and possible extra models)

• Japanese version 2 (DONE, March, 21 2021)+ vertical text
• Chinese version2 (DONE, March, 21 2021)+ vertical text
• Korean version 2(DONE, March, 21 2021)
• Latin version 2 (DONE, March, 21 2021)
• Math + Greek?
• Number+symbol only

Guideline for new language request

To request a new language support, I need you to send a PR with 2 following files

1. In folder easyocr/character, we need 'yourlanguagecode_char.txt' that contains list of all characters. Please see format/example from other files in that folder.
2. In folder easyocr/dict, we need 'yourlanguagecode.txt' that contains list of words in your language. On average we have ~30000 words per language with more than 50000 words for popular one. More is better in this file.

If your language has unique elements (such as 1. Arabic: characters change form when attach to each other + write from right to left 2. Thai: Some characters need to be above the line and some below), please educate me with your best ability and/or give useful links. It is important to take care of the detail to achieve a system that really works.

Lastly, please understand that my priority will have to go to popular language or set of languages that share most of characters together (also tell me if your language share a lot of characters with other). It takes me at least a week to work for new model. You may have to wait a while for new model to be released.

[yossibiton]

Why won't you share the training code, so people could train the model by themself ?

[madrugado]

For group 4 you could add Ukrainian, Bulgarian, and may be Mongolian, although it is not Slavic it uses Cyrillic script.

[edloginova]

Do you plan to only work with human languages? It would be amazing to add a model to recognize mathematical formulas.

[manohar-cyber]

I guess Tamil, Telugu can be added to one group because they belongs to a language group called 'Dravidian'. Meaning they relate to each other in terms of grammar, word arrangement.Two other popular( in India) language, which belong to that family can also be added to that group— Kannada and Malayalam (For further info— https://en.m.wikipedia.org/wiki/Dravidian_languages). Moreover Telugu and kannada share some common alphabets and words. I will be adding alphabet and words of kannada language for language request.
Great project, keep it up👍

[bgmastermind]

For Group 4
Bulgarian
dict bg.txt
char bg_char.txt

[upadhyayprakash]

I'd highly recomend supporting Devanagiri Script (Wiki - https://en.wikipedia.org/wiki/Devanagari), which is the fourth most widely adopted writing system in the world. Please go through the wikipedia link to understand its wide spread usage across most Ancient Languages including Sanskrit, Hindi, Marathi, Awadhi, Haryanvi.

I see you have included "Hindi" as a target language, which of course, is the most spoken language in the Indian Subcontinent.

If you could let me know what's the current word-count you have (maybe share the "dict" & "alphabets" directory), I can continue with the research to share more details about the Language as it's my First Language.

Hindi has 47 primary alphabets (including 14 Vowels & 33 Consonants).

You can contact me @ prakash.upadhyay93@yahoo.com

[arashjafari]

Can i help for the Persian (Farsi) language ? I can supply some popular words and characters

@rkcosmos

[junaidgirkar]

Can i contribute in any way. I am fluent in Hindi alongside English. Also I may be of help in the programming section. I know Python, C and Java in languages. Am good in front-end with HTML, CSS and JavaScript (basic).

[manmeet3591]

I recommend adding Punjabi language which is the 10th most spoken language around the world.
pb_char.txt

[rkcosmos]

@edloginova After doing human language, we can explore math as well.

@upadhyayprakash Lists are here easyocr/character and easyocr/dict

@arashjafari looks like we already have both words and char. You can recheck if everything is alright.

@junaidgirkar sounds good, I'll keep in mind. May call you for help.

[Vijayabhaskar96]

Why won't you share the training code, so people could train the model by themself ?

I agree with this, If the training code and sample dataset are provided, many can train the model for their language. With free GPU services like Google colab and Kaggle Kernels, anyone can train them online and contribute much faster.

[rkcosmos]

Why won't you share the training code, so people could train the model by themself ?

@yossibiton @Vijayabhaskar96 because it's still not straightforward training process. Even I have to think carefully when creating model. Will share later when it's clean. Please don't pressure me, I am doing a lot of work for free.