Adding Omnilingual ASR models

[ebezzam]

What does this PR do?

Adds Omnilingual ASR: https://github.com/facebookresearch/omnilingual-asr

CTC-variant

• functional conversion to checkpoint that is (more) Transformers-compatible: https://huggingface.co/bezzam/omniasr-ctc-300m-v2
• functional modeling (e.g. by trying with example script)
• passing single + batch integration tests

CUDA_VISIBLE_DEVICES=1 RUN_SLOW=1 pytest tests/models/omniasr/test_modeling_omniasr.py::OmniASRForCTCIntegrationTest

LLM-variant

• functional conversion to checkpoint that is (more) Transformers-compatible: https://huggingface.co/bezzam/omniasr-llm-300m-v2
• functional modeling (e.g. by trying with example script)
  • Probably need to define a new processor and tokenizer which can handle the language IDs? And then create a new checkpoint
• passing single + batch integration tests

CUDA_VISIBLE_DEVICES=1 RUN_SLOW=1 pytest tests/models/omniasr/test_modeling_omniasr.py::OmniASRForConditionalGenerationIntegrationTest

When both CTC and LLM-variants working:

• (in progress) prune to essential code paths and config (iteratively update conversion script)
• (in progress) shift into modular file, see what can be reused Wav2Vec2, SeamlessM4T, recent audio LMs
• custom tokenizer? atm using from LasrTokenizer
• full tests

[github-actions]

View the CircleCI Test Summary for this PR:

https://huggingface.co/spaces/transformers-community/circle-ci-viz?pr=43265&sha=96f6b6

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[github-actions]

[For maintainers] Suggested jobs to run (before merge)

run-slow: auto, omniasr

[github-actions]

---

CI recap

Dashboard: View test results in Grafana
Latest run: 28464792218:1
Result: failure | Jobs: 14 | Tests: 116,676 | Failures: 1 | Duration: 20h 1m

Code quality check failed: test jobs were skipped. Fix the code quality issues and push again to run tests.