ORTOptimizer for wav2vec2-bert

[aconeil]

Feature request

This is a request to make the ORTOptimizer available for wav2vec2-bert.

Motivation

Currently when trying to convert a fine-tuned wav2vec2-bert model to an optimized onnx model, the following error is raised:
NotImplementedError: Tried to use ORTOptimizer for the model type wav2vec2-bert, but it is not available yet. Please open an issue or submit a PR at https://github.com/huggingface/optimum.

Your contribution

I am fairly new to the world of ONNX models, but willing to help by answering any questions about the issue.

[IlyasMoutawwakil]

please open a PR to add support for optimizing the model, it is as simple as adding it here:
https://github.com/huggingface/optimum/blob/main/optimum/onnxruntime/utils.py#L112
and testing it of course.

The idea is that onnxruntime provides a set of optimizations for some specific models and we apply them on similar models. I guess in this case ("wav2vec2-bert") a similar model is "bert", so its optimization should be applied.