Add fast_beam_search_nbest for streaming pruned rnn-t

[ezerhouni]

No description provided.

[ezerhouni]

@csukuangfj It is not done yet. However, I did some refactoring to have a clearer way to pass parameter to beam search. Please let me know what you think about it. Then I will add the same changes (if you agree) to the other models.

[ezerhouni]

@csukuangfj The doc is not update, I will do so, if you agree with the changes

[csukuangfj]

Thanks!

The refactoring looks good to me.

[csukuangfj]

@ezerhouni
Could you fix the CI errors?

FYI: You can re-trigger the CI by removing the label ready and re-add it after pushing new commits.

https://github.com/k2-fsa/sherpa/runs/7502556741?check_suite_focus=true

Traceback (most recent call last):
  File "./sherpa/bin/pruned_stateless_emformer_rnnt2/streaming_server.py", line 43, in <module>
    from beam_search import FastBeamSearch, GreedySearch, ModifiedBeamSearch
  File "/home/runner/work/sherpa/sherpa/sherpa/bin/pruned_stateless_emformer_rnnt2/beam_search.py", line 7, in <module>
    from sherpa import (
  File "/opt/hostedtoolcache/Python/3.7.13/x64/lib/python3.7/site-packages/k2_sherpa-0.6-py3.7-linux-x86_64.egg/sherpa/__init__.py", line 23, in <module>
    from .decode import (
  File "/opt/hostedtoolcache/Python/3.7.13/x64/lib/python3.7/site-packages/k2_sherpa-0.6-py3.7-linux-x86_64.egg/sherpa/decode.py", line 21, in <module>
    from icefall.decode import Nbest
ModuleNotFoundError: No module named 'icefall'

[ezerhouni]

@ezerhouni Could you fix the CI errors?

FYI: You can re-trigger the CI by removing the label ready and re-add it after pushing new commits.

https://github.com/k2-fsa/sherpa/runs/7502556741?check_suite_focus=true

Traceback (most recent call last):
  File "./sherpa/bin/pruned_stateless_emformer_rnnt2/streaming_server.py", line 43, in <module>
    from beam_search import FastBeamSearch, GreedySearch, ModifiedBeamSearch
  File "/home/runner/work/sherpa/sherpa/sherpa/bin/pruned_stateless_emformer_rnnt2/beam_search.py", line 7, in <module>
    from sherpa import (
  File "/opt/hostedtoolcache/Python/3.7.13/x64/lib/python3.7/site-packages/k2_sherpa-0.6-py3.7-linux-x86_64.egg/sherpa/__init__.py", line 23, in <module>
    from .decode import (
  File "/opt/hostedtoolcache/Python/3.7.13/x64/lib/python3.7/site-packages/k2_sherpa-0.6-py3.7-linux-x86_64.egg/sherpa/decode.py", line 21, in <module>
    from icefall.decode import Nbest
ModuleNotFoundError: No module named 'icefall'

I add icefall as a dependency in the CI. I restarted the workflow. Let see

[ezerhouni]

@csukuangfj any idea why the CI jobs are queued for more than an hour now ?

[csukuangfj]

@csukuangfj any idea why the CI jobs are queued for more than an hour now ?

Now, it is started. For each test, if there are more than two jobs, I just canceled all but the latest one.

[ezerhouni]

@csukuangfj I think the CI passed. Is it good to go ?

[ezerhouni]

Merging it then. Thanks @csukuangfj for your review

[csukuangfj]

Thanks!