Streaming asr time stamp

[ezerhouni]

Copy from : #119

[ezerhouni]

@csukuangfj I have this issue when installing :

/sherpa/sherpa/csrc/online_asr.cc:247:29: error: invalid initialization of reference of type ‘const std::vector<int, std::allocator<int> >&’ from expression of type ‘std::vector<std::vector<int, std::allocator<int> > >*’
  247 |                             &all_hyps, &all_num_trailing_blank_frames)

Did you have the fix somewhere or should I take care of it ? (I saw that you made the code)

[csukuangfj]

I see.

The master code:

sherpa/sherpa/csrc/online_asr.cc

Lines 246 to 247 in b163428

	StreamingGreedySearch(*model_, encoder_out, batched_decoder_out,
	&all_hyps, &all_num_trailing_blank_frames)

Code of this PR

sherpa/sherpa/csrc/rnnt_beam_search.cc

Lines 205 to 211 in 8990519

	torch::Tensor StreamingGreedySearch(
	RnntModel &model, // NOLINT
	torch::Tensor encoder_out, torch::Tensor decoder_out,
	const std::vector<int32_t> &frame_offset,
	std::vector<std::vector<int32_t>> *hyps,
	std::vector<int32_t> *num_trailing_blank_frames,
	std::vector<std::vector<int32_t>> *timestamps) {

---

This PR changes the signature of StreamingGreedySearch, so we need to change the places where StreamingGreedySearch is invoked in C++.

[csukuangfj]

online_asr.cc was added after #119 is created. Please change online_asr.cc accordingly. For now, just pass an empty vector to StreamingGreedySearch from online_asr.cc should be fine.

[ezerhouni]

@csukuangfj FYI, there is also frame_offset to set

[ezerhouni]

@csukuangfj Can you have a look ? I think the cpp is broken though, I will try to have a look today

[csukuangfj]

Looks great to me. Thanks for the help.

[csukuangfj]

@csukuangfj Can you have a look ? I think the cpp is broken though, I will try to have a look today

It is just a dummy implementation for the OnlineAsr, but I compiles, I think. What do you mean cpp is broken?

[ezerhouni]

@csukuangfj For the frame_offset in cpp, I just pass empty vector so not sure it produce to correct output (but it compiles)

[csukuangfj]

@csukuangfj For the frame_offset in cpp, I just pass empty vector so not sure it produce to correct output (but it compiles)

The timestamp won't be correct, but it won't affect the recognition results. Since we are not returning the timestamp information in c++, the current dummy implementation should be fine. We can fix it in a separate PR to also return timestamp in c++.

[csukuangfj]

@ezerhouni
Thanks! I am merging it. We can fix the dummy implementation for c++ api in a separate PR.