end-to-end tests

[aniketmaurya]

Add end-to-end tests for:

• dynamic Batching - addressed by fix: default unbatch always generator #68
• Dynamic batching with streaming - addressed by fix: default unbatch always generator #68
• single prediction add readme improvements #70
• single streaming add e2e test for simple streaming server #247

[imsiddhant07]

Hi @aniketmaurya wanted to confirm the scope of contribution here.

With reference to

Dynamic batching with streaming - addressed by #68

I can see there was _unbatch_no_stream() unbatch() methods added to LitAPI() along with tests.

Is a similar contribution expected for single streaming as well, i.e. methods in LitAPI class as well as tests under e2e.

[aniketmaurya]

hi @imsiddhant07! No it's not required to add anything in LitAPI. In the PR that you mentioned, the test was just a by-product.

TLDR; only e2e test is required.

[AdolfoVillalobos]

Hello! I submitted #247 to handle a single streaming case. I hope I understood the case correctly. Let me know If I got something wrong please ;)