[Runtime][Pipeline Executor] Add the map logic of global input and subgraph input.

[huajsj]

User can use "global input name" to feed input data for pipeline runtime. The name like
"data_a" will be mapped into a input interface of subgraph. In this PR, we
create the related logic to do the following things.

1. building the input map configuration
2. in runtime c++ module, parseing the input connection configuration then
   creating related data structure to record the said connection map.
3. providing the function to return the map information for verification.

Thanks for contributing to TVM! Please refer to guideline https://tvm.apache.org/docs/contribute/ for useful information and tips. After the pull request is submitted, please request code reviews from Reviewers by @ them in the pull request thread.

[liangfu]

Thanks for the update @huajsj , I have left additional change requests, otherwise good to me.

[huajsj]

Thanks @liangfu, all review comments addressed, please take a look.

[huajsj]

all review comments addressed, thanks @liangfu.

[liangfu]

Thanks for contributing and the updates @huajsj. This is now merged.

[HungYangChang]

Hello @huajsj

I have questions regarding how to set continuous stream inputs into the pipeline module.
In your example, there are continuous stream inputs (input1 ~ input4, ...) that are fed into the pipeline module.

In the test_pipeline_executor.py, I noticed there is set_input function to set input data.

pipeline_module_test.set_input("data_a", data)
pipeline_module_test.set_input("data_b", data)
input_data = pipeline_module_test.get_input("data_a")
tvm.testing.assert_allclose(data, input_data.numpy())
# Running the pipeline executor in sequential mode.
pipeline_module_test.run(True)

As far as I understand, multiple inputs are essential to utilize the advantage of pipeline executor.
However, it seems like it only feeds single input instead of multiple stream inputs.
I am wondering in your pipeline implementation, do you have any codes to support such multiple stream inputs feeding?

Thanks :)

[HungYangChang]

This is a follow-up question from the last question.

After re-reading your code

I notice you created data as batch data for pipeline computation and feed data into the pipeline module.

However, from my understanding, It looks like 5 multiple stream inputs are fed to the pipeline module one by one, and each of them runs in sequential mode as the below figure shown.

I think this implementation is different from what you claim in your example (running in pipeline format).

I am wondering do I misunderstand anything?
Or when pipeline_module_test.run("False"). Does it mean the pipeline executor executes these 5 multiple stream inputs one by one in pipeline format to utilize the advantage of the pipeline executor?