Require test manifest path for running tests

[tianleh]

Is your feature request related to a problem? Please describe

#604

Describe the solution you'd like

require test manifest path for running tests

Describe alternatives you've considered

No response

Additional context

No response

[tianleh]

Also move the test manifest files from src to manifests

[dblock]

@tianleh No need to make new issues for things you're already putting PRs up for or very close to :) less work for you

[tianleh]

Thanks for the suggestion. I originally created this issue because the effort seemed non-trivial. Also I am keeping practicing my ability to realize such phased changes in advance. With such tracking (or "backfilling") exercise, I can always look back later as self retrospective of task breakdown when I need to create tasks for a group of engineers.

If it is the label "untriaged" which may attract the team' attention to groom the issue, I can quickly remove such label post creation.

[tianleh]

I have been maintaining the overall picture of the task breakdown in this issue #604 (scroll down a bit from the top)