Adds support for YAML file to pyflyte run

[kumare3]

Tracking issue

flyteorg/flyte#5365

Why are the changes needed?

To pass a yaml | json file

What changes were proposed in this pull request?

You can now pass all inputs as yaml optionally using the flag --flyte-inputs-file . It can also be a json

 pyflyte run exhaustive.py t1 --flyte-inputs-file t.yaml

Also it is possible to override certain parameters in the input file using additional args, like so

pyflyte run exhaustive.py t1 --flyte-inputs-file t.yaml --f 4.0 --e green

For the interface

@task
def t1(i: int, f: float, s: str, foo: Foo, ff: FlyteFile, fd: FlyteDirectory, e: Color, l: typing.List[int], d: typing.Dict[str, int], b: bool, j: typing.Optional[int] = None):
    pass

The yaml file t.yaml is like this

i: 10
f: 1.0
s: "hello"
foo:
  i: 10
ff: /tmp/remote.py
fd: /tmp
e: red
l:
 - 1
 - 2
 - 4
d:
  x: 1
  y: 2
b: false

TODO:

• unit tests

[samhita-alla]

can you remove this?

[kumare3]

Haha ya

[kumare3]

lets raise an exception here - maybe of type click.BadParameterException ?

[mao3267]

Do you mean changing the secho lines (line 797 - 803) to something like this?

raise click.BadParameter(
    message=f"Could not load the inputs file. Please make sure it is a valid JSON or YAML file."
    f"\n json error: {e},"
    f"\n yaml error: {yaml_e}",
    param_hint="--flyte-inputs-file",
)

[kumare3]

yes

[kumare3]

Couple small nits, then lets ship it. Also can you please add some unit tests? cc @mao3267. I want to get this commit in quickly. Adding unit tests, especially the example I have and maybe another nested JSON example will help

[thomasjpfan]

At this point, we are already running pyflyte run .... Can the option be called --inputs-file?

[mao3267]

Couple small nits, then lets ship it. Also can you please add some unit tests? cc @mao3267. I want to get this commit in quickly. Adding unit tests, especially the example I have and maybe another nested JSON example will help

Some unit tests are added in #2552 . Does the test_all_types_with_file_input in tests/flytekit/unit/cli/pyflyte/test_run.py look good? Currently it's tested on the existed workflow my_wf with json file and pipe as inputs to check if it supports all kinds of inputs. Maybe add a yaml one?

[kumare3]

I see that this was already merged. I am closing the PR.
we need docs for this.
cc @mao3267 can you help with the docs?
cc @neverett fyi