Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support default values in typing.List[dataclass] and typing.Dict[str, dataclass] #2603

Merged
merged 53 commits into from
Aug 26, 2024
Merged

Support default values in typing.List[dataclass] and typing.Dict[str, dataclass] #2603

merged 53 commits into from
Aug 26, 2024

Commits on Aug 2, 2024

  1. fix: set dataclass member as optional if default value is provided 

    Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @mao3267
    mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    cf8567c View commit details
    Browse the repository at this point in the history

  2. lint 

    Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @mao3267
    mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    d33fae2 View commit details
    Browse the repository at this point in the history

  3. feat: handle nested dataclass conversion in JsonParamType 

    Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @mao3267
    mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    958d6dc View commit details
    Browse the repository at this point in the history

  4. fix: handle errors caused by NoneType default value 

    Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @mao3267
    mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    5e2dd6e View commit details
    Browse the repository at this point in the history

  5. test: add nested dataclass unit tests 

    Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @mao3267
    mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    06097a9 View commit details
    Browse the repository at this point in the history

  6. Sagemaker dict determinism (flyteorg#2597) 

    * truncate sagemaker agent outputs

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix tests and update agent output

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* lint

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix test

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* add idempotence token to workflow

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix type

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix mixin

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* modify output handler

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* make the dictionary deterministic

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* nit

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

---------

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @samhita-alla @mao3267
    samhita-alla authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    f20b466 View commit details
    Browse the repository at this point in the history

  7. refactor(core): Enhance return type extraction logic (flyteorg#2598) 

    Signed-off-by: Kevin Su <pingsutw@apache.org>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @pingsutw @mao3267
    pingsutw authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    2672d24 View commit details
    Browse the repository at this point in the history

  8. Feat: Make exception raised by external command authenticator more ac… 

    …tionable (flyteorg#2594)

Signed-off-by: Fabio Grätz <fabiogratz@googlemail.com>
Co-authored-by: Fabio Grätz <fabiogratz@googlemail.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @fg91 @mao3267
    2 people authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    0e1dae1 View commit details
    Browse the repository at this point in the history

  9. Fix: Properly re-raise non-grpc exceptions during refreshing of proxy… 

    …-auth credentials in auth interceptor (flyteorg#2591)

Signed-off-by: Fabio Grätz <fabiogratz@googlemail.com>
Co-authored-by: Fabio Grätz <fabiogratz@googlemail.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @fg91 @mao3267
    2 people authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    73a90e4 View commit details
    Browse the repository at this point in the history

  10. validate idempotence token length in subsequent tasks (flyteorg#2604) 

    * validate idempotence token length in subsequent tasks

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* remove redundant param

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* add tests

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

---------

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @samhita-alla @mao3267
    samhita-alla authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    e838dae View commit details
    Browse the repository at this point in the history

  11. Add nvidia-l4 gpu accelerator (flyteorg#2608) 

    Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @eapolinario @mao3267
    2 people authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    537a3d7 View commit details
    Browse the repository at this point in the history

  12. eliminate redundant literal conversion for Iterator[JSON] type (fly… 

    …teorg#2602)

* eliminate redundant literal conversion for  type

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* add test

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* lint

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* add isclass check

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

---------

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @samhita-alla @mao3267
    samhita-alla authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    ac4be0e View commit details
    Browse the repository at this point in the history

  13. [FlyteSchema] Fix numpy problems (flyteorg#2619) 

    Signed-off-by: Future-Outlier <eric901201@gmail.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @Future-Outlier @mao3267
    Future-Outlier authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    45b04a6 View commit details
    Browse the repository at this point in the history

  14. add nim plugin (flyteorg#2475) 

    * add nim plugin

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* move nim to inference

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* import fix

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix port

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* add pod_template method

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* add containers

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* update

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* clean up

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* remove cloud import

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix extra config

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* remove decorator

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* add tests, update readme

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* add env

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* add support for lora adapter

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* minor fixes

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* add startup probe

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* increase failure threshold

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* remove ngc secret group

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* move plugin to flytekit core

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix docs

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* remove hf group

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* modify podtemplate import

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix import

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix ngc api key

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix tests

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix formatting

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* lint

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* docs fix

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* docs fix

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* update secrets interface

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* add secret prefix

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* fix tests

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* add urls

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* add urls

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* remove urls

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* minor modifications

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* remove secrets prefix; add failure threshold

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* add hard-coded prefix

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* add comment

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* make secrets prefix a required param

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* move nim to flytekit plugin

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* update readme

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* update readme

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

* update readme

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>

---------

Signed-off-by: Samhita Alla <aallasamhita@gmail.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @samhita-alla @mao3267
    samhita-alla authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    39f2635 View commit details
    Browse the repository at this point in the history

  15. [Elastic/Artifacts] Pass through model card (flyteorg#2575) 

    Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @wild-endeavor @mao3267
    wild-endeavor authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    357877f View commit details
    Browse the repository at this point in the history

  16. Remove pyarrow as a direct dependency (flyteorg#2228) 

    Signed-off-by: Thomas J. Fan <thomasjpfan@gmail.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @thomasjpfan @mao3267
    thomasjpfan authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    758736f View commit details
    Browse the repository at this point in the history

  17. Boolean flag to show local container logs to the terminal (flyteorg#2521 

    )

Signed-off-by: aditya7302 <aditya7302@gmail.com>
Signed-off-by: Kevin Su <pingsutw@apache.org>
Co-authored-by: Kevin Su <pingsutw@apache.org>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @aditya7302 @pingsutw @mao3267
    2 people authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    25381ce View commit details
    Browse the repository at this point in the history

  18. Enable Ray Fast Register (flyteorg#2606) 

    Signed-off-by: Jan Fiedler <jan@union.ai>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @fiedlerNr9 @mao3267
    fiedlerNr9 authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    dc575e4 View commit details
    Browse the repository at this point in the history

  19. [Artifacts/Elastic] Skip partitions (flyteorg#2620) 

    Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @wild-endeavor @mao3267
    wild-endeavor authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    87bfcc7 View commit details
    Browse the repository at this point in the history

  20. Install flyteidl from master in plugins tests (flyteorg#2621) 

    Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @eapolinario @mao3267
    2 people authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    5614fe3 View commit details
    Browse the repository at this point in the history

  21. Using ParamSpec to show underlying typehinting (flyteorg#2617) 

    Signed-off-by: JackUrb <jack@datologyai.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @JackUrb @mao3267
    JackUrb authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    1d25882 View commit details
    Browse the repository at this point in the history

  22. Support ArrayNode mapping over Launch Plans (flyteorg#2480) 

    * set up array node

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* wip array node task wrapper

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* support function like callability

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* temp check in some progress on python func wrapper

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* only support launch plans in new array node class for now

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* add map task array node implementation wrapper

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* ArrayNode only supports LPs for now

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* support local execute for new array node implementation

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* add local execute unit tests for array node

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* set exeucution version in array node spec

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* check input types for local execute

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* remove code that is un-needed for now

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* clean up array node class

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* improve naming

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* clean up

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* utilize enum execution mode to set array node execution path

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* default execution mode to FULL_STATE for new array node class

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* support min_successes for new array node

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* add map task wrapper unit test

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* set min successes for array node map task wrapper

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* update docstrings

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* Install flyteidl from master in plugins tests

Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>

* lint

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* clean up min success/ratio setting

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* lint

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

* make array node class callable

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>

---------

Signed-off-by: Paul Dittamo <pvdittamo@gmail.com>
Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @pvditt @eapolinario @mao3267
    2 people authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    e6606ff View commit details
    Browse the repository at this point in the history

  23. Richer printing for some artifact objects (flyteorg#2624) 

    Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @wild-endeavor @mao3267
    wild-endeavor authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    20c8250 View commit details
    Browse the repository at this point in the history

  24. ci: Add Python 3.9 to build matrix (flyteorg#2622) 

    Signed-off-by: Kevin Su <pingsutw@apache.org>
Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Signed-off-by: Future-Outlier <eric901201@gmail.com>
Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: Future-Outlier <eric901201@gmail.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @pingsutw @eapolinario
    @Future-Outlier @mao3267
    3 people authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    2ef9b08 View commit details
    Browse the repository at this point in the history

  25. bump (flyteorg#2627) 

    Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @wild-endeavor @mao3267
    wild-endeavor authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    83b2638 View commit details
    Browse the repository at this point in the history

  26. Added alt prefix head to FlyteFile.new_remote (flyteorg#2601) 

    * Added alt prefix head to FlyteFile.new_remote

Signed-off-by: pryce-turner <pryce.turner@gmail.com>

* Added get_new_path method to FileAccessProvider, fixed new_remote method of FlyteFile

Signed-off-by: pryce-turner <pryce.turner@gmail.com>

* Updated tests and added new path creator to FlyteFile/Dir new_remote methods

Signed-off-by: pryce-turner <pryce.turner@gmail.com>

* Improved docstrings, fixed minor path sep bug, more descriptive naming, better test

Signed-off-by: pryce-turner <pryce.turner@gmail.com>

* Formatting

Signed-off-by: pryce-turner <pryce.turner@gmail.com>

---------

Signed-off-by: pryce-turner <pryce.turner@gmail.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @pryce-turner @mao3267
    pryce-turner authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    414052a View commit details
    Browse the repository at this point in the history

  27. Feature gate for FlyteMissingReturnValueException (flyteorg#2623) 

    Signed-off-by: Kevin Su <pingsutw@apache.org>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @pingsutw @mao3267
    pingsutw authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    1e7bfbe View commit details
    Browse the repository at this point in the history

  28. Remove use of multiprocessing from the OAuth client (flyteorg#2626) 

    * Remove use of multiprocessing from the OAuth client

Signed-off-by: Robert Deaton <robert.deaton@freenome.com>

* Lint

Signed-off-by: Robert Deaton <robert.deaton@freenome.com>

---------

Signed-off-by: Robert Deaton <robert.deaton@freenome.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @rdeaton-freenome @mao3267
    rdeaton-freenome authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    9129608 View commit details
    Browse the repository at this point in the history

  29. Update codespell in precommit to version 2.3.0 (flyteorg#2630) 

    Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @eapolinario @mao3267
    eapolinario authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    9895b28 View commit details
    Browse the repository at this point in the history

  30. Fix Snowflake Agent Bug (flyteorg#2605) 

    * fix snowflake agent bug

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* a work version

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* Snowflake work version

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* fix secret encode

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* all works, I am so happy

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* improve additional protocol

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* fix tests

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* Fix Tests

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* update agent

Signed-off-by: Kevin Su <pingsutw@apache.org>

* Add snowflake test

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* sd

Signed-off-by: Kevin Su <pingsutw@apache.org>

* snowflake loglinks

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* add metadata

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* secret

Signed-off-by: Kevin Su <pingsutw@apache.org>

* nit

Signed-off-by: Kevin Su <pingsutw@apache.org>

* remove table

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* add comment for get private key

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* update comments:

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* Fix Tests

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* update comments

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* update comments

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* Better Secrets

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* use union secret

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* Update Changes

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* use if not get_plugin().secret_requires_group()

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* Use Union SDK

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* Update

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* Fix Secrets

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* Fix Secrets

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* remove pacakge.json

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* lint

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* add snowflake-connector-python

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* fix test_snowflake

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* Try to fix tests

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* fix tests

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* Try Fix snowflake Import

Signed-off-by: Future-Outlier <eric901201@gmail.com>

* snowflake test passed

Signed-off-by: Future-Outlier <eric901201@gmail.com>

---------

Signed-off-by: Future-Outlier <eric901201@gmail.com>
Signed-off-by: Kevin Su <pingsutw@apache.org>
Co-authored-by: Kevin Su <pingsutw@apache.org>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @Future-Outlier @pingsutw @mao3267
    2 people authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    89ba90f View commit details
    Browse the repository at this point in the history

  31. run test_missing_return_value on python 3.10+ (flyteorg#2637) 

    Signed-off-by: Kevin Su <pingsutw@apache.org>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @pingsutw @mao3267
    pingsutw authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    399e19e View commit details
    Browse the repository at this point in the history

  32. [Elastic] Fix context usage and apply fix to fork method (flyteorg#2628) 

    Signed-off-by: Yee Hing Tong <wild-endeavor@users.noreply.github.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @wild-endeavor @mao3267
    wild-endeavor authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    c95b987 View commit details
    Browse the repository at this point in the history

  33. Add flytekit-omegaconf plugin (flyteorg#2299) 

    * add flytekit-hydra

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* fix small typo readme

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* ruff ruff

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* lint more

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* rename plugin into flytekit-omegaconf

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* lint sort imports

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* use flytekit logger

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* use flytekit logger flyteorg#2

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* fix typing info in is_flatable

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* use default_factory instead of mutable default value

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* add python3.11 and python3.12 to setup.py

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* make fmt

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* define error message only once

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* add docstring

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* remove GenericEnumTransformer and tests

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* fallback to TypeEngine.get_transformer(node_type) to find suitable transformer

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* explicit valueerrors instead of asserts

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* minor style improvements

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* remove obsolete warnings

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* import flytekit logger instead of instantiating our own

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* docstrings in reST format

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* refactor transformer mode

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* improve docs

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* refactor dictconfig class into smaller methods

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* add unit tests for dictconfig transformer

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* refactor of parse_type_description()

Signed-off-by: mg515 <miha.garafolj@gmail.com>

* add omegaconf plugin to pythonbuild.yaml

---------

Signed-off-by: mg515 <miha.garafolj@gmail.com>
Signed-off-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Co-authored-by: Eduardo Apolinario <eapolinario@users.noreply.github.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @mg515 @eapolinario @mao3267
    2 people authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    b5e1a33 View commit details
    Browse the repository at this point in the history

  34. Adds extra-index-url to default image builder (flyteorg#2636) 

    Signed-off-by: Thomas J. Fan <thomasjpfan@gmail.com>
Co-authored-by: Kevin Su <pingsutw@apache.org>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @thomasjpfan @pingsutw @mao3267
    2 people authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    d6bcde5 View commit details
    Browse the repository at this point in the history

  35. reference_task should inherit from PythonTask (flyteorg#2643) 

    Signed-off-by: Kevin Su <pingsutw@apache.org>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @pingsutw @mao3267
    pingsutw authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    8ff53b9 View commit details
    Browse the repository at this point in the history

  36. Fix Get Agent Secret Using Key (flyteorg#2644) 

    Signed-off-by: Future-Outlier <eric901201@gmail.com>
Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @Future-Outlier @mao3267
    Future-Outlier authored and mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    0b48963 View commit details
    Browse the repository at this point in the history

  37. fix: prevent converting Flyte types as custom dataclasses 

    Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @mao3267
    mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    17fa0a6 View commit details
    Browse the repository at this point in the history

  38. fix: add None to output type 

    Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @mao3267
    mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    c01b0f6 View commit details
    Browse the repository at this point in the history

  39. Merge remote-tracking branch 'origin' into handle-dataclass-default-v… 

    …alue

Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @mao3267
    mao3267 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    8fa9a04 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2024

  1. Merge branch 'master' of https://github.com/mao3267/flytekit into han… 

    …dle-dataclass-default-value
    @mao3267
    mao3267 committed Aug 9, 2024
    Configuration menu
    Copy the full SHA
    a6232a4 View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2024

  1. test: add unit test for nested dataclass inputs 

    Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @mao3267
    mao3267 committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    64cc5b8 View commit details
    Browse the repository at this point in the history

  2. test: add unit tests for nested dataclass, dataclass default value as… 

    … None, and flyte type exceptions

Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @mao3267
    mao3267 committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    30d1222 View commit details
    Browse the repository at this point in the history

  3. fix: handle NoneType as default value of list type dataclass members 

    Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @mao3267
    mao3267 committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    c285e34 View commit details
    Browse the repository at this point in the history

  4. fix: add comments for has_nested_dataclass function 

    Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @mao3267
    mao3267 committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    4d2646c View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2024

  1. fix: make lint 

    Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @mao3267
    mao3267 committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    9de3f07 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of https://github.com/mao3267/flytekit into han… 

    …dle-dataclass-default-value
    @mao3267
    mao3267 committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    ec7ae5e View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2024

  1. Merge remote-tracking branch 'origin' into handle-dataclass-default-v… 

    …alue
    @mao3267
    mao3267 committed Aug 25, 2024
    Configuration menu
    Copy the full SHA
    6013ad1 View commit details
    Browse the repository at this point in the history

  2. fix: update tests regarding input through file and pipe 

    Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @mao3267
    mao3267 committed Aug 25, 2024
    Configuration menu
    Copy the full SHA
    b0162cd View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' of https://github.com/mao3267/flytekit into han… 

    …dle-dataclass-default-value
    @mao3267
    mao3267 committed Aug 25, 2024
    Configuration menu
    Copy the full SHA
    d2ecd1f View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2024

  1. Make JsonParamType convert faster 

    Signed-off-by: Future-Outlier <eric901201@gmail.com>
    @Future-Outlier
    Future-Outlier committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    7db88f3 View commit details
    Browse the repository at this point in the history

  2. make has_nested_dataclass func more clean and add tests for dataclass… 

    …_with_optional_fields

Signed-off-by: Future-Outlier <eric901201@gmail.com>
    @Future-Outlier
    Future-Outlier committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    27fc2d1 View commit details
    Browse the repository at this point in the history

  3. make logic more backward compatible 

    Signed-off-by: Future-Outlier <eric901201@gmail.com>
    @Future-Outlier
    Future-Outlier committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    9f09010 View commit details
    Browse the repository at this point in the history

  4. fix: handle indexing errors in dict/list while checking nested datacl… 

    …ass, add comments

Signed-off-by: mao3267 <chenvincent610@gmail.com>
    @mao3267
    mao3267 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    cd8877f View commit details
    Browse the repository at this point in the history