Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SDK - Components - Creating graph components from python pipeline function #2273

Commits on Sep 28, 2019

  1. SDK/Components - Creating graph components from python pipeline function

    `create_graph_component_from_pipeline_func` converts python pipeline function to a graph component object that can be saved, shared, composed or submitted for execution.
    
    Example:
    
        producer_op = load_component(component_with_0_inputs_and_2_outputs)
        processor_op = load_component(component_with_2_inputs_and_2_outputs)
    
        def pipeline1(pipeline_param_1: int):
            producer_task = producer_op()
            processor_task = processor_op(pipeline_param_1, producer_task.outputs['Output 2'])
    
            return OrderedDict([
                ('Pipeline output 1', producer_task.outputs['Output 1']),
                ('Pipeline output 2', processor_task.outputs['Output 2']),
            ])
    
        graph_component = create_graph_component_from_pipeline_func(pipeline1)
    Ark-kun committed Sep 28, 2019
    Configuration menu
    Copy the full SHA
    7855d02 View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2019

  1. Changed the signatures of exported functions

    Non-public create_graph_component_spec_from_pipeline_func creates ComponentSpec
    Public create_graph_component_from_pipeline_func creates component and writes it to file.
    Ark-kun committed Sep 29, 2019
    Configuration menu
    Copy the full SHA
    a9b120f View commit details
    Browse the repository at this point in the history
  2. Switched to using _extract_component_interface to analyze function si…

    …gnature
    
    Stopped humanizing the input names for now. I think it's benefitial to extract interface from function signature the same way for both container and graph python components.
    Ark-kun committed Sep 29, 2019
    Configuration menu
    Copy the full SHA
    2003ddf View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    dc92137 View commit details
    Browse the repository at this point in the history
  4. Cleaned up the test

    Ark-kun committed Sep 29, 2019
    Configuration menu
    Copy the full SHA
    c034dc2 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    10a0f85 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2019

  1. By default, do not include task component specs in the graph component

    Remove the component spec from component reference unless it will make the reference empty or unless explicitly asked by the user
    Ark-kun committed Oct 1, 2019
    Configuration menu
    Copy the full SHA
    0becc25 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    128cb0d View commit details
    Browse the repository at this point in the history
  3. Fixed imports

    Ark-kun committed Oct 1, 2019
    Configuration menu
    Copy the full SHA
    e410b4d View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2019

  1. Updated the copyright year.

    Ark-kun committed Oct 2, 2019
    Configuration menu
    Copy the full SHA
    1e59cfc View commit details
    Browse the repository at this point in the history