Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor runner configuration, add labels to dataflow options #718

Merged
merged 4 commits into from
Jun 1, 2020

Conversation

zhilingc
Copy link
Collaborator

What this PR does / why we need it:

Adds option of setting labels for dataflow jobs, and cleans up the job configuration code a bit, also ties the runner configuration classes to the protos. Both runners extend the RunnerConfig class which support conversion of the config fields to beam args.

import java.util.Map;

public abstract class RunnerConfig {
public String[] toArgs() throws IllegalAccessException {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Javadoc pls ☺️

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yessir

@zhilingc zhilingc requested a review from pyalex as a code owner May 29, 2020 02:34
@zhilingc zhilingc added the kind/feature New feature or request label May 29, 2020
@zhilingc zhilingc added the area/ingestion The ingestion Beam component and storage-related items label May 29, 2020
@woop
Copy link
Member

woop commented Jun 1, 2020

/lgtm

@feast-ci-bot feast-ci-bot merged commit f9ce8ee into feast-dev:master Jun 1, 2020
@feast-ci-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: woop, zhilingc

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@woop
Copy link
Member

woop commented Jun 1, 2020

@zhilingc is this going to be backported to 0.5?

khorshuheng pushed a commit to khorshuheng/feast that referenced this pull request Jun 5, 2020
…dev#718)

* Refactor runner configuration, add labels to dataflow options

* Remove util method

* Add javadocs for RunnerConfig class

* Apply spotless
khorshuheng pushed a commit that referenced this pull request Jun 5, 2020
* Refactor runner configuration, add labels to dataflow options

* Remove util method

* Add javadocs for RunnerConfig class

* Apply spotless
zhangchi1 pushed a commit to Cimpress-MCP/feast that referenced this pull request Jun 11, 2020
…dev#718)

* Refactor runner configuration, add labels to dataflow options

* Remove util method

* Add javadocs for RunnerConfig class

* Apply spotless
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved area/ingestion The ingestion Beam component and storage-related items kind/feature New feature or request lgtm size/L
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants