Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BigQueryTask #678

Merged
merged 6 commits into from
Feb 22, 2019
Merged

BigQueryTask #678

merged 6 commits into from
Feb 22, 2019

Conversation

cicdw
Copy link
Member

@cicdw cicdw commented Feb 21, 2019

Thanks for contributing to Prefect!

Please describe your work and make sure your PR:

  • adds new tests (if appropriate)
  • updates CHANGELOG.md (if appropriate)
  • updates docstrings for any new functions or function arguments, including docs/outline.toml for API reference docs (if appropriate)

What does this PR change and why is it important?

Adds a BigQueryTask to the task library and adds an additional google package dependency. At some point we will need to discuss the correct way to handle our packages with testing + documentation.

## check for any argument inconsistencies
if query is None:
raise ValueError("No query provided.")
if sum([dataset_dest is None, table_dest is None]) == 1:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:mind blown:

def __init__(
self,
query: str = None,
query_params: List[tuple] = None, # 3-tuples
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like this arg is unused

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good eye; used now.

@jlowin
Copy link
Member

jlowin commented Feb 22, 2019

@cicdw looking good. What do you think about linking to these docs in the arg docstring for query_parameters? They have a very specific format (and need to be referenced in the query with the @ symbol) so I think point users to a guide would be helpful.

@cicdw
Copy link
Member Author

cicdw commented Feb 22, 2019

@jlowin updated 👍

Copy link
Member

@jlowin jlowin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀

@cicdw cicdw merged commit cb8fe8e into master Feb 22, 2019
@cicdw cicdw deleted the bigquery branch February 22, 2019 17:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants