Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Snowflake delta support #138

Merged
merged 2 commits into from
Sep 21, 2022
Merged

Conversation

aPeterHeise
Copy link
Contributor

Description & motivation

Added support for delta lake as described in #137

Added table_format option to be used with Delta.
Added documentation for Delta lake
@aPeterHeise
Copy link
Contributor Author

See here for feature description.

@aPeterHeise
Copy link
Contributor Author

Hi @jtcohen6 , how can I convince you to accept this PR? ;-)

@sdrzymala
Copy link

Hi @jtcohen6 ,
There is more people and teams actually waiting for that PR. Any particular reason why it shouldn't be closed? Anyhow thanks a lot for your time! And big kudos to @aPeterHeise !

@pgoslatara
Copy link
Contributor

@jtcohen6 Can this PR get some love please? Currently using this fix at a client so would be great to get it onto main.

@jeremyyeo
Copy link
Collaborator

Hey @aPeterHeise, thanks for the contribution - sorry for the delay here.

Just looking over this and looks straight forward and the docs here seem to suggest that AUTO_REFRESH needs to be FALSE when table format is delta?

Jerco tested this out and found that indeed that Snowflake does raise an error if we have a wrong combination:

"SQL compilation error: invalid property combination 'AUTO_REFRESH'='true' and 'TABLE_FORMAT'='delta'"

We don't have a way to test this in CI right now but this change looks good.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants