-
Notifications
You must be signed in to change notification settings - Fork 1.5k
fix: create file for empty stream #16342
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Maybe add same test for write_parquet and write_json? I think they should have same behavior. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you @chenkovsky -- the only question I have about this PR is how it works when writing partitioned output (aka into a directory).
The only thing I think the PR needs is a test showing what happens when writing to a directory.
I am not 100% sure what the expected behavior would be in this case, and I think either one is probably reasonable.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you @chenkovsky 🙏
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you @chenkovsky
Which issue does this PR close?
Rationale for this change
file won't be created for empty dataframe
What changes are included in this PR?
create file if row number is zero
Are these changes tested?
UT
Are there any user-facing changes?
No