-
Notifications
You must be signed in to change notification settings - Fork 906
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
kedro.io.CSVS3DataSet does not use load_args #2
Comments
Hey @Lucianois - you can submit code snippets using "```" like so. From the example you have submitted, it's not clear if you have applied the correct |
@tsanikgr already identified the problem. |
Thanks for the comment @Pet3ris! And, @Lucianois, thank you so much for submitting this issue and for the updated the comment. We have a fix for this that we're about to push through. |
Description
When to loading a dataframe from S3, the arguments used are the default, instead of the configured under load_args on the catalog.yml
Context
Trying to load CSV from S3 with custom load_args
Steps to Reproduce
XXX.csv.s3:
type: CSVS3DataSet # https://kedro.readthedocs.io/en/latest/kedro.io.CSVS3DataSet.html
load_args: # https://pandas.pydata.org/pandas-docs/stable/generated/pandas.read_csv.html
sep: '\t'
encoding: "ISO-8859-1"
Create pipeline to display data in XXX.csv.s3
example:
node(
read_display,
["XXX.csv.s3"],
None
)
Expected Result
Data should be split by tab
Actual Result
Data is loaded without custom sep.
Your Environment
Include as many relevant details about the environment you experienced the bug in
DOES NOT HAPPEN in KEDRO v0.13.1.dev53
Checklist
Include labels so that we can categorise your issue
The text was updated successfully, but these errors were encountered: