Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Separate the reading and processing in the IO #544

Closed
Tracked by #547
abelsiqueira opened this issue Mar 14, 2024 · 1 comment · Fixed by #607
Closed
Tracked by #547

Separate the reading and processing in the IO #544

abelsiqueira opened this issue Mar 14, 2024 · 1 comment · Fixed by #607
Assignees
Labels
Type: improvement Better way of doing something Zone: code architecture Changes to the structure or fundamentals

Comments

@abelsiqueira
Copy link
Member

What and Why

Currently, the reading of CSV processes a lot of stuff returning the graph structure, the representative periods structure, and the base periods structure. We should have an intermediate step that just reads the data into dataframes and a second (or more) function(s) will process dataframes into something else.

Things to keep in mind:

  • Reading will move to TulipaIO.jl
  • Many structures will change to DataFrames
  • We want to allow manual input

Possible Drawbacks

No response

Related Issues

No response

@abelsiqueira abelsiqueira added the Type: improvement Better way of doing something label Mar 14, 2024
@abelsiqueira abelsiqueira changed the title Separate the reading and processing in the iO Separate the reading and processing in the IO Mar 14, 2024
@abelsiqueira abelsiqueira added the Zone: code architecture Changes to the structure or fundamentals label Mar 14, 2024
@abelsiqueira abelsiqueira self-assigned this Mar 18, 2024
@clizbe
Copy link
Member

clizbe commented Apr 15, 2024

@suvayu "Data validation of whether columns are correctly named etc should be within TEM, not TIO. And it should be concentrated in one spot in the workflow, not spread out all over the place."

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Type: improvement Better way of doing something Zone: code architecture Changes to the structure or fundamentals
Projects
None yet
2 participants