You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, the data loader adds new keys to the data attributes to store common metadata like sample temperature.
For instance, if an endstation stores the sample temperature in the "TB" attribute, we would add a new key "temp_sample" to the attributes and copy the value. This results in duplicate attributes with same value but different name, which can be confusing.
Possible solution
We could try to preserve the original attributes.
The steps are:
Add a mapping to the loader.
Upon loading the data, just add one attribute that stores the name of the loader the data was loaded with.
Write an accessor that can get the mapping from the loader, and return the corresponding value dynamically.
Some expected problems with this approach:
A loader update with breaking changes may break existing analysis code
Alternatives
No response
Additional context
No response
The text was updated successfully, but these errors were encountered:
In this approach, major changes to the loader may break existing code and saved data. It would be better to retain the current way of storing the data, and just add an accessor for convenience.
Things to consider:
What do we need in the accessor?
Hard to generalize, must provide per-loader customization
Similar to creating a summary dataset, although this currently requires manual effort
Are we OK with current attribute names? They may be confusing, i.e., temperature is temp_sample but work function is sample_workfunction...
Description
Currently, the data loader adds new keys to the data attributes to store common metadata like sample temperature.
For instance, if an endstation stores the sample temperature in the
"TB"
attribute, we would add a new key"temp_sample"
to the attributes and copy the value. This results in duplicate attributes with same value but different name, which can be confusing.Possible solution
We could try to preserve the original attributes.
The steps are:
Some expected problems with this approach:
Alternatives
No response
Additional context
No response
The text was updated successfully, but these errors were encountered: