You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Rename field_data_types to sdtypes in the update methods
In the update method, accept a dictionary with param name column_name_to_sdtype
Always let the user know that the transformer will change based on the new updated sdtype
# updating the sdtype of a single column>>>ht.update_sdtypes(column_name_to_sdtype={
'colA': 'categorical'
})
Info: Thetransformersforthesecolumnsmaychangebasedonthenewsdtypes.
Use'get_config()'toverifythetransformers.
# updating the sdtypes of multiple columns>>>ht.update_sdtypes(column_name_to_sdtype={
'colA': 'categorical',
'colB': 'categorical',
'colC': 'categorical',
})
Info: Thetransformersforthesecolumnsmaychangebasedonthenewsdtypes.
Use'get_config()'toverifythetransformers.
Edge cases
Scenario 1: User tries to get or update the types without using auto_detect_config (see #399 )
>>>ht=HyperTransformer()
>>>ht.get_sdtypes()
{}
Tip: Usethe`detect_initial_config`methodtopre-populateallthesdtypesandtransformersfromyourdataset.
# this will still work but will print out a tip>>>ht.update_sdtypes(column_name_to_sdtype={
'colA': 'categorical'
})
Tip: Usethe`detect_initial_config`methodtopre-populateallthesdtypesandtransformersfromyourdataset.
Scenario 2: User updates the types after calling fit or fit_transform on the data already.
npatki
changed the title
Improve getting and updating field_data_types in HyperTransformer
Improve updating field_data_types in HyperTransformerMar 2, 2022
Expected behavior
field_data_types
tosdtypes
in the update methodscolumn_name_to_sdtype
sdtype
Edge cases
Scenario 1: User tries to get or update the types without using
auto_detect_config
(see #399 )Scenario 2: User updates the types after calling
fit
orfit_transform
on the data already.Scenario 3: User tries to add in a type that is not available on open source
The text was updated successfully, but these errors were encountered: