Skip to content
This repository was archived by the owner on Jun 3, 2025. It is now read-only.

[MLOps 1.5] Autogenerate data logging configs from the registry#867

Merged
dbogunowicz merged 94 commits intomainfrom
feature/damian/config_generation
Feb 3, 2023
Merged

[MLOps 1.5] Autogenerate data logging configs from the registry#867
dbogunowicz merged 94 commits intomainfrom
feature/damian/config_generation

Conversation

@dbogunowicz
Copy link
Copy Markdown
Contributor

@dbogunowicz dbogunowicz commented Jan 19, 2023

Feature Preview:

string_result = data_logging_config_from_predefined(
        group_names="image_classification",
        frequency=2
        loggers={"some_logger": {"arg_1": 10}},
    )

outputs:

loggers:
  python: null

data_logging:
  pipeline_outputs.labels:
  - func: predicted_classes
    frequency: 1
  - func: predicted_top_score
    frequency: 1
  pipeline_inputs.images:
  - func: image_shape
    frequency: 1
  - func: mean_pixels_per_channel
    frequency: 1
  - func: std_pixels_per_channel
    frequency: 1
  - func: fraction_zeros
    frequency: 1

Description

Introduces a new helper function, data_logging_config_from_predefined, that generates data logging configurations using metric group names and optional arguments. The function enables developers to quickly generate examples of data logging configurations, as demonstrated in the examples/data-logging-configs directory.

This PR includes comprehensive testing and features a test that, when run with the appropriate environment variable, can regenerate a fresh set of examples. This functionality is useful for maintaining up-to-date configurations as the log structure evolves over time. :

GENERATE_CONFIGS=1 pytest tests/deepsparse/loggers/metric_functions/helpers/test_data_config_from_predefined.py 

bogunowicz@arrival.com and others added 30 commits January 9, 2023 13:03
…ne' into feature/damian/refactor_function_logger
Co-authored-by: Benjamin Fineran <bfineran@users.noreply.github.com>
Base automatically changed from feature/damian/refactor_function_logger to main January 26, 2023 14:28
@dbogunowicz dbogunowicz changed the base branch from main to feature/damian/deco January 27, 2023 16:00
Base automatically changed from feature/damian/deco to main January 30, 2023 14:03
Copy link
Copy Markdown
Contributor

@corey-nm corey-nm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the yamls look good to me!

@dbogunowicz dbogunowicz merged commit 0b5887f into main Feb 3, 2023
@dbogunowicz dbogunowicz deleted the feature/damian/config_generation branch February 3, 2023 14:43
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants