model monitoring

[isabelizimm]

issue for tracking purposes 🥳

main monitoring functions

• vetiver.compute_metrics
• vetiver.pin_metrics
• vetiver.plot_metrics

[machow]

From pairing it sounds like the main piece left is vetiver.pin_metrics. Leaving some extra notes here.

vetiver compute metrics

R

• the grain seems to be .index and .metric
• .index - the rolled up date used
• .n - number of rows used in rollup
• .metric - name of metric (from hardhat)
• .estimator - kind of metric (from hardhat. e.g. standard for continuous variables? other values are "binary", etc..)

python

[juliasilge]

This looks like it is done to me! 👀 Is it ready to be closed?

[isabelizimm]

yes! closed with #82 and #76