-
Notifications
You must be signed in to change notification settings - Fork 1.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Added ONNX export support and tests for {FixedPlatt, Naive}CalibratorEstimators #5289
Added ONNX export support and tests for {FixedPlatt, Naive}CalibratorEstimators #5289
Conversation
Codecov Report
@@ Coverage Diff @@
## master #5289 +/- ##
========================================
Coverage 73.79% 73.80%
========================================
Files 1022 1022
Lines 190490 190617 +127
Branches 20484 20488 +4
========================================
+ Hits 140571 140677 +106
- Misses 44395 44418 +23
+ Partials 5524 5522 -2
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
{ | ||
// Initialize variables needed for the ONNX conversion test | ||
var (mlContext, dataView, estimators, initialPipeline) = GetEstimatorsForOnnxConversionTests(); | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sorry, you might have just introduced a bug here. The mlContext returned from GetEstimatorsForOnnxConversionTests
is now different from the MLContext used to create the calibrator. Either you should fix GetEstimatorsForOnnxConversionTests
to use the MLContext
from the base class or pass it in as a param to this function like I mentioned in my earlier comment.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you for the heads up, I have removed the usage of MLContext
in these tests in lieu of ML.
/azp run |
Azure Pipelines successfully started running 2 pipeline(s). |
Partial Fix for #5277
Added ONNX export support for the Naive calibrator estimator. FixedPlatt calibrator estimator can already be exported as it is deriving from Platt calibrator, which is also already supported.
Also added unit tests to check ONNX export for FixedPlatt and Naive calibrator estimators. Specifically, I have consolidated the separate unit tests of calibrators with/without standard date and binary prediction trainers into 1 unit test per calibrator.
ONNX export support for
IsotonicCalibratorEstimator
will come in a separate PR.