Skip to content

Multiclass Classification catalog does not contain EvaluateNonCalibrated #3323

Open
@artidoro

Description

@artidoro

The Multiclass Classification catalog has non calibrated trainers (SdcaNonCalibratedMulticlassTrainer) along with many calibrated trainers.

Currently there is only one Evaluate method, which assumes that the model is calibrated, and therefore produces LogLoss metrics. These metrics don't makes sense for the non calibrated trainers.

We should therefore add an evaluation method named EvaluateNonCalibrated for the non calibrated trainers.

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2Priority of the issue for triage purpose: Needs to be fixed at some point.bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions