AutoML Ranking Error: "RankingMetrics Not Implemented"

[jwood803]

When running the Ranking AutoML experiment on this data from the Ranking sample, I seem to get a Metric Microsoft.ML.Data.RankingMetrics not implemented error during the Execute method.

I'm probably doing something wrong but I'm not sure what I'm missing.

var context = new MLContext();

var data = context.Data.LoadFromTextFile<RankingData>("./ranking.tsv", separatorChar: '\t');

var settings = new RankingExperimentSettings
{
      MaxExperimentTimeInSeconds = 300,
      OptimizingMetric = RankingMetric.Ndcg
};

var experiment = context.Auto().CreateRankingExperiment(settings);

var results = experiment.Execute(data);

Here's the full code, if needed.

[mstfbl]

Hi @jwood803,

Thank you for notifying us of this bug where RankingMetrics was not supported for cross validation AutoML experiments. I've opened PR #5386 to remedy this. This issue will be closed when the PR is merged.

[jwood803]

@mstfbl Just tried again with the 1.5.2 release and all looks great! Thank you for looking at and fixing this!