You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The train and test data can be read with different TextLoaders, which makes it easy to introduce bugs. If there is a difference in the settings, the metrics are likely to be wrong but there are no errors.
Example:
stringtrainDataPath="sentiment_data.tsv";pipeline.Add(newTextLoader<SentimentData>(trainDataPath,useHeader:true));// Later in the file, after completing the pipeline and training the modelstringtestDataPath="sentiment_test.tsv";vartestData=newTextLoader<SentimentData>(testDataPath,userHeader:true,sep:',');varevaluator=newBinaryClassificationEvaluator();BinaryClassificationMetricsmetrics=evaluator.Evaluate(model,testData);
Evaluating on the test data will result in incorrect metrics as the test file will be parsed incorrectly. However, the experiment runs successfully with no errors, so this might be difficult to detect.