Display low-scoring examples controlling for some other feature

[neubig]

One common use case that I have noticed is

"I want to see examples that are lower-scoring than other examples of similar length"

The reason why this is important is because some metrics are sensitive to the length of the output, so if you select all low-scoring examples you might get all short examples, which is not super-interesting.

Generalizing this a bit, it could be interesting to think of a way to say "I want examples that are low-scoring, controlling for some other feature".

This is relatively easy when controlling for a categorical feature (you could just take all examples in the bottom nth percentile given any particular categorical feature value), but it is somewhat more complicated conceptually when the feature is a float or integer.

[cabreraalex]

You could do this by looking at the table view and sorting by the score value after you have filtered

[neubig]

Nice. It'd also be kinda nice to be able to do this without filtering though. We could brainstorm the details offline sometime.