Use size and compression as metrics (original #575)

[obulat]

This issue has been migrated from the CC Search API repository

Author: aldenstpage
Date: Wed Jul 29 2020
Labels: ✨ goal: improvement,🏷 status: label work required,🙅 status: discontinued

Problem

Images with low resolution or high compression sometimes show up in the first page of results, even with popularity boosting.

This issue blocks on consuming outbound data from the web crawler.

Description

We should heavily weigh down results with low resolution and high compression. Both of these metrics can be distilled into a single "quality_penalty" value (high compression OR low resolution will result in higher quality penalties). The thinking here is that small resolution or high compression are strong indicators that an image is not worth showing, but high resolution and low compressibility do not necessarily correlate with relevance.

[sarayourfriend]

This issue might also be a catalogue issue, depending on the process we settle on for general document score calculation. Not pinging the catalogue folks yet because I've pinged them on a few different issues in the last few minutes already for their advice, and we're already discussing something along the lines of what is suggested here as part of the 2023 planning discussion (#343). The correct home and implementation approach for this issue should get settled naturally via that discussion.