Skip to content

[Draft] Filter images before clustering #858

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 16 commits into
base: deployments/ood.antenna.insectai.org
Choose a base branch
from

Conversation

mihow
Copy link
Collaborator

@mihow mihow commented May 25, 2025

Work by @Yuyan-C

Copy link

netlify bot commented May 25, 2025

Deploy Preview for antenna-preview ready!

Name Link
🔨 Latest commit b42bd72
🔍 Latest deploy log https://app.netlify.com/projects/antenna-preview/deploys/684c65facb31e00008c24909
😎 Deploy Preview https://deploy-preview-858--antenna-preview.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.
Lighthouse
Lighthouse
1 paths audited
Performance: 75 (🔴 down 5 from production)
Accessibility: 89 (no change from production)
Best Practices: 92 (no change from production)
SEO: 100 (no change from production)
PWA: 80 (no change from production)
View the detailed breakdown and full score reports

To edit notification comments on pull requests, go to your Netlify project configuration.

Copy link

netlify bot commented May 25, 2025

Deploy Preview for antenna-ood ready!

Name Link
🔨 Latest commit b42bd72
🔍 Latest deploy log https://app.netlify.com/projects/antenna-ood/deploys/684c65fae0cec300085e3fb8
😎 Deploy Preview https://deploy-preview-858--antenna-ood.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@mihow mihow changed the title [Draft] Incorporate size information into clustering [Draft] Filter images before clustering Jul 7, 2025
@mihow
Copy link
Collaborator Author

mihow commented Jul 7, 2025

I suggest we open a new branch from main and pull in several of these filters for the regular classification task (and keep clustering it's own experimental branch)

Filters:

  • Filter crops that are too small
  • Filter crops that are too blurry
  • Filter crops on the edge

These can be first implemented in a post-processing job, which can be run on existing predictions. It will add a prediction to existing occurrences and update their determination. If the occurrence does not pass the filters, a new prediction should be added "Not identifiable".

Then we can consider when & how it is run in the existing pipeline. I suggest this pattern for all post-processing steps (regional class masking, rank predictions, etc)

After the post-processing implementation, look into adding these filters to the prediction service itself (the AMI Data Companion). And adjust the confidence score or reject the prediction at the source, before sending to Antenna. Do users want to see blurry & small images with low confidence, or do they want them hidden all together? (no classification & not included in response). Or return the unidentifiable image with sore of 0 and taxon "Not identifiable".

@mihow mihow assigned vanessavmac and mihow and unassigned vanessavmac Jul 16, 2025
@mihow mihow added this to the Post Panama feature integration milestone Jul 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants