[Bug]: Cannot generate bloom filter (probably due to duplicated entries in the include/exclude data set)

[KevinMind]

What happened?

When creating the bloom base filter, we get this error

This is because the error rate is very disparate causing a lot of false positives and many layers to be created. This is likely due to duplicate entries in the include/exclude list that make the filter inherently non-deterministic.

What did you expect to happen?

It should create the filter, regardless of the number of items.

Is there an existing issue for this?

• I have searched the existing issues

┆Issue is synchronized with this Jira Task