[Feature]: The array attribute of the JSON data type should support intersection queries.

[pofey]

Is there an existing issue for this?

• I have searched the existing issues

Is your feature request related to a problem? Please describe.

json data:
{ "genre": ["comedy", "documentary"] }

I need to query data where the genre includes 'documentary' and 'plot' values, which is currently not supported. However, Pinecone can implement this with the $in keyword.

For example, queries with the following filters will match the vector:
{"genre": {"$in":["documentary","action"]}}

Describe the solution you'd like.

No response

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response

[jiaoew1991]

Hi @pofey Would you like to contribute this feature?

[pofey]

Hi @pofey Would you like to contribute this feature?

I'm sorry, I just stated my needs. Did I choose the wrong category?

[jiaoew1991]

Hi @pofey Would you like to contribute this feature?

I'm sorry, I just stated my needs. Did I choose the wrong category?

Nope, feel free to open issues. we will put the feature in backlog until someone working on it.

[pofey]

Hi @pofey Would you like to contribute this feature?

I'm sorry, I just stated my needs. Did I choose the wrong category?

Nope, feel free to open issues. we will put the feature in backlog until someone working on it.

Thank you for your support. Could I know approximately how long it would take to complete this support?

[jiaoew1991]

The support for the array type is already on the roadmap and is expected to be available in the 2.3.x series around August, If it doesn't go smoothly, it will go to a later version. Functions like intersection and difference will be supported first on the array type.

[xiaofan-luan]

I thought these on two different functionalities?
currently milvus already support json_contains functionalities, I guess it already support contains a list?
@xiaocai2333

[xiaocai2333]

I thought these on two different functionalities? currently milvus already support json_contains functionalities, I guess it already support contains a list? @xiaocai2333

@xiaofan-luan @pofey We currently do not support lists, but this requirement can be converted to json_contains(genre, action) or json_contains(genre, documentary) . Moreover, this feature is only available in version 2.3.

[xiaocai2333]

@xiaofan-luan Additionally, I think that to fulfill this requirement, it would be beneficial to introduce a new function called json_contains_any(array, list or element).

[xiaocai2333]

/assign

[xiaofan-luan]

json_contains_any

Is there a reason json_contains can not cover it?

[xiaocai2333]

json_contains_any

Is there a reason json_contains can not cover it?

It can achieve this functionality by combining json_contains with or. Currently, json_contains does not support elements that are lists, but if necessary, I will prioritize supporting it.