You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We are currently benchmarking VertexAISearchRetriever against VectorSearchVectorStore
And we are working with document in japanese.
With VectorSearchVectorStore retriever we can retrieve the japanese document without problem,
but when we switch to VertexAISearchRetriever the page content in japanese is in unicode. While in the Vertex ai Search console in GCP we can visualize the document in normal Japanese.
The data store is created with one structuted jsonl file from GCS.
Code example:
query = "how does dior sauvage smell like ?"
retriever = VertexAISearchRetriever(
project_id=PROJECT_ID,
location_id=LOCATION_ID,
data_store_id=DATA_STORE_ID,
max_documents=10,
engine_data_type=1,
)
result = retriever.invoke(query)
for doc in result:
print(doc)
print(type(doc))
print(doc.page_content)
HI,
We are currently benchmarking VertexAISearchRetriever against VectorSearchVectorStore
And we are working with document in japanese.
With VectorSearchVectorStore retriever we can retrieve the japanese document without problem,
but when we switch to VertexAISearchRetriever the page content in japanese is in unicode. While in the Vertex ai Search console in GCP we can visualize the document in normal Japanese.
The data store is created with one structuted jsonl file from GCS.
Code example:
What we retrieve:
Thanks for your help
The text was updated successfully, but these errors were encountered: