[Bug] DataPrep llama-index api failing

[ezelanza]

Priority

P1-Stopper

OS type

Ubuntu

Hardware type

Xeon-GNR

Installation method

• Pull docker images from hub.docker.com
• Build docker images from source
• Other
• N/A

Deploy method

• Docker
• Docker Compose
• Kubernetes Helm Charts
• Kubernetes GMC
• Other
• N/A

Running nodes

Single Node

What's the version?

1.3

The Dataprep image has errors when running Docker Compose (I tried with agentQnA on Xeon and ChatQnA on Xeon too)

Description

llama-index dependency error

Reproduce steps

docker compose up -d (On ChatQnA and AgentQnA)

Raw log

docker compose up -d
 ✔ Container redis-vector-db         Healthy                                                                                                                                                                           0.5s 
 ✔ Container tei-embedding-server    Running                                                                                                                                                                           0.0s 
 ✔ Container tei-reranking-server    Running                                                                                                                                                                           0.0s 
 ✔ Container retriever-redis-server  Running                                                                                                                                                                           0.0s 
 ✘ Container dataprep-redis-server   Error                                                                                                                                                                             4.5s 
 ⠙ Container vllm-service            Waiting

logs dataprep-redis-server
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing LLMChain from langchain root module is no longer supported. Please use langchain.chains.LLMChain instead.
  warnings.warn(
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing PromptTemplate from langchain root module is no longer supported. Please use langchain_core.prompts.PromptTemplate instead.
  warnings.warn(
Traceback (most recent call last):
  File "/home/user/comps/dataprep/src/opea_dataprep_microservice.py", line 14, in <module>
    from integrations.neo4j_llamaindex import OpeaNeo4jLlamaIndexDataprep
  File "/home/user/comps/dataprep/src/integrations/neo4j_llamaindex.py", line 33, in <module>
    from llama_index.llms.openai import OpenAI
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/__init__.py", line 2, in <module>
    from llama_index.llms.openai.responses import OpenAIResponses
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/responses.py", line 6, in <module>
    from openai.types.responses import (
ImportError: cannot import name 'ResponseTextAnnotationDeltaEvent' from 'openai.types.responses' (/usr/local/lib/python3.11/site-packages/openai/types/responses/__init__.py)
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing LLMChain from langchain root module is no longer supported. Please use langchain.chains.LLMChain instead.
  warnings.warn(
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing PromptTemplate from langchain root module is no longer supported. Please use langchain_core.prompts.PromptTemplate instead.
  warnings.warn(
Traceback (most recent call last):
  File "/home/user/comps/dataprep/src/opea_dataprep_microservice.py", line 14, in <module>
    from integrations.neo4j_llamaindex import OpeaNeo4jLlamaIndexDataprep
  File "/home/user/comps/dataprep/src/integrations/neo4j_llamaindex.py", line 33, in <module>
    from llama_index.llms.openai import OpenAI
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/__init__.py", line 2, in <module>
    from llama_index.llms.openai.responses import OpenAIResponses
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/responses.py", line 6, in <module>
    from openai.types.responses import (
ImportError: cannot import name 'ResponseTextAnnotationDeltaEvent' from 'openai.types.responses' (/usr/local/lib/python3.11/site-packages/openai/types/responses/__init__.py)
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing LLMChain from langchain root module is no longer supported. Please use langchain.chains.LLMChain instead.
  warnings.warn(
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing PromptTemplate from langchain root module is no longer supported. Please use langchain_core.prompts.PromptTemplate instead.
  warnings.warn(
Traceback (most recent call last):
  File "/home/user/comps/dataprep/src/opea_dataprep_microservice.py", line 14, in <module>
    from integrations.neo4j_llamaindex import OpeaNeo4jLlamaIndexDataprep
  File "/home/user/comps/dataprep/src/integrations/neo4j_llamaindex.py", line 33, in <module>
    from llama_index.llms.openai import OpenAI
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/__init__.py", line 2, in <module>
    from llama_index.llms.openai.responses import OpenAIResponses
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/responses.py", line 6, in <module>
    from openai.types.responses import (
ImportError: cannot import name 'ResponseTextAnnotationDeltaEvent' from 'openai.types.responses' (/usr/local/lib/python3.11/site-packages/openai/types/responses/__init__.py)
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing LLMChain from langchain root module is no longer supported. Please use langchain.chains.LLMChain instead.
  warnings.warn(
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing PromptTemplate from langchain root module is no longer supported. Please use langchain_core.prompts.PromptTemplate instead.
  warnings.warn(
Traceback (most recent call last):
  File "/home/user/comps/dataprep/src/opea_dataprep_microservice.py", line 14, in <module>
    from integrations.neo4j_llamaindex import OpeaNeo4jLlamaIndexDataprep
  File "/home/user/comps/dataprep/src/integrations/neo4j_llamaindex.py", line 33, in <module>
    from llama_index.llms.openai import OpenAI
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/__init__.py", line 2, in <module>
    from llama_index.llms.openai.responses import OpenAIResponses
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/responses.py", line 6, in <module>
    from openai.types.responses import (
ImportError: cannot import name 'ResponseTextAnnotationDeltaEvent' from 'openai.types.responses' (/usr/local/lib/python3.11/site-packages/openai/types/responses/__init__.py)
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing LLMChain from langchain root module is no longer supported. Please use langchain.chains.LLMChain instead.
  warnings.warn(
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing PromptTemplate from langchain root module is no longer supported. Please use langchain_core.prompts.PromptTemplate instead.
  warnings.warn(
Traceback (most recent call last):
  File "/home/user/comps/dataprep/src/opea_dataprep_microservice.py", line 14, in <module>
    from integrations.neo4j_llamaindex import OpeaNeo4jLlamaIndexDataprep
  File "/home/user/comps/dataprep/src/integrations/neo4j_llamaindex.py", line 33, in <module>
    from llama_index.llms.openai import OpenAI
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/__init__.py", line 2, in <module>
    from llama_index.llms.openai.responses import OpenAIResponses
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/responses.py", line 6, in <module>
    from openai.types.responses import (
ImportError: cannot import name 'ResponseTextAnnotationDeltaEvent' from 'openai.types.responses' (/usr/local/lib/python3.11/site-packages/openai/types/responses/__init__.py)
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing LLMChain from langchain root module is no longer supported. Please use langchain.chains.LLMChain instead.
  warnings.warn(
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing PromptTemplate from langchain root module is no longer supported. Please use langchain_core.prompts.PromptTemplate instead.
  warnings.warn(
Traceback (most recent call last):
  File "/home/user/comps/dataprep/src/opea_dataprep_microservice.py", line 14, in <module>
    from integrations.neo4j_llamaindex import OpeaNeo4jLlamaIndexDataprep
  File "/home/user/comps/dataprep/src/integrations/neo4j_llamaindex.py", line 33, in <module>
    from llama_index.llms.openai import OpenAI
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/__init__.py", line 2, in <module>
    from llama_index.llms.openai.responses import OpenAIResponses
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/responses.py", line 6, in <module>
    from openai.types.responses import (
ImportError: cannot import name 'ResponseTextAnnotationDeltaEvent' from 'openai.types.responses' (/usr/local/lib/python3.11/site-packages/openai/types/responses/__init__.py)
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing LLMChain from langchain root module is no longer supported. Please use langchain.chains.LLMChain instead.
  warnings.warn(
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing PromptTemplate from langchain root module is no longer supported. Please use langchain_core.prompts.PromptTemplate instead.
  warnings.warn(
Traceback (most recent call last):
  File "/home/user/comps/dataprep/src/opea_dataprep_microservice.py", line 14, in <module>
    from integrations.neo4j_llamaindex import OpeaNeo4jLlamaIndexDataprep
  File "/home/user/comps/dataprep/src/integrations/neo4j_llamaindex.py", line 33, in <module>
    from llama_index.llms.openai import OpenAI
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/__init__.py", line 2, in <module>
    from llama_index.llms.openai.responses import OpenAIResponses
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/responses.py", line 6, in <module>
    from openai.types.responses import (
ImportError: cannot import name 'ResponseTextAnnotationDeltaEvent' from 'openai.types.responses' (/usr/local/lib/python3.11/site-packages/openai/types/responses/__init__.py)
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing LLMChain from langchain root module is no longer supported. Please use langchain.chains.LLMChain instead.
  warnings.warn(
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing PromptTemplate from langchain root module is no longer supported. Please use langchain_core.prompts.PromptTemplate instead.
  warnings.warn(
Traceback (most recent call last):
  File "/home/user/comps/dataprep/src/opea_dataprep_microservice.py", line 14, in <module>
    from integrations.neo4j_llamaindex import OpeaNeo4jLlamaIndexDataprep
  File "/home/user/comps/dataprep/src/integrations/neo4j_llamaindex.py", line 33, in <module>
    from llama_index.llms.openai import OpenAI
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/__init__.py", line 2, in <module>
    from llama_index.llms.openai.responses import OpenAIResponses
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/responses.py", line 6, in <module>
    from openai.types.responses import (
ImportError: cannot import name 'ResponseTextAnnotationDeltaEvent' from 'openai.types.responses' (/usr/local/lib/python3.11/site-packages/openai/types/responses/__init__.py)
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing LLMChain from langchain root module is no longer supported. Please use langchain.chains.LLMChain instead.
  warnings.warn(
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing PromptTemplate from langchain root module is no longer supported. Please use langchain_core.prompts.PromptTemplate instead.
  warnings.warn(
Traceback (most recent call last):
  File "/home/user/comps/dataprep/src/opea_dataprep_microservice.py", line 14, in <module>
    from integrations.neo4j_llamaindex import OpeaNeo4jLlamaIndexDataprep
  File "/home/user/comps/dataprep/src/integrations/neo4j_llamaindex.py", line 33, in <module>
    from llama_index.llms.openai import OpenAI
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/__init__.py", line 2, in <module>
    from llama_index.llms.openai.responses import OpenAIResponses
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/responses.py", line 6, in <module>
    from openai.types.responses import (
ImportError: cannot import name 'ResponseTextAnnotationDeltaEvent' from 'openai.types.responses' (/usr/local/lib/python3.11/site-packages/openai/types/responses/__init__.py)
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing LLMChain from langchain root module is no longer supported. Please use langchain.chains.LLMChain instead.
  warnings.warn(
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing PromptTemplate from langchain root module is no longer supported. Please use langchain_core.prompts.PromptTemplate instead.
  warnings.warn(
Traceback (most recent call last):
  File "/home/user/comps/dataprep/src/opea_dataprep_microservice.py", line 14, in <module>
    from integrations.neo4j_llamaindex import OpeaNeo4jLlamaIndexDataprep
  File "/home/user/comps/dataprep/src/integrations/neo4j_llamaindex.py", line 33, in <module>
    from llama_index.llms.openai import OpenAI
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/__init__.py", line 2, in <module>
    from llama_index.llms.openai.responses import OpenAIResponses
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/responses.py", line 6, in <module>
    from openai.types.responses import (
ImportError: cannot import name 'ResponseTextAnnotationDeltaEvent' from 'openai.types.responses' (/usr/local/lib/python3.11/site-packages/openai/types/responses/__init__.py)
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing LLMChain from langchain root module is no longer supported. Please use langchain.chains.LLMChain instead.
  warnings.warn(
/usr/local/lib/python3.11/site-packages/langchain/__init__.py:30: UserWarning: Importing PromptTemplate from langchain root module is no longer supported. Please use langchain_core.prompts.PromptTemplate instead.
  warnings.warn(
Traceback (most recent call last):
  File "/home/user/comps/dataprep/src/opea_dataprep_microservice.py", line 14, in <module>
    from integrations.neo4j_llamaindex import OpeaNeo4jLlamaIndexDataprep
  File "/home/user/comps/dataprep/src/integrations/neo4j_llamaindex.py", line 33, in <module>
    from llama_index.llms.openai import OpenAI
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/__init__.py", line 2, in <module>
    from llama_index.llms.openai.responses import OpenAIResponses
  File "/usr/local/lib/python3.11/site-packages/llama_index/llms/openai/responses.py", line 6, in <module>
    from openai.types.responses import (
ImportError: cannot import name 'ResponseTextAnnotationDeltaEvent' from 'openai.types.responses' (/usr/local/lib/python3.11/site-packages/openai/types/responses/__init__.py)

Attachments

No response

[yinghu5]

Hi @letonghan
Could you please help to check the issue, may related to opea-project/GenAIComps#1735 and opea-project/GenAIComps#1737 as llama-index version changed, thank you!

[yinghu5]

Hi @ezelanza
Thank you a lot for reporting the issue. It should caused by llama-index version and fixed by opea-project/GenAIComps#1752
could you please try the latest version and see if the issue is resolved?