[Bug]: ragflow-server can't connect to es01

[LIUyizheSDU]

Self Checks

• I have searched for existing issues search for existing issues, including closed ones.
• I confirm that I am using English to submit this report (Language Policy).
• Non-english title submitions will be closed directly ( 非英文标题的提交将会被直接关闭 ) (Language Policy).
• Please do not modify this template :) and fill in all the required fields.

RAGFlow workspace code commit ID

d0eda83

RAGFlow image version

v0.17.2

Other environment information

Actual behavior

The ragflow-server cant connect to es01。

ragflow-server logs:

`2025-03-17 20:40:26,733 INFO 19 ragflow_server log path: /ragflow/logs/ragflow_server.log, log levels: {'peewee': 'WARNING', 'pdfminer': 'WARNING', 'root': 'INFO'}
2025-03-17 20:40:34,396 INFO 19 init database on cluster mode successfully
2025-03-17 20:40:47,892 INFO 19
____ ___ ______ ______ __
/ __ \ / | / // // / _ __
/ // // /| | / / __ / / / // __ | | /| / /
/ , // ___ |/ // // __/ / // // /| |/ |/ /
// ||// ||_/// // _/ |/|__/

2025-03-17 20:40:47,892 INFO 19 RAGFlow version: v0.17.2 full
2025-03-17 20:40:47,892 INFO 19 project base: /ragflow
2025-03-17 20:40:47,893 INFO 19 Current configs, from /ragflow/conf/service_conf.yaml:
ragflow: {'host': '0.0.0.0', 'http_port': 9380}
mysql: {'name': 'rag_flow', 'user': 'root', 'password': '', 'host': 'mysql', 'port': 3306, 'max_connections': 100, 'stale_timeout': 30}
minio: {'user': 'rag_flow', 'password': '', 'host': 'minio:9000'}
es: {'hosts': 'http://es01:9200', 'username': 'elastic', 'password': ''}
infinity: {'uri': 'infinity:23817', 'db_name': 'default_db'}
redis: {'db': 1, 'password': '', 'host': 'redis:6379'}
2025-03-17 20:40:47,893 INFO 19 Use Elasticsearch http://es01:9200 as the doc engine.
2025-03-17 20:42:58,620 INFO 19 GET http://es01:9200/ [status:N/A duration:130.725s]
2025-03-17 20:42:58,620 WARNING 19 Node <Urllib3HttpNode(http://es01:9200)> has failed for 1 times in a row, putting on 1 second timeout
2025-03-17 20:42:58,620 WARNING 19 Connection timed out. Waiting Elasticsearch http://es01:9200 to be healthy.
2025-03-17 20:43:56,648 INFO 16 ragflow_server log path: /ragflow/logs/ragflow_server.log, log levels: {'peewee': 'WARNING', 'pdfminer': 'WARNING', 'root': 'INFO'}`

task_executor logs:
`2025-03-17 20:41:02,483 INFO 34 task_consumer_0 log path: /ragflow/logs/task_consumer_0.log, log levels: {'peewee': 'WARNING', 'pdfminer': 'WARNING', 'root': 'INFO'}
2025-03-17 20:41:02,484 INFO 34

---

/_ /_ / / / / _____ _______ / / _____
/ / / __ `/ / /// / __/ | |// _ / / / / / __/ __ / /
/ / / // ( ) ,< / /> </ / // // / // // / /
// _,///|| /_____//||_/_/_,/_/___//

2025-03-17 20:41:02,485 INFO 34 TaskExecutor: RAGFlow version: v0.17.2 full
2025-03-17 20:41:02,485 INFO 34 Use Elasticsearch http://es01:9200 as the doc engine.
2025-03-17 20:43:12,955 INFO 34 GET http://es01:9200/ [status:N/A duration:130.469s]
2025-03-17 20:43:12,956 WARNING 34 Node <Urllib3HttpNode(http://es01:9200)> has failed for 1 times in a row, putting on 1 second timeout
2025-03-17 20:43:12,956 WARNING 34 Connection timed out. Waiting Elasticsearch http://es01:9200 to be healthy.
2025-03-17 20:44:35,868 INFO 29 task_consumer_0 log path: /ragflow/logs/task_consumer_0.log, log levels: {'peewee': 'WARNING', 'pdfminer': 'WARNING', 'root': 'INFO'}
2025-03-17 20:44:35,869 INFO 29

---

/_ /_ / / / / _____ _______ / / _____
/ / / __ `/ / /// / __/ | |// _ / / / / / __/ __ / /
/ / / // ( ) ,< / /> </ / // // / // // / /
// _,///|| /_____//||_/_/_,/_/___//

2025-03-17 20:44:35,869 INFO 29 TaskExecutor: RAGFlow version: v0.17.2 full
2025-03-17 20:44:35,870 INFO 29 Use Elasticsearch http://es01:9200 as the doc engine.
2025-03-17 20:46:45,948 INFO 29 GET http://es01:9200/ [status:N/A duration:130.077s]
2025-03-17 20:46:45,948 WARNING 29 Node <Urllib3HttpNode(http://es01:9200)> has failed for 1 times in a row, putting on 1 second timeout
2025-03-17 20:46:45,948 WARNING 29 Connection timed out. Waiting Elasticsearch http://es01:9200 to be healthy.
2025-03-17 20:49:01,116 INFO 29 GET http://es01:9200/ [status:N/A duration:130.161s]
2025-03-17 20:49:01,116 WARNING 29 Node <Urllib3HttpNode(http://es01:9200)> has failed for 1 times in a row, putting on 1 second timeout
2025-03-17 20:49:01,116 WARNING 29 Connection timed out. Waiting Elasticsearch http://es01:9200 to be healthy.
2025-03-17 20:49:06,122 INFO 29 Resurrected node <Urllib3HttpNode(http://es01:9200)> (force=False)
2025-03-17 20:51:16,284 INFO 29 HEAD http://es01:9200/ [status:N/A duration:130.161s]
2025-03-17 20:51:16,284 WARNING 29 Node <Urllib3HttpNode(http://es01:9200)> has failed for 2 times in a row, putting on 2 second timeout
2025-03-17 20:51:16,284 ERROR 29 Elasticsearch http://es01:9200 is unhealthy in 120s.
2025-03-17 20:51:51,267 INFO 540 task_consumer_0 log path: /ragflow/logs/task_consumer_0.log, log levels: {'peewee': 'WARNING', 'pdfminer': 'WARNING', 'root': 'INFO'}
2025-03-17 20:51:51,268 INFO 540 `

running docker exec ragflow-server curl -v http://es01:9200 , output
% Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0* Trying 172.18.0.2:9200... 0 0 0 0 0 0 0 0 --:--:-- 0:01:07 --:--:-- 0

Expected behavior

No response

Steps to reproduce

follows readme,output different when run' docker logs -f ragflow-server '。

Additional information

No response

[LIUyizheSDU]

sorry for my poor description

[CaffreyChen2095]

Upload your service_conf.yaml file

[LIUyizheSDU]

ragflow:
  host: ${RAGFLOW_HOST:-0.0.0.0}
  http_port: 9380
mysql:
  name: '${MYSQL_DBNAME:-rag_flow}'
  user: '${MYSQL_USER:-root}'
  password: '${MYSQL_PASSWORD:-infini_rag_flow}'
  host: '${MYSQL_HOST:-mysql}'
  port: 3306
  max_connections: 100
  stale_timeout: 30
minio:
  user: '${MINIO_USER:-rag_flow}'
  password: '${MINIO_PASSWORD:-infini_rag_flow}'
  host: '${MINIO_HOST:-minio}:9000'
es:
  hosts: 'http://${ES_HOST:-es01}:9200'
  username: '${ES_USER:-elastic}'
  password: '${ELASTIC_PASSWORD:-infini_rag_flow}'
infinity:
  uri: '${INFINITY_HOST:-infinity}:23817'
  db_name: 'default_db'
redis:
  db: 1
  password: '${REDIS_PASSWORD:-infini_rag_flow}'
  host: '${REDIS_HOST:-redis}:6379'

Upload your service_conf.yaml file

[LIUyizheSDU]

Connecting to es01 on the host works fine with port forwarding.

[LIUyizheSDU]

docker network inspect docker-ragflow

[
    {
        "Name": "docker_ragflow",
        "Id": "e207edb9eef3bcce66b5b5c39af917884604ff988e1a3b16b763b081daf73778",
        "Created": "2025-03-18T09:32:46.480052903+08:00",
        "Scope": "local",
        "Driver": "bridge",
        "EnableIPv6": false,
        "IPAM": {
            "Driver": "default",
            "Options": null,
            "Config": [
                {
                    "Subnet": "172.21.0.0/16",
                    "Gateway": "172.21.0.1"
                }
            ]
        },
        "Internal": false,
        "Attachable": false,
        "Ingress": false,
        "ConfigFrom": {
            "Network": ""
        },
        "ConfigOnly": false,
        "Containers": {
            "1aea9499d778b951becc3d145e1a986a260aaf981685f3cc828b424d41154318": {
                "Name": "ragflow-server",
                "EndpointID": "dfb0ae74a412239189235a1d1a3835d0701b38ce4482bf54f9e3430ae6299b66",
                "MacAddress": "02:42:ac:15:00:06",
                "IPv4Address": "172.21.0.6/16",
                "IPv6Address": ""
            },
            "2067e8aa9a758418da0f1c26beeedc51dca5b961d3ef987af0cdb4e301656bba": {
                "Name": "ragflow-es-01",
                "EndpointID": "26674f687af592412b250a222330a66894851b6e4b5573589989cb6ab998da2f",
                "MacAddress": "02:42:ac:15:00:03",
                "IPv4Address": "172.21.0.3/16",
                "IPv6Address": ""
            },
            "60f409647042f284153b04891c05ff69b29e2dd75111db5a1ccf1d8ed73bf239": {
                "Name": "ragflow-mysql",
                "EndpointID": "c040f5fd958c67b858af03ee73c4d56c733e731d41a2d7cdb79e8d3ae3a829e0",
                "MacAddress": "02:42:ac:15:00:05",
                "IPv4Address": "172.21.0.5/16",
                "IPv6Address": ""
            },
            "bde70249bb80c1662ba60e2f177237083d88f389529c8731c84866a2a6ea2661": {
                "Name": "ragflow-minio",
                "EndpointID": "21db1a31610e745069934e2496e18a1a6fa91e6cdc2b4f10042c38170bda3e85",
                "MacAddress": "02:42:ac:15:00:02",
                "IPv4Address": "172.21.0.2/16",
                "IPv6Address": ""
            },
            "ce58fea01fed1ae6a4b64da18b3932cf2da36bcd76610c930110b6b384efb8b6": {
                "Name": "ragflow-redis",
                "EndpointID": "2dcb0da3a2bd12c9579138b3b5ddbdce44e70aed690868a5296792770d0953fd",
                "MacAddress": "02:42:ac:15:00:04",
                "IPv4Address": "172.21.0.4/16",
                "IPv6Address": ""
            }
        },
        "Options": {},
        "Labels": {
            "com.docker.compose.network": "ragflow",
            "com.docker.compose.project": "docker",
            "com.docker.compose.version": "2.17.2"
        }
    }
]

[LIUyizheSDU]

Confirmed:

1. containers are on the same network, network type is bridge
2. Container name can be correctly resolved to ip
3. The service is listening on 0.0.0.0.
4. Container test, the corresponding port of the container can be accessed
5. The firewall is not activated on the host computer.
   How to solve the network connection timeout between containers?

[CaffreyChen2095]

Sorry, it doesn't seem to be any problem. I tried to modify the elasticsearch.yml on ES01 by adding the xpack.security option and then used curl to access http://es01:9200 to check the feedback, but it didn't achieve the expected result.

[LIUyizheSDU]

docker-compose-base.yaml:

services:
  es01:
    container_name: ragflow-es-01
    profiles:
      - elasticsearch
    image: elasticsearch:${STACK_VERSION}
    volumes:
      - esdata01:/usr/share/elasticsearch/data
    ports:
      - ${ES_PORT}:9200
    env_file: .env
    environment:
      - node.name=es01
      - ELASTIC_PASSWORD=${ELASTIC_PASSWORD}
      - bootstrap.memory_lock=false
      - discovery.type=single-node
      - xpack.security.enabled=false
      - xpack.security.http.ssl.enabled=false
      - xpack.security.transport.ssl.enabled=false
      - cluster.routing.allocation.disk.watermark.low=5gb
      - cluster.routing.allocation.disk.watermark.high=3gb
      - cluster.routing.allocation.disk.watermark.flood_stage=2gb
      - TZ=${TIMEZONE}
    mem_limit: ${MEM_LIMIT}
    ulimits:
      memlock:
        soft: -1
        hard: -1
    healthcheck:
      test: ["CMD-SHELL", "curl http://localhost:9200"]
      interval: 10s
      timeout: 10s
      retries: 120
    networks:
      - ragflow
    restart: on-failure

  infinity:
    container_name: ragflow-infinity
    profiles:
      - infinity
    image: infiniflow/infinity:v0.6.0-dev3
    volumes:
      - infinity_data:/var/infinity
      - ./infinity_conf.toml:/infinity_conf.toml
    command: ["-f", "/infinity_conf.toml"]
    ports:
      - ${INFINITY_THRIFT_PORT}:23817
      - ${INFINITY_HTTP_PORT}:23820
      - ${INFINITY_PSQL_PORT}:5432
    env_file: .env
    environment:
      - TZ=${TIMEZONE}
    mem_limit: ${MEM_LIMIT}
    ulimits:
      nofile:
        soft: 500000
        hard: 500000
    networks:
      - ragflow
    healthcheck:
      test: ["CMD", "curl", "http://localhost:23820/admin/node/current"]
      interval: 10s
      timeout: 10s
      retries: 120
    restart: on-failure


  mysql:
    # mysql:5.7 linux/arm64 image is unavailable.
    image: mysql:8.0.39
    container_name: ragflow-mysql
    env_file: .env
    environment:
      - MYSQL_ROOT_PASSWORD=${MYSQL_PASSWORD}
      - TZ=${TIMEZONE}
    command:
      --max_connections=1000
      --character-set-server=utf8mb4
      --collation-server=utf8mb4_unicode_ci
      --default-authentication-plugin=mysql_native_password
      --tls_version="TLSv1.2,TLSv1.3"
      --init-file /data/application/init.sql
    ports:
      - ${MYSQL_PORT}:3306
    volumes:
      - mysql_data:/var/lib/mysql
      - ./init.sql:/data/application/init.sql
    networks:
      - ragflow
    healthcheck:
      test: ["CMD", "mysqladmin" ,"ping", "-uroot", "-p${MYSQL_PASSWORD}"]
      interval: 10s
      timeout: 10s
      retries: 3
    restart: on-failure

  minio:
    image: quay.io/minio/minio:RELEASE.2023-12-20T01-00-02Z
    container_name: ragflow-minio
    command: server --console-address ":9001" /data
    ports:
      - ${MINIO_PORT}:9000
      - ${MINIO_CONSOLE_PORT}:9001
    env_file: .env
    environment:
      - MINIO_ROOT_USER=${MINIO_USER}
      - MINIO_ROOT_PASSWORD=${MINIO_PASSWORD}
      - TZ=${TIMEZONE}
    volumes:
      - minio_data:/data
    networks:
      - ragflow
    restart: on-failure

  redis:
    # swr.cn-north-4.myhuaweicloud.com/ddn-k8s/docker.io/valkey/valkey:8
    image: valkey/valkey:8
    container_name: ragflow-redis
    command: redis-server --requirepass ${REDIS_PASSWORD} --maxmemory 128mb --maxmemory-policy allkeys-lru
    env_file: .env
    ports:
      - ${REDIS_PORT}:6379
    volumes:
      - redis_data:/data
    networks:
      - ragflow
    restart: on-failure



volumes:
  esdata01:
    driver: local
  infinity_data:
    driver: local
  mysql_data:
    driver: local
  minio_data:
    driver: local
  redis_data:
    driver: local

networks:
  ragflow:
    driver: bridge
    attachable: true
    driver_opts:
      com.docker.network.bridge.enable_icc: "true"

docker-compose.yaml:

# include:
#   - ./docker-compose-base.yml

services:
  ragflow:
    depends_on:
      mysql:
        condition: service_healthy
    image: ${RAGFLOW_IMAGE}
    container_name: ragflow-server
    ports:
      - ${SVR_HTTP_PORT}:9380
      - 80:80
      - 443:443
    volumes:
      - ./ragflow-logs:/ragflow/logs
      - ./nginx/ragflow.conf:/etc/nginx/conf.d/ragflow.conf
      - ./nginx/proxy.conf:/etc/nginx/proxy.conf
      - ./nginx/nginx.conf:/etc/nginx/nginx.conf
    env_file: .env
    environment:
      - TZ=${TIMEZONE}
      - HF_ENDPOINT=${HF_ENDPOINT}
      - MACOS=${MACOS}
    networks:
      - ragflow
    restart: on-failure
    # https://docs.docker.com/engine/daemon/prometheus/#create-a-prometheus-configuration
    # If you're using Docker Desktop, the --add-host flag is optional. This flag makes sure that the host's internal IP gets exposed to the Prometheus container.
    extra_hosts:
      - "host.docker.internal:host-gateway"

compose command:
docker compose -f docker-compose-base.yaml -f docker compose.yaml up -d
my docker don't support include

[LIUyizheSDU]

Anyone can help me？ Whatever I do , the containers cannot communicate with each other. The SYN sent by ragflow-server can be detected in the bridge, but there is no response. Container es01 can access port 9200 and receive a json, so do the host machine.

[LIUyizheSDU]

sudo iptables -L -n -v --line-numbers
output:

Chain INPUT (policy ACCEPT 52318 packets, 77M bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain FORWARD (policy ACCEPT 0 packets, 0 bytes)
num   pkts bytes target     prot opt in     out     source               destination         
1        0     0 DOCKER-USER  all  --  *      *       0.0.0.0/0            0.0.0.0/0           
2        0     0 DOCKER-FORWARD  all  --  *      *       0.0.0.0/0            0.0.0.0/0           

Chain OUTPUT (policy ACCEPT 42648 packets, 146M bytes)
num   pkts bytes target     prot opt in     out     source               destination         

Chain DOCKER (2 references)
num   pkts bytes target     prot opt in     out     source               destination         
1        0     0 ACCEPT     tcp  --  !br-f16fd3b954eb br-f16fd3b954eb  0.0.0.0/0            172.18.0.6           tcp dpt:9380
2        0     0 ACCEPT     tcp  --  !br-f16fd3b954eb br-f16fd3b954eb  0.0.0.0/0            172.18.0.6           tcp dpt:443
3        0     0 ACCEPT     tcp  --  !br-f16fd3b954eb br-f16fd3b954eb  0.0.0.0/0            172.18.0.6           tcp dpt:80
4        0     0 ACCEPT     tcp  --  !br-f16fd3b954eb br-f16fd3b954eb  0.0.0.0/0            172.18.0.4           tcp dpt:9001
5        0     0 ACCEPT     tcp  --  !br-f16fd3b954eb br-f16fd3b954eb  0.0.0.0/0            172.18.0.5           tcp dpt:3306
6        0     0 ACCEPT     tcp  --  !br-f16fd3b954eb br-f16fd3b954eb  0.0.0.0/0            172.18.0.4           tcp dpt:9000
7        0     0 ACCEPT     tcp  --  !br-f16fd3b954eb br-f16fd3b954eb  0.0.0.0/0            172.18.0.3           tcp dpt:6379
8        0     0 ACCEPT     tcp  --  !br-f16fd3b954eb br-f16fd3b954eb  0.0.0.0/0            172.18.0.2           tcp dpt:9200
9        0     0 DROP       all  --  !docker0 docker0  0.0.0.0/0            0.0.0.0/0           
10       0     0 DROP       all  --  !br-f16fd3b954eb br-f16fd3b954eb  0.0.0.0/0            0.0.0.0/0           

Chain DOCKER-BRIDGE (1 references)
num   pkts bytes target     prot opt in     out     source               destination         
1        0     0 DOCKER     all  --  *      docker0  0.0.0.0/0            0.0.0.0/0           
2        0     0 DOCKER     all  --  *      br-f16fd3b954eb  0.0.0.0/0            0.0.0.0/0           

Chain DOCKER-CT (1 references)
num   pkts bytes target     prot opt in     out     source               destination         
1        0     0 ACCEPT     all  --  *      docker0  0.0.0.0/0            0.0.0.0/0            ctstate RELATED,ESTABLISHED
2        0     0 ACCEPT     all  --  *      br-f16fd3b954eb  0.0.0.0/0            0.0.0.0/0            ctstate RELATED,ESTABLISHED

Chain DOCKER-FORWARD (1 references)
num   pkts bytes target     prot opt in     out     source               destination         
1        0     0 DOCKER-CT  all  --  *      *       0.0.0.0/0            0.0.0.0/0           
2        0     0 DOCKER-ISOLATION-STAGE-1  all  --  *      *       0.0.0.0/0            0.0.0.0/0           
3        0     0 DOCKER-BRIDGE  all  --  *      *       0.0.0.0/0            0.0.0.0/0           
4        0     0 ACCEPT     all  --  docker0 *       0.0.0.0/0            0.0.0.0/0           
5        0     0 ACCEPT     all  --  br-f16fd3b954eb *       0.0.0.0/0            0.0.0.0/0           

Chain DOCKER-ISOLATION-STAGE-1 (1 references)
num   pkts bytes target     prot opt in     out     source               destination         
1        0     0 DOCKER-ISOLATION-STAGE-2  all  --  docker0 !docker0  0.0.0.0/0            0.0.0.0/0           
2        0     0 DOCKER-ISOLATION-STAGE-2  all  --  br-f16fd3b954eb !br-f16fd3b954eb  0.0.0.0/0            0.0.0.0/0           

Chain DOCKER-ISOLATION-STAGE-2 (2 references)
num   pkts bytes target     prot opt in     out     source               destination         
1        0     0 DROP       all  --  *      br-f16fd3b954eb  0.0.0.0/0            0.0.0.0/0           
2        0     0 DROP       all  --  *      docker0  0.0.0.0/0            0.0.0.0/0           

Chain DOCKER-USER (1 references)
num   pkts bytes target     prot opt in     out     source               destination         
1     575K  830M RETURN     all  --  *      *       0.0.0.0/0            0.0.0.0/0     

sudo tcpdump -i f16fd3b954eb port 9200 -nnv

output:

tcpdump: listening on br-f16fd3b954eb, link-type EN10MB (Ethernet), capture size 262144 bytes
20:23:00.539668 IP (tos 0x0, ttl 64, id 45181, offset 0, flags [DF], proto TCP (6), length 60)
    172.18.0.6.36374 > 172.18.0.2.9200: Flags [S], cksum 0x585b (incorrect -> 0x1b6c), seq 353195989, win 64240, options [mss 1460,sackOK,TS val 2040414447 ecr 0,nop,wscale 7], length 0
20:23:40.361826 IP (tos 0x0, ttl 64, id 57092, offset 0, flags [DF], proto TCP (6), length 60)
    172.18.0.6.36438 > 172.18.0.2.9200: Flags [S], cksum 0x585b (incorrect -> 0x1310), seq 1414694172, win 64240, options [mss 1460,sackOK,TS val 2040454270 ecr 0,nop,wscale 7], length 0
20:23:41.371671 IP (tos 0x0, ttl 64, id 57093, offset 0, flags [DF], proto TCP (6), length 60)
    172.18.0.6.36438 > 172.18.0.2.9200: Flags [S], cksum 0x585b (incorrect -> 0x0f1f), seq 1414694172, win 64240, options [mss 1460,sackOK,TS val 2040455279 ecr 0,nop,wscale 7], length 0
20:23:43.387655 IP (tos 0x0, ttl 64, id 57094, offset 0, flags [DF], proto TCP (6), length 60)
    172.18.0.6.36438 > 172.18.0.2.9200: Flags [S], cksum 0x585b (incorrect -> 0x073f), seq 1414694172, win 64240, options [mss 1460,sackOK,TS val 2040457295 ecr 0,nop,wscale 7], length 0