Again: An example from the documentation doesn't work

[makorne]

The same as

uname -a
Linux fedora 6.5.12-100.fc37.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Nov 20 22:28:44 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

lsb_release
LSB Version: :core-4.1-amd64:core-4.1-noarch

cat /proc/version
Linux version 6.5.12-100.fc37.x86_64 (mockbuild@bkernel01.iad2.fedoraproject.org) (gcc (GCC) 12.3.1 20230508 (Red Hat 12.3.1-1), GNU ld version 2.38-27.fc37) #1 SMP PREEMPT_DYNAMIC Mon Nov 20 22:28:44 UTC 2023

I haven't modify config/disk.yaml

logs.zip

[blinkov]

@makorne could you show the output of LD_LIBRARY_PATH=ydbd/lib ydbd/bin/ydbd --svnrevision?

[makorne]

LD_LIBRARY_PATH=ydbd/lib ydbd/bin/ydbd --svnrevision
Git info:
Commit: e8171b1
Branch: tags/23.3.25.hotfix.1
Author: Daniil Cherednik dcherednik@ydb.tech
Summary: Ydb stable 23-3-25-hotfix-1

Other info:
Build by: Unknown user
Top src dir: /opt/buildagent/work/3e574e3efc81dc20/tag

Build info:
Compiler: /usr/bin/clang++-12
Compiler version:
Ubuntu clang version 12.0.0-3ubuntu1~20.04.5
Target: x86_64-pc-linux-gnu
Thread model: posix
InstalledDir: /usr/bin
Compile flags: \ \ \ -fexceptions\ \ \ -fno-common\ \ \ -fcolor-diagnostics\ \ \ -faligned-allocation\ \ \ -fdebug-default-version=4\ \ \ -ffunction-sections\ \ \ -fdata-sections\ \ \ -Wall\ \ \ -Wextra\ \ \ -Wno-parentheses\ \ \ -Wno-implicit-const-int-float-conversion\ \ \ -Wno-unknown-warning-option\ \ \ -pipe\ \ \ -D_THREAD_SAFE\ \ \ -D_PTHREADS\ \ \ -D_REENTRANT\ \ \ -D_LARGEFILE_SOURCE\ \ \ -D__STDC_CONSTANT_MACROS\ \ \ -D__STDC_FORMAT_MACROS\ \ \ -D__LONG_LONG_SUPPORTED\ \ -D_GNU_SOURCE\ -DLIBCXX_BUILDING_LIBCXXRT\ -fuse-init-array\ -D_FILE_OFFSET_BITS=64\ -m64\ \ \ \ -msse2\ \ \ \ \ -msse3\ \ \ \ \ -mssse3\ \ \ \ \ \ \ \ \ -msse4.1\ \ \ \ \ \ \ -msse4.2\ \ \ \ \ \ \ -mpopcnt\ \ \ \ \ \ -mcx16\ -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE\ \ \ -Woverloaded-virtual\ \ \ -Wimport-preprocessor-directive-pedantic\ \ \ -Wno-undefined-var-template\ \ \ -Wno-return-std-move\ \ \ -Wno-defaulted-function-deleted\ \ \ -Wno-pessimizing-move\ \ \ -Wno-deprecated-anon-enum-enum-conversion\ \ \ -Wno-deprecated-enum-enum-conversion\ \ \ -Wno-deprecated-enum-float-conversion\ \ \ -Wno-ambiguous-reversed-operator\ \ \ -Wno-deprecated-volatile\ \ \ \ \ \ -DSSE_ENABLED=1\ \ \ \ \ -DSSE3_ENABLED=1\ \ \ \ \ -DSSSE3_ENABLED=1\ \ \ \ \ \ \ \ \ -DSSE41_ENABLED=1\ \ \ \ \ \ \ -DSSE42_ENABLED=1\ \ \ \ \ \ \ -DPOPCNT_ENABLED=1\ \ \ \ \ \ -DCX16_ENABLED=1

[blinkov]

@makorne ok, then this seems like a new issue. I've just tried to reproduce it on a fresh VM with Fedora 37. It has the same kernel as you do and it downloaded the exact same YDB binary as you have, but the start.sh script still works fine:

[blinkov@fedora ~]$ ./start.sh disk
Data file ydb.data not found, creating ...
Starting storage process...
Initializing storage ...
Registering database ...
Starting database process...

Database started. Connection options for YDB CLI:

-e grpc://localhost:2136 -d /Root/test

[blinkov@fedora ~]$ uname -a
Linux fedora.ru-central1.internal 6.5.12-100.fc37.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Nov 20 22:28:44 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Is there anything special about this machine you're trying this on? The error messages look network-related, could you show the output of cat /etc/hosts and ifconfig?

[makorne]

cat /etc/hosts

127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6

ifconfig

br-b5610bf6ba43: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        inet 172.18.0.1  netmask 255.255.0.0  broadcast 172.18.255.255
        ether xx:xx:xx:xx:xx:xx   txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

docker0: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        inet 172.17.0.1  netmask 255.255.0.0  broadcast 172.17.255.255
        ether xx:xx:xx:xx:xx:xx   txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

enp2s0: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        ether xx:xx:xx:xx:xx:xx  txqueuelen 1000  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 68409  bytes 41706056 (39.7 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 68409  bytes 41706056 (39.7 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

wlp3s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.0.110  netmask 255.255.255.0  broadcast 192.168.0.255
        inet6 xxxx::xxxx:xxxx:xxxx:xxxx  prefixlen 64  scopeid 0x20<link>
        ether b4:xx:xx:xx:xx:xx  txqueuelen 1000  (Ethernet)
        RX packets 26720852  bytes 34061578190 (31.7 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 12180103  bytes 1953295789 (1.8 GiB)

    TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

I redownload all and tried with the localhost

ydb -e grpc://localhost:2136 -d /Root/test scheme ls

Status: UNAVAILABLE
Issues: 
<main>: Error: Database nodes resolve failed with no certain result, code: 200400
<main>: Error: Endpoint list is empty for database /Root/test, cluster endpoint localhost:2136.

and 127.0.0.1
ydb -e grpc://127.0.0.1:2136 -d /Root/test scheme ls

Status: UNAVAILABLE
Issues: 
<main>: Error: Database nodes resolve failed with no certain result, code: 200400
<main>: Error: Endpoint list is empty for database /Root/test, cluster endpoint 127.0.0.1:2136.

[blinkov]

@makorne ifconfig/hosts doesn't seem to be out of the ordinary. Is there still a 2024-02-19T03:47:42.709828Z :INTERCONNECT NOTICE: Handshake [1:7337154747358577978:8191] [node 50000] ICH03 handshake failed, explanation# incoming handshake Peer# <unknown>(::1) Peer connectivity-checking failed, error# DNS resolve error: Misformatted domain name, Unresolved host# fedora message in storage_start.log like in the issue description? Or maybe you could recreate logs.zip file?

[makorne]

logs.zip

[broderix]

Hi, stuck on the same problem, but a little different.

on host (same with -e grpc://127.0.0.1:2136) (ubuntu 22.04, lxc)

./ydbd/bin/ydbd  --svnrevision
Git info:
    Commit: 5635e2b3861415a967ee84538225501ef7decfd4
    Branch: tags/24.1.7
    Author: Alexander Petrukhin <shmel1k@users.noreply.github.com>
    Summary: [cms] add start_time in public cms maintenance api (#2452) (#2472)

Other info:
    Build by: Unknown user
    Top src dir: /opt/buildagent/work/3e574e3efc81dc20/tag
    Top build dir: /root/.ya/build
    Hostname: 99956cb04ab5
    Host information:
        Linux 99956cb04ab5 5.4.0-169-generic #187-Ubuntu SMP Thu Nov 23 14:52:28 UTC 2023 x86_64

Build info:
    Compiler: /root/.ya/tools/v4/5695783597/bin/clang++
    Compiler version:
        clang version 16.0.6
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /root/.ya/tools/v4/5695783597/bin
    Compile flags: -pipe -m64 -O3 -g -ggnu-pubnames -fexceptions -fno-common -ffunction-sections -fdata-sections -fuse-init-array -fcolor-diagnostics -faligned-allocation -fdebug-default-version=4 -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -Werror -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -DNDEBUG -D__LONG_LONG_SUPPORTED -DSSE_ENABLED=1 -DSSE3_ENABLED=1 -DSSSE3_ENABLED=1 -DSSE41_ENABLED=1 -DSSE42_ENABLED=1 -DPOPCNT_ENABLED=1 -DCX16_ENABLED=1 -D_libunwind_ -DLIBCXX_BUILDING_LIBCXXRT -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -std=c++20 -Woverloaded-virtual -Wimport-preprocessor-directive-pedantic -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-return-std-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++

ydb version
YDB CLI 2.15.0

ydb -d /Root --profile default-profile -e grpc://192.168.88.110:2136 scheme ls
experiments  test  test2  test4  .sys

on client (macbook pro m1)

ydb version
YDB CLI 2.15.0

ydb -d /Root --profile default-profile -e grpc://192.168.88.110:2136 scheme ls
Status: TRANSPORT_UNAVAILABLE
Issues:
<main>: Error: GRpc error: (14): failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:2136: Failed to connect to remote host: Connection refused
<main>: Error: Grpc error response on endpoint 127.0.0.1:2136

ydb -d /Root/test2 --profile default-profile -e grpc://192.168.88.110:2136 scheme ls
Status: UNAVAILABLE
Issues:
<main>: Error: Database nodes resolve failed with no certain result, code: 200400
<main>: Error: Endpoint list is empty for database /Root/test2, cluster endpoint 192.168.88.110:2136.

nmap 192.168.88.110 -p2135-2136
Starting Nmap 7.95 ( https://nmap.org ) at 2024-10-24 10:58 MSK
Nmap scan report for capuchin (192.168.88.110)
Host is up (0.00058s latency).

PORT     STATE SERVICE
2135/tcp open  gris
2136/tcp open  appworxsrv

Nmap done: 1 IP address (1 host up) scanned in 0.02 seconds

lxc config device show ydb-dev-main
"2135":
  connect: tcp:127.0.0.1:2135
  listen: tcp:0.0.0.0:2135
  type: proxy
"2136":
  connect: tcp:127.0.0.1:2136
  listen: tcp:0.0.0.0:2136
  type: proxy
"8765":
  connect: tcp:127.0.0.1:8765
  listen: tcp:0.0.0.0:8765
  type: proxy
root:
  path: /
  pool: default-hdd2
  size: 100GB
  type: disk