Skip to content

Again: An example from the documentation doesn't work #2051

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
makorne opened this issue Feb 19, 2024 · 7 comments
Open

Again: An example from the documentation doesn't work #2051

makorne opened this issue Feb 19, 2024 · 7 comments
Labels

Comments

@makorne
Copy link

makorne commented Feb 19, 2024

The same as

uname -a
Linux fedora 6.5.12-100.fc37.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Nov 20 22:28:44 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

lsb_release
LSB Version: :core-4.1-amd64:core-4.1-noarch

cat /proc/version
Linux version 6.5.12-100.fc37.x86_64 ([email protected]) (gcc (GCC) 12.3.1 20230508 (Red Hat 12.3.1-1), GNU ld version 2.38-27.fc37) #1 SMP PREEMPT_DYNAMIC Mon Nov 20 22:28:44 UTC 2023

I haven't modify config/disk.yaml

logs.zip

@blinkov
Copy link
Member

blinkov commented Feb 19, 2024

@makorne could you show the output of LD_LIBRARY_PATH=ydbd/lib ydbd/bin/ydbd --svnrevision?

@makorne
Copy link
Author

makorne commented Feb 19, 2024

LD_LIBRARY_PATH=ydbd/lib ydbd/bin/ydbd --svnrevision
Git info:
Commit: e8171b1
Branch: tags/23.3.25.hotfix.1
Author: Daniil Cherednik [email protected]
Summary: Ydb stable 23-3-25-hotfix-1

Other info:
Build by: Unknown user
Top src dir: /opt/buildagent/work/3e574e3efc81dc20/tag

Build info:
Compiler: /usr/bin/clang++-12
Compiler version:
Ubuntu clang version 12.0.0-3ubuntu1~20.04.5
Target: x86_64-pc-linux-gnu
Thread model: posix
InstalledDir: /usr/bin
Compile flags: \ \ \ -fexceptions\ \ \ -fno-common\ \ \ -fcolor-diagnostics\ \ \ -faligned-allocation\ \ \ -fdebug-default-version=4\ \ \ -ffunction-sections\ \ \ -fdata-sections\ \ \ -Wall\ \ \ -Wextra\ \ \ -Wno-parentheses\ \ \ -Wno-implicit-const-int-float-conversion\ \ \ -Wno-unknown-warning-option\ \ \ -pipe\ \ \ -D_THREAD_SAFE\ \ \ -D_PTHREADS\ \ \ -D_REENTRANT\ \ \ -D_LARGEFILE_SOURCE\ \ \ -D__STDC_CONSTANT_MACROS\ \ \ -D__STDC_FORMAT_MACROS\ \ \ -D__LONG_LONG_SUPPORTED\ \ -D_GNU_SOURCE\ -DLIBCXX_BUILDING_LIBCXXRT\ -fuse-init-array\ -D_FILE_OFFSET_BITS=64\ -m64\ \ \ \ -msse2\ \ \ \ \ -msse3\ \ \ \ \ -mssse3\ \ \ \ \ \ \ \ \ -msse4.1\ \ \ \ \ \ \ -msse4.2\ \ \ \ \ \ \ -mpopcnt\ \ \ \ \ \ -mcx16\ -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE\ \ \ -Woverloaded-virtual\ \ \ -Wimport-preprocessor-directive-pedantic\ \ \ -Wno-undefined-var-template\ \ \ -Wno-return-std-move\ \ \ -Wno-defaulted-function-deleted\ \ \ -Wno-pessimizing-move\ \ \ -Wno-deprecated-anon-enum-enum-conversion\ \ \ -Wno-deprecated-enum-enum-conversion\ \ \ -Wno-deprecated-enum-float-conversion\ \ \ -Wno-ambiguous-reversed-operator\ \ \ -Wno-deprecated-volatile\ \ \ \ \ \ -DSSE_ENABLED=1\ \ \ \ \ -DSSE3_ENABLED=1\ \ \ \ \ -DSSSE3_ENABLED=1\ \ \ \ \ \ \ \ \ -DSSE41_ENABLED=1\ \ \ \ \ \ \ -DSSE42_ENABLED=1\ \ \ \ \ \ \ -DPOPCNT_ENABLED=1\ \ \ \ \ \ -DCX16_ENABLED=1

@blinkov
Copy link
Member

blinkov commented Feb 20, 2024

@makorne ok, then this seems like a new issue. I've just tried to reproduce it on a fresh VM with Fedora 37. It has the same kernel as you do and it downloaded the exact same YDB binary as you have, but the start.sh script still works fine:

[blinkov@fedora ~]$ ./start.sh disk
Data file ydb.data not found, creating ...
Starting storage process...
Initializing storage ...
Registering database ...
Starting database process...

Database started. Connection options for YDB CLI:

-e grpc://localhost:2136 -d /Root/test

[blinkov@fedora ~]$ uname -a
Linux fedora.ru-central1.internal 6.5.12-100.fc37.x86_64 #1 SMP PREEMPT_DYNAMIC Mon Nov 20 22:28:44 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Is there anything special about this machine you're trying this on? The error messages look network-related, could you show the output of cat /etc/hosts and ifconfig?

@makorne
Copy link
Author

makorne commented Feb 20, 2024

cat /etc/hosts

127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6

ifconfig

br-b5610bf6ba43: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        inet 172.18.0.1  netmask 255.255.0.0  broadcast 172.18.255.255
        ether xx:xx:xx:xx:xx:xx   txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

docker0: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        inet 172.17.0.1  netmask 255.255.0.0  broadcast 172.17.255.255
        ether xx:xx:xx:xx:xx:xx   txqueuelen 0  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

enp2s0: flags=4099<UP,BROADCAST,MULTICAST>  mtu 1500
        ether xx:xx:xx:xx:xx:xx  txqueuelen 1000  (Ethernet)
        RX packets 0  bytes 0 (0.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 0  bytes 0 (0.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1000  (Local Loopback)
        RX packets 68409  bytes 41706056 (39.7 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 68409  bytes 41706056 (39.7 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

wlp3s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.0.110  netmask 255.255.255.0  broadcast 192.168.0.255
        inet6 xxxx::xxxx:xxxx:xxxx:xxxx  prefixlen 64  scopeid 0x20<link>
        ether b4:xx:xx:xx:xx:xx  txqueuelen 1000  (Ethernet)
        RX packets 26720852  bytes 34061578190 (31.7 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 12180103  bytes 1953295789 (1.8 GiB)
    TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

I redownload all and tried with the localhost

ydb -e grpc://localhost:2136 -d /Root/test scheme ls

Status: UNAVAILABLE
Issues: 
<main>: Error: Database nodes resolve failed with no certain result, code: 200400
<main>: Error: Endpoint list is empty for database /Root/test, cluster endpoint localhost:2136.

and 127.0.0.1
ydb -e grpc://127.0.0.1:2136 -d /Root/test scheme ls

Status: UNAVAILABLE
Issues: 
<main>: Error: Database nodes resolve failed with no certain result, code: 200400
<main>: Error: Endpoint list is empty for database /Root/test, cluster endpoint 127.0.0.1:2136.

@blinkov
Copy link
Member

blinkov commented Feb 20, 2024

@makorne ifconfig/hosts doesn't seem to be out of the ordinary. Is there still a 2024-02-19T03:47:42.709828Z :INTERCONNECT NOTICE: Handshake [1:7337154747358577978:8191] [node 50000] ICH03 handshake failed, explanation# incoming handshake Peer# <unknown>(::1) Peer connectivity-checking failed, error# DNS resolve error: Misformatted domain name, Unresolved host# fedora message in storage_start.log like in the issue description? Or maybe you could recreate logs.zip file?

@makorne
Copy link
Author

makorne commented Feb 20, 2024

logs.zip

@broderix
Copy link

broderix commented Oct 23, 2024

Hi, stuck on the same problem, but a little different.

on host (same with -e grpc://127.0.0.1:2136) (ubuntu 22.04, lxc)

./ydbd/bin/ydbd  --svnrevision
Git info:
    Commit: 5635e2b3861415a967ee84538225501ef7decfd4
    Branch: tags/24.1.7
    Author: Alexander Petrukhin <[email protected]>
    Summary: [cms] add start_time in public cms maintenance api (#2452) (#2472)

Other info:
    Build by: Unknown user
    Top src dir: /opt/buildagent/work/3e574e3efc81dc20/tag
    Top build dir: /root/.ya/build
    Hostname: 99956cb04ab5
    Host information:
        Linux 99956cb04ab5 5.4.0-169-generic #187-Ubuntu SMP Thu Nov 23 14:52:28 UTC 2023 x86_64

Build info:
    Compiler: /root/.ya/tools/v4/5695783597/bin/clang++
    Compiler version:
        clang version 16.0.6
        Target: x86_64-unknown-linux-gnu
        Thread model: posix
        InstalledDir: /root/.ya/tools/v4/5695783597/bin
    Compile flags: -pipe -m64 -O3 -g -ggnu-pubnames -fexceptions -fno-common -ffunction-sections -fdata-sections -fuse-init-array -fcolor-diagnostics -faligned-allocation -fdebug-default-version=4 -Wall -Wextra -Wno-parentheses -Wno-implicit-const-int-float-conversion -Wno-unknown-warning-option -Werror -D_THREAD_SAFE -D_PTHREADS -D_REENTRANT -D_LARGEFILE_SOURCE -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D_FILE_OFFSET_BITS=64 -D_GNU_SOURCE -D_YNDX_LIBUNWIND_ENABLE_EXCEPTION_BACKTRACE -DNDEBUG -D__LONG_LONG_SUPPORTED -DSSE_ENABLED=1 -DSSE3_ENABLED=1 -DSSSE3_ENABLED=1 -DSSE41_ENABLED=1 -DSSE42_ENABLED=1 -DPOPCNT_ENABLED=1 -DCX16_ENABLED=1 -D_libunwind_ -DLIBCXX_BUILDING_LIBCXXRT -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -DCATBOOST_OPENSOURCE=yes -msse2 -msse3 -mssse3 -msse4.1 -msse4.2 -mpopcnt -mcx16 -Wno-array-parameter -Wno-deprecate-lax-vec-conv-all -Wno-unqualified-std-cast-call -Wno-unused-but-set-parameter -Wno-implicit-function-declaration -Wno-int-conversion -Wno-incompatible-function-pointer-types -Wno-address-of-packed-member -std=c++20 -Woverloaded-virtual -Wimport-preprocessor-directive-pedantic -Wno-ambiguous-reversed-operator -Wno-defaulted-function-deleted -Wno-deprecated-anon-enum-enum-conversion -Wno-deprecated-enum-enum-conversion -Wno-deprecated-enum-float-conversion -Wno-deprecated-volatile -Wno-pessimizing-move -Wno-return-std-move -Wno-undefined-var-template -nostdinc++ -DCATBOOST_OPENSOURCE=yes -nostdinc++
ydb version
YDB CLI 2.15.0
ydb -d /Root --profile default-profile -e grpc://192.168.88.110:2136 scheme ls
experiments  test  test2  test4  .sys

on client (macbook pro m1)

ydb version
YDB CLI 2.15.0
ydb -d /Root --profile default-profile -e grpc://192.168.88.110:2136 scheme ls
Status: TRANSPORT_UNAVAILABLE
Issues:
<main>: Error: GRpc error: (14): failed to connect to all addresses; last error: UNKNOWN: ipv4:127.0.0.1:2136: Failed to connect to remote host: Connection refused
<main>: Error: Grpc error response on endpoint 127.0.0.1:2136
ydb -d /Root/test2 --profile default-profile -e grpc://192.168.88.110:2136 scheme ls
Status: UNAVAILABLE
Issues:
<main>: Error: Database nodes resolve failed with no certain result, code: 200400
<main>: Error: Endpoint list is empty for database /Root/test2, cluster endpoint 192.168.88.110:2136.
nmap 192.168.88.110 -p2135-2136
Starting Nmap 7.95 ( https://nmap.org ) at 2024-10-24 10:58 MSK
Nmap scan report for capuchin (192.168.88.110)
Host is up (0.00058s latency).

PORT     STATE SERVICE
2135/tcp open  gris
2136/tcp open  appworxsrv

Nmap done: 1 IP address (1 host up) scanned in 0.02 seconds
lxc config device show ydb-dev-main
"2135":
  connect: tcp:127.0.0.1:2135
  listen: tcp:0.0.0.0:2135
  type: proxy
"2136":
  connect: tcp:127.0.0.1:2136
  listen: tcp:0.0.0.0:2136
  type: proxy
"8765":
  connect: tcp:127.0.0.1:8765
  listen: tcp:0.0.0.0:8765
  type: proxy
root:
  path: /
  pool: default-hdd2
  size: 100GB
  type: disk

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants