WM fixed bugs and performance #7254

GrigoriyPA · 2024-07-30T11:34:27Z

YQ WM fix for sls feature flag (YQ WM fix for sls feature flag #7057)
YQ-3446 add queued time into query stats (YQ-3446 add queued time into query stats #6965)
YQ-3442 added pools cache (YQ-3442 added pools cache #7186)

Changelog entry

Fixed bugs and performance for resource pools

Changelog category

Performance improvement

Additional information

Эти изменения нужны в пределах задачи YQ-3222: workload manager v1 (YDB DWH к скейлу), все фичи которые должны быть к скейлу согласовали с @fomichev3000 в этой дельте:
https://delta.yandex-team.ru/page/epad/page/oq95gk1890527ptp

Ещё нужно будет доделать изменения по этим тикетам:

YQ-3491: Поддержать CREATE/ALTER/DROP RESOURCE POOL CLASSIFIER
YQ-3492: Поддержать сохранение resource pool classifier в object таблицы
YQ-3493: Поддержать кеш классификаторов в kqp proxy

github-actions · 2024-07-30T11:43:57Z

⚪ 2024-07-30 11:43:56 UTC Pre-commit check for 56f98bc has started.
⚪ 2024-07-30 11:46:27 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-07-30 11:53:14 UTC Build successful.

github-actions · 2024-07-30T11:48:46Z

⚪ 2024-07-30 11:48:46 UTC Pre-commit check for 56f98bc has started.
⚪ 2024-07-30 11:51:48 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-07-30 12:30:44 UTC Build successful.
⚪ 2024-07-30 12:30:56 UTC Tests are running...
🔴 2024-07-30 13:51:31 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
13907	12584	0	2	1308	13

🟡 2024-07-30 13:52:08 UTC ydbd size 8.1 GiB changed* by +429.7 KiB, which is >= 100.0 KiB vs stable-24-3: Warning

ydbd size dash	stable-24-3: `63e04e6`	merge: `56f98bc`	diff	diff %
ydbd size	8 724 358 984 Bytes	8 724 798 992 Bytes	+429.7 KiB	+0.005%
ydbd stripped size	476 945 224 Bytes	476 966 664 Bytes	+20.9 KiB	+0.004%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-07-30T11:57:44Z

⚪ 2024-07-30 11:57:43 UTC Pre-commit check for 56f98bc has started.
⚪ 2024-07-30 12:00:51 UTC Build linux-x86_64-release-asan is running...
🟢 2024-07-30 12:22:57 UTC Build successful.
⚪ 2024-07-30 12:23:10 UTC Tests are running...
🔴 2024-07-30 14:27:38 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
9797	9210	0	87	324	176

🟡 2024-07-30 14:28:22 UTC ydbd size 5.2 GiB changed* by +273.0 KiB, which is >= 100.0 KiB vs stable-24-3: Warning

ydbd size dash	stable-24-3: `63e04e6`	merge: `56f98bc`	diff	diff %
ydbd size	5 613 453 344 Bytes	5 613 732 896 Bytes	+273.0 KiB	+0.005%
ydbd stripped size	1 210 296 712 Bytes	1 210 357 832 Bytes	+59.7 KiB	+0.005%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-07-30T17:11:20Z

⚪ 2024-07-30 17:11:20 UTC Pre-commit check for 49f37ae has started.
⚪ 2024-07-30 17:14:04 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-07-30 18:14:11 UTC Build successful.
⚪ 2024-07-30 18:14:25 UTC Tests are running...
🔴 2024-07-30 19:58:27 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
39787	34553	0	1	5219	14

🟡 2024-07-30 19:59:10 UTC ydbd size 8.1 GiB changed* by +446.0 KiB, which is >= 100.0 KiB vs stable-24-3: Warning

ydbd size dash	stable-24-3: `725b0df`	merge: `49f37ae`	diff	diff %
ydbd size	8 724 358 984 Bytes	8 724 815 640 Bytes	+446.0 KiB	+0.005%
ydbd stripped size	476 945 224 Bytes	476 967 752 Bytes	+22.0 KiB	+0.005%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-07-30T17:11:59Z

⚪ 2024-07-30 17:11:59 UTC Pre-commit check for 49f37ae has started.
⚪ 2024-07-30 17:14:51 UTC Build linux-x86_64-release-asan is running...
🟢 2024-07-30 17:57:18 UTC Build successful.
⚪ 2024-07-30 17:57:31 UTC Tests are running...
🔴 2024-07-30 20:01:05 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
11269	10686	0	86	321	176

🟡 2024-07-30 20:01:52 UTC ydbd size 5.2 GiB changed* by +290.6 KiB, which is >= 100.0 KiB vs stable-24-3: Warning

ydbd size dash	stable-24-3: `725b0df`	merge: `49f37ae`	diff	diff %
ydbd size	5 613 453 456 Bytes	5 613 751 040 Bytes	+290.6 KiB	+0.005%
ydbd stripped size	1 210 296 840 Bytes	1 210 362 728 Bytes	+64.3 KiB	+0.005%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-07-30T17:13:10Z

⚪ 2024-07-30 17:13:10 UTC Pre-commit check for 49f37ae has started.
⚪ 2024-07-30 17:16:09 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-07-30 17:55:28 UTC Build successful.

github-actions · 2024-07-31T18:11:25Z

⚪ 2024-07-31 18:11:25 UTC Pre-commit check for 891c528 has started.
⚪ 2024-07-31 18:14:15 UTC Build linux-x86_64-relwithdebinfo is running...
🟢 2024-07-31 19:10:35 UTC Build successful.
⚪ 2024-07-31 19:10:57 UTC Tests are running...
🔴 2024-07-31 20:55:34 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
39786	34549	0	1	5221	15

🟡 2024-07-31 20:56:14 UTC ydbd size 8.1 GiB changed* by +831.2 KiB, which is >= 100.0 KiB vs stable-24-3: Warning

ydbd size dash	stable-24-3: `57fe13a`	merge: `891c528`	diff	diff %
ydbd size	8 724 279 368 Bytes	8 725 130 544 Bytes	+831.2 KiB	+0.010%
ydbd stripped size	476 945 928 Bytes	476 988 104 Bytes	+41.2 KiB	+0.009%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-07-31T18:12:03Z

⚪ 2024-07-31 18:12:02 UTC Pre-commit check for 891c528 has started.
⚪ 2024-07-31 18:14:57 UTC Build linux-x86_64-release-clang14 is running...
🟢 2024-07-31 18:50:26 UTC Build successful.

github-actions · 2024-07-31T18:12:08Z

⚪ 2024-07-31 18:12:07 UTC Pre-commit check for 891c528 has started.
⚪ 2024-07-31 18:14:55 UTC Build linux-x86_64-release-asan is running...
🟢 2024-07-31 18:58:50 UTC Build successful.
⚪ 2024-07-31 18:59:09 UTC Tests are running...
🔴 2024-07-31 20:55:15 UTC Some tests failed, follow the links below.

Test history | Test log

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
11247	11194	0	11	27	15

🟡 2024-07-31 20:55:55 UTC ydbd size 5.5 GiB changed* by +532.5 KiB, which is >= 100.0 KiB vs stable-24-3: Warning

ydbd size dash	stable-24-3: `57fe13a`	merge: `891c528`	diff	diff %
ydbd size	5 904 537 912 Bytes	5 905 083 192 Bytes	+532.5 KiB	+0.009%
ydbd stripped size	1 480 421 440 Bytes	1 480 536 992 Bytes	+112.8 KiB	+0.008%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

YQ WM fix for sls feature flag (ydb-platform#7057)

c2fb3fa

GrigoriyPA requested a review from a team as a code owner July 30, 2024 11:34

YQ-3446 add queued time into query stats (ydb-platform#6965)

6c0b232

YQ-3442 added pools cache (ydb-platform#7186)

34a0622

GrigoriyPA requested a review from fomichev3000 July 31, 2024 18:13

fomichev3000 approved these changes Aug 1, 2024

View reviewed changes

GrigoriyPA merged commit 2f21060 into ydb-platform:stable-24-3 Aug 2, 2024
8 of 12 checks passed

GrigoriyPA deleted the merge-to-stable-WM-fixed-bugs-and-performance branch August 2, 2024 06:08

niksaveliev mentioned this pull request Aug 15, 2024

New kafka metering fix #7856

Closed

This was referenced Aug 16, 2024

Fix use after move in http_proxy #7884

Closed

fix use after move in http_proxy #7885

Merged

StekPerepolnen mentioned this pull request Aug 23, 2024

merge/stable 24 3/query float test asan #8192

Closed

siarheivesialou mentioned this pull request Aug 28, 2024

stable 24 3 6 logbroker add 5 last requests #8389

Closed

swalrus1 mentioned this pull request Sep 3, 2024

Update stable-24-3: add metrics to describe table #8688

Closed

This was referenced Oct 29, 2024

viewer healthcheck pathmerge stable 24 3 11 hotfix #11042

Closed

viewer healthcheck pathmerge stable 24 #11044

Closed

serbel324 mentioned this pull request Nov 19, 2024

Merge double accelerations into 24-3 #11740

Merged

GrigoriyPA mentioned this pull request Feb 21, 2025

merge to ydb stable YQ-4070 supported insert values for s3 #14914

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

WM fixed bugs and performance #7254

WM fixed bugs and performance #7254

GrigoriyPA commented Jul 30, 2024 •

edited

Loading

github-actions bot commented Jul 30, 2024 •

edited

Loading

github-actions bot commented Jul 30, 2024 •

edited

Loading

github-actions bot commented Jul 30, 2024 •

edited

Loading

github-actions bot commented Jul 30, 2024 •

edited

Loading

github-actions bot commented Jul 30, 2024 •

edited

Loading

github-actions bot commented Jul 30, 2024 •

edited

Loading

github-actions bot commented Jul 31, 2024 •

edited

Loading

github-actions bot commented Jul 31, 2024 •

edited

Loading

github-actions bot commented Jul 31, 2024 •

edited

Loading

WM fixed bugs and performance #7254

WM fixed bugs and performance #7254

Conversation

GrigoriyPA commented Jul 30, 2024 • edited Loading

Changelog entry

Changelog category

Additional information

github-actions bot commented Jul 30, 2024 • edited Loading

github-actions bot commented Jul 30, 2024 • edited Loading

github-actions bot commented Jul 30, 2024 • edited Loading

github-actions bot commented Jul 30, 2024 • edited Loading

github-actions bot commented Jul 30, 2024 • edited Loading

github-actions bot commented Jul 30, 2024 • edited Loading

github-actions bot commented Jul 31, 2024 • edited Loading

github-actions bot commented Jul 31, 2024 • edited Loading

github-actions bot commented Jul 31, 2024 • edited Loading

GrigoriyPA commented Jul 30, 2024 •

edited

Loading

github-actions bot commented Jul 30, 2024 •

edited

Loading

github-actions bot commented Jul 30, 2024 •

edited

Loading

github-actions bot commented Jul 30, 2024 •

edited

Loading

github-actions bot commented Jul 30, 2024 •

edited

Loading

github-actions bot commented Jul 30, 2024 •

edited

Loading

github-actions bot commented Jul 30, 2024 •

edited

Loading

github-actions bot commented Jul 31, 2024 •

edited

Loading

github-actions bot commented Jul 31, 2024 •

edited

Loading

github-actions bot commented Jul 31, 2024 •

edited

Loading