Skip to content

Add BuildStats B-Tree detailed logging #15193

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Mar 5, 2025
Merged

Conversation

kunga
Copy link
Member

@kunga kunga commented Feb 28, 2025

Changelog entry

...

Changelog category

  • Not for changelog (changelog entry is not required)

Description for reviewers

In order to debug #15235

@kunga kunga self-assigned this Feb 28, 2025
Copy link

github-actions bot commented Feb 28, 2025

🟢 2025-03-03 16:42:08 UTC The validation of the Pull Request description is successful.

Copy link

github-actions bot commented Feb 28, 2025

2025-02-28 11:54:40 UTC Pre-commit check linux-x86_64-release-asan for ee97bc3 has started.
2025-02-28 11:54:53 UTC Artifacts will be uploaded here
2025-02-28 11:57:52 UTC ya make is running...
🔴 2025-02-28 12:01:36 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Feb 28, 2025

2025-02-28 11:59:13 UTC Pre-commit check linux-x86_64-relwithdebinfo for ee97bc3 has started.
2025-02-28 11:59:16 UTC Artifacts will be uploaded here
2025-02-28 12:02:04 UTC ya make is running...
🔴 2025-02-28 12:05:12 UTC Build failed, see the logs. Also see fail summary

@kunga kunga changed the title Debug B-Tree histograms Add BuildStats B-Tree detailed logging Mar 3, 2025
Copy link

github-actions bot commented Mar 3, 2025

2025-03-03 16:41:17 UTC Pre-commit check linux-x86_64-release-asan for 7a88e63 has started.
2025-03-03 16:41:31 UTC Artifacts will be uploaded here
2025-03-03 16:44:26 UTC ya make is running...
🟡 2025-03-03 18:13:56 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
13436 13293 0 89 16 38

2025-03-03 18:15:46 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-03 18:28:53 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
201 (only retried tests) 165 0 2 3 31

2025-03-03 18:29:06 UTC ya make is running... (failed tests rerun, try 3)
🟢 2025-03-03 18:43:51 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
63 (only retried tests) 32 0 0 1 30

🟢 2025-03-03 18:44:04 UTC Build successful.
🟡 2025-03-03 18:44:36 UTC ydbd size 3.7 GiB changed* by +240.2 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 55bb8ab merge: 7a88e63 diff diff %
ydbd size 3 989 365 008 Bytes 3 989 610 976 Bytes +240.2 KiB +0.006%
ydbd stripped size 1 388 709 288 Bytes 1 388 782 152 Bytes +71.2 KiB +0.005%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 3, 2025

2025-03-03 16:42:53 UTC Pre-commit check linux-x86_64-relwithdebinfo for 7a88e63 has started.
2025-03-03 16:43:08 UTC Artifacts will be uploaded here
2025-03-03 16:46:09 UTC ya make is running...
🟡 2025-03-03 17:54:43 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
27813 25207 0 4 2467 135

2025-03-03 17:57:08 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-03-03 18:13:34 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
209 (only retried tests) 84 0 0 0 125

🟢 2025-03-03 18:13:43 UTC Build successful.
🟡 2025-03-03 18:14:01 UTC ydbd size 2.1 GiB changed* by +128.1 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 55bb8ab merge: 7a88e63 diff diff %
ydbd size 2 288 962 280 Bytes 2 289 093 416 Bytes +128.1 KiB +0.006%
ydbd stripped size 479 716 288 Bytes 479 744 960 Bytes +28.0 KiB +0.006%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 4, 2025

2025-03-04 10:11:18 UTC Pre-commit check linux-x86_64-release-asan for d5bcf86 has started.
2025-03-04 10:11:34 UTC Artifacts will be uploaded here
2025-03-04 10:15:00 UTC ya make is running...
🟡 2025-03-04 12:02:13 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14035 13892 0 77 29 37

2025-03-04 12:03:40 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-04 12:19:22 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
183 (only retried tests) 144 0 6 1 32

2025-03-04 12:19:34 UTC ya make is running... (failed tests rerun, try 3)
🟡 2025-03-04 12:35:20 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
68 (only retried tests) 35 0 1 1 31

🟢 2025-03-04 12:35:31 UTC Build successful.
🟡 2025-03-04 12:36:05 UTC ydbd size 3.7 GiB changed* by +256.4 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 269d7ae merge: d5bcf86 diff diff %
ydbd size 3 989 555 120 Bytes 3 989 817 672 Bytes +256.4 KiB +0.007%
ydbd stripped size 1 388 759 208 Bytes 1 388 832 840 Bytes +71.9 KiB +0.005%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 4, 2025

2025-03-04 10:20:09 UTC Pre-commit check linux-x86_64-relwithdebinfo for d5bcf86 has started.
2025-03-04 10:20:24 UTC Artifacts will be uploaded here
2025-03-04 10:23:52 UTC ya make is running...
🟡 2025-03-04 12:03:07 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
28541 25929 0 3 2471 138

2025-03-04 12:05:34 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-04 12:21:49 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
214 (only retried tests) 88 0 1 0 125

2025-03-04 12:22:03 UTC ya make is running... (failed tests rerun, try 3)
🔴 2025-03-04 12:38:42 UTC Some tests failed, follow the links below.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
186 (only retried tests) 60 0 1 0 125

🟢 2025-03-04 12:38:57 UTC Build successful.
🟡 2025-03-04 12:39:20 UTC ydbd size 2.1 GiB changed* by +139.0 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 269d7ae merge: d5bcf86 diff diff %
ydbd size 2 289 055 416 Bytes 2 289 197 752 Bytes +139.0 KiB +0.006%
ydbd stripped size 479 733 824 Bytes 479 764 288 Bytes +29.8 KiB +0.006%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@kunga kunga marked this pull request as ready for review March 4, 2025 12:49
@kunga kunga requested a review from snaury March 4, 2025 12:50
Copy link

github-actions bot commented Mar 4, 2025

2025-03-04 12:55:21 UTC Pre-commit check linux-x86_64-release-asan for 457bb78 has started.
2025-03-04 12:55:37 UTC Artifacts will be uploaded here
2025-03-04 12:59:07 UTC ya make is running...
🟡 2025-03-04 14:14:42 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14032 13911 0 63 18 40

2025-03-04 14:17:13 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-04 14:32:32 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
165 (only retried tests) 119 0 9 3 34

2025-03-04 14:32:46 UTC ya make is running... (failed tests rerun, try 3)
🟢 2025-03-04 14:45:30 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
75 (only retried tests) 42 0 0 1 32

🟢 2025-03-04 14:45:40 UTC Build successful.
🟡 2025-03-04 14:46:21 UTC ydbd size 3.7 GiB changed* by +260.4 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 57dc7ac merge: 457bb78 diff diff %
ydbd size 3 989 750 528 Bytes 3 990 017 176 Bytes +260.4 KiB +0.007%
ydbd stripped size 1 388 808 424 Bytes 1 388 886 152 Bytes +75.9 KiB +0.006%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 4, 2025

2025-03-04 12:55:56 UTC Pre-commit check linux-x86_64-relwithdebinfo for 457bb78 has started.
2025-03-04 12:56:20 UTC Artifacts will be uploaded here
2025-03-04 13:00:08 UTC ya make is running...
🟡 2025-03-04 14:00:22 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
28541 25929 0 2 2466 144

2025-03-04 14:03:17 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-03-04 14:21:13 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
216 (only retried tests) 89 0 0 0 127

🟢 2025-03-04 14:21:27 UTC Build successful.
🟡 2025-03-04 14:21:49 UTC ydbd size 2.1 GiB changed* by +143.0 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 57dc7ac merge: 457bb78 diff diff %
ydbd size 2 289 174 928 Bytes 2 289 321 376 Bytes +143.0 KiB +0.006%
ydbd stripped size 479 753 792 Bytes 479 788 352 Bytes +33.8 KiB +0.007%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@kunga kunga requested a review from snaury March 4, 2025 16:01
Copy link

github-actions bot commented Mar 4, 2025

2025-03-04 16:03:32 UTC Pre-commit check linux-x86_64-relwithdebinfo for 85feb6e has started.
2025-03-04 16:03:50 UTC Artifacts will be uploaded here
2025-03-04 16:07:15 UTC ya make is running...
🟡 2025-03-04 17:43:01 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
28532 25924 0 3 2467 138

2025-03-04 17:46:09 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-03-04 17:59:32 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
210 (only retried tests) 83 0 0 0 127

🟢 2025-03-04 17:59:42 UTC Build successful.
🟡 2025-03-04 18:00:01 UTC ydbd size 2.1 GiB changed* by +139.1 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 827cd39 merge: 85feb6e diff diff %
ydbd size 2 289 690 984 Bytes 2 289 833 400 Bytes +139.1 KiB +0.006%
ydbd stripped size 479 831 392 Bytes 479 861 664 Bytes +29.6 KiB +0.006%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 4, 2025

2025-03-04 16:05:01 UTC Pre-commit check linux-x86_64-release-asan for 85feb6e has started.
2025-03-04 16:05:17 UTC Artifacts will be uploaded here
2025-03-04 16:08:39 UTC ya make is running...
🟡 2025-03-04 17:56:32 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14015 13844 0 96 37 38

2025-03-04 17:57:46 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-04 18:13:01 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
229 (only retried tests) 187 0 2 6 34

2025-03-04 18:13:18 UTC ya make is running... (failed tests rerun, try 3)
🟢 2025-03-04 18:31:29 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
71 (only retried tests) 37 0 0 1 33

🟢 2025-03-04 18:31:38 UTC Build successful.
🟡 2025-03-04 18:32:07 UTC ydbd size 3.7 GiB changed* by +265.0 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 0ce9793 merge: 85feb6e diff diff %
ydbd size 3 990 667 704 Bytes 3 990 939 088 Bytes +265.0 KiB +0.007%
ydbd stripped size 1 389 071 592 Bytes 1 389 153 576 Bytes +80.1 KiB +0.006%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 5, 2025

2025-03-05 08:51:12 UTC Pre-commit check linux-x86_64-relwithdebinfo for 6cf3d43 has started.
2025-03-05 08:51:16 UTC Artifacts will be uploaded here
2025-03-05 08:54:36 UTC ya make is running...
🟡 2025-03-05 10:29:06 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
28533 25945 0 3 2466 119

2025-03-05 10:31:25 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-05 10:42:28 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
175 (only retried tests) 65 0 1 0 109

2025-03-05 10:42:36 UTC ya make is running... (failed tests rerun, try 3)
🟢 2025-03-05 10:53:58 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
156 (only retried tests) 47 0 0 0 109

🟢 2025-03-05 10:54:07 UTC Build successful.
🟡 2025-03-05 10:54:30 UTC ydbd size 2.1 GiB changed* by +137.0 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 9c6936d merge: 6cf3d43 diff diff %
ydbd size 2 290 087 664 Bytes 2 290 227 952 Bytes +137.0 KiB +0.006%
ydbd stripped size 479 952 384 Bytes 479 979 008 Bytes +26.0 KiB +0.006%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Mar 5, 2025

2025-03-05 08:53:56 UTC Pre-commit check linux-x86_64-release-asan for 6cf3d43 has started.
2025-03-05 08:54:11 UTC Artifacts will be uploaded here
2025-03-05 08:57:20 UTC ya make is running...
🟡 2025-03-05 10:45:18 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
14035 13869 0 77 47 42

2025-03-05 10:46:30 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-03-05 11:02:21 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
233 (only retried tests) 187 0 8 1 37

2025-03-05 11:02:32 UTC ya make is running... (failed tests rerun, try 3)
🟢 2025-03-05 11:18:04 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
78 (only retried tests) 44 0 0 1 33

🟢 2025-03-05 11:18:16 UTC Build successful.
🟡 2025-03-05 11:18:51 UTC ydbd size 3.7 GiB changed* by +267.1 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 9c6936d merge: 6cf3d43 diff diff %
ydbd size 3 990 867 248 Bytes 3 991 140 776 Bytes +267.1 KiB +0.007%
ydbd stripped size 1 388 994 440 Bytes 1 389 076 968 Bytes +80.6 KiB +0.006%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@kunga kunga enabled auto-merge (squash) March 5, 2025 09:17
@kunga kunga merged commit 9908e6c into ydb-platform:main Mar 5, 2025
12 checks passed
kunga added a commit to kunga/ydb that referenced this pull request Mar 5, 2025
kunga added a commit to kunga/ydb that referenced this pull request Mar 5, 2025
kunga added a commit to kunga/ydb that referenced this pull request Mar 5, 2025
kunga added a commit to kunga/ydb that referenced this pull request Mar 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants