Skip to content

TESTOWNERS and migration to column shard #7733

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 19 commits into from
Aug 14, 2024

Conversation

naspirato
Copy link
Collaborator

@naspirato naspirato commented Aug 13, 2024

Changelog entry

  • changed destination of test runs upload : from datashard table to column shard table
  • added TESTOWNERS which will be used for analytics only so far

Changelog category

  • Not for changelog (changelog entry is not required)

Additional information

...

@naspirato naspirato changed the title Flaky analytics and migration to column shard TESTOWNERS and migration to column shard Aug 13, 2024
Copy link

github-actions bot commented Aug 13, 2024

2024-08-13 16:32:44 UTC Pre-commit check for 71de528 has started.
2024-08-13 16:36:19 UTC Check linux-x86_64-release-clang14 is running...

Copy link

github-actions bot commented Aug 13, 2024

2024-08-13 16:35:45 UTC Pre-commit check for 71de528 has started.
2024-08-13 16:39:19 UTC Check linux-x86_64-relwithdebinfo is running...
2024-08-13 17:02:49 UTC Check cancelled

Copy link

github-actions bot commented Aug 13, 2024

2024-08-13 16:50:46 UTC Pre-commit check for 71de528 has started.
2024-08-13 16:54:20 UTC Check linux-x86_64-release-asan is running...
2024-08-13 17:02:53 UTC Check cancelled

@naspirato naspirato requested a review from maximyurchuk August 13, 2024 16:55
Copy link

github-actions bot commented Aug 13, 2024

2024-08-13 17:56:04 UTC Pre-commit check for ba452f3 has started.
2024-08-13 18:00:04 UTC Check linux-x86_64-release-clang14 is running...

Copy link

github-actions bot commented Aug 13, 2024

2024-08-13 17:58:28 UTC Pre-commit check for ba452f3 has started.
2024-08-13 18:02:09 UTC Check linux-x86_64-relwithdebinfo is running...
🟡 2024-08-13 19:16:09 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
39715 34388 0 5 5308 14

2024-08-13 19:19:38 UTC Failed tests rerun (try 2) linux-x86_64-relwithdebinfo is running...
🟡 2024-08-13 19:28:24 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
24 (only retried tests) 12 0 1 1 10

2024-08-13 19:28:32 UTC Failed tests rerun (try 3) linux-x86_64-relwithdebinfo is running...
🟢 2024-08-13 19:36:16 UTC Tests successful.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
16 (only retried tests) 7 0 0 0 9

🟢 2024-08-13 19:36:23 UTC Build successful.
🟢 2024-08-13 19:36:54 UTC ydbd size 8.1 GiB changed* by -16 Bytes, which is <= 0 Bytes vs main: OK

ydbd size dash main: c1875d3 merge: ba452f3 diff diff %
ydbd size 8 703 104 424 Bytes 8 703 104 408 Bytes -16 Bytes -0.000%
ydbd stripped size 473 156 488 Bytes 473 156 488 Bytes 0 Bytes 0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Aug 13, 2024

2024-08-13 18:03:02 UTC Pre-commit check for ba452f3 has started.
2024-08-13 18:05:51 UTC Check linux-x86_64-release-asan is running...
🔴 2024-08-13 20:14:21 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
10910 10861 0 13 23 13

🟢 2024-08-13 20:15:21 UTC Build successful.
🟢 2024-08-13 20:15:50 UTC ydbd size 5.5 GiB changed* by -96 Bytes, which is <= 0 Bytes vs main: OK

ydbd size dash main: c1875d3 merge: ba452f3 diff diff %
ydbd size 5 853 000 728 Bytes 5 853 000 632 Bytes -96 Bytes -0.000%
ydbd stripped size 1 469 599 760 Bytes 1 469 599 696 Bytes -64 Bytes -0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Aug 14, 2024

2024-08-14 11:12:11 UTC Pre-commit check for bf193e7 has started.
2024-08-14 11:15:15 UTC Check linux-x86_64-release-asan is running...
2024-08-14 11:20:01 UTC Check cancelled

Copy link

github-actions bot commented Aug 14, 2024

2024-08-14 11:13:02 UTC Pre-commit check for bf193e7 has started.
2024-08-14 11:15:49 UTC Check linux-x86_64-relwithdebinfo is running...
2024-08-14 11:19:45 UTC Check cancelled

Copy link

github-actions bot commented Aug 14, 2024

2024-08-14 11:13:02 UTC Pre-commit check for bf193e7 has started.
2024-08-14 11:15:56 UTC Check linux-x86_64-release-clang14 is running...
2024-08-14 11:19:41 UTC Check cancelled

Copy link

github-actions bot commented Aug 14, 2024

2024-08-14 11:21:25 UTC Pre-commit check for c15f690 has started.
2024-08-14 11:24:12 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-08-14 11:30:02 UTC Build successful.

Copy link

github-actions bot commented Aug 14, 2024

2024-08-14 11:21:31 UTC Pre-commit check for c15f690 has started.
2024-08-14 11:25:21 UTC Check linux-x86_64-release-asan is running...
🔴 2024-08-14 13:26:48 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
10935 10858 0 9 29 39

🟢 2024-08-14 13:27:44 UTC Build successful.
🟢 2024-08-14 13:28:12 UTC ydbd size 5.5 GiB changed* by -96 Bytes, which is <= 0 Bytes vs main: OK

ydbd size dash main: b6537e1 merge: c15f690 diff diff %
ydbd size 5 869 833 096 Bytes 5 869 833 000 Bytes -96 Bytes -0.000%
ydbd stripped size 1 473 498 160 Bytes 1 473 498 096 Bytes -64 Bytes -0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Aug 14, 2024

2024-08-14 11:23:55 UTC Pre-commit check for c15f690 has started.
2024-08-14 11:26:40 UTC Check linux-x86_64-relwithdebinfo is running...
🟡 2024-08-14 12:54:22 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
39757 34407 0 6 5312 32

2024-08-14 12:57:46 UTC Failed tests rerun (try 2) linux-x86_64-relwithdebinfo is running...
🟢 2024-08-14 13:05:03 UTC Tests successful.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
55 (only retried tests) 26 0 0 0 29

🟢 2024-08-14 13:05:10 UTC Build successful.
🟢 2024-08-14 13:05:46 UTC ydbd size 8.1 GiB changed* by -32 Bytes, which is <= 0 Bytes vs main: OK

ydbd size dash main: b6537e1 merge: c15f690 diff diff %
ydbd size 8 725 240 952 Bytes 8 725 240 920 Bytes -32 Bytes -0.000%
ydbd stripped size 474 249 448 Bytes 474 249 448 Bytes 0 Bytes 0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

import urllib.parse

# Функция для декодирования percent-encoded строки
def decode_percent_encoded_string(encoded_string):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Чет непонятно зачем функция, которая перевызывает другую функцию as is

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Файл для удаления, поэтому коммент неактуален

.add_column("branch", ydb.OptionalType(ydb.PrimitiveType.Utf8))
.add_column("build_type", ydb.OptionalType(ydb.PrimitiveType.Utf8))
.add_column("commit", ydb.OptionalType(ydb.PrimitiveType.Utf8))
.add_column("duration", ydb.OptionalType(ydb.PrimitiveType.Double))
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Вот тут я бы предложил единицы измерения указать, типа duration_sec

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

к сожалению поздно
Нынешний ydb cli не умеет при ипорте/экспорте менять название столбца (насколько я видел)



def main():
# parser = argparse.ArgumentParser()
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ну не стоит закомменченный код коммитить

tc_settings = ydb.TableClientSettings().with_native_date_in_result_sets(enabled=True)
table_client = ydb.TableClient(driver, tc_settings)

#table_path = f'test_results/analytics/flaky_tests_history_{history_for_n_day}_days'
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Тоже стоит почистить

maximyurchuk
maximyurchuk previously approved these changes Aug 14, 2024
Copy link

github-actions bot commented Aug 14, 2024

2024-08-14 14:52:14 UTC Pre-commit check for c0c6a1f has started.
2024-08-14 14:55:57 UTC Check linux-x86_64-release-clang14 is running...
🟢 2024-08-14 14:56:07 UTC Build successful.

Copy link

github-actions bot commented Aug 14, 2024

2024-08-14 14:56:28 UTC Pre-commit check for c0c6a1f has started.
2024-08-14 14:58:42 UTC Check linux-x86_64-release-asan is running...
🟢 2024-08-14 14:58:46 UTC Tests successful.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2024-08-14 14:58:52 UTC Build successful.

Copy link

github-actions bot commented Aug 14, 2024

2024-08-14 14:57:24 UTC Pre-commit check for c0c6a1f has started.
2024-08-14 15:02:07 UTC Check linux-x86_64-relwithdebinfo is running...
🟢 2024-08-14 15:02:11 UTC Tests successful.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
0 0 0 0 0 0

🟢 2024-08-14 15:02:18 UTC Build successful.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants