Additional validation for s3 reads/writes #12082

evanevanevanevannnn · 2024-11-28T09:04:31Z

Changelog entry

Additional validation for s3 writes, double optional types are now explicitly unsupported

fix for YQ-1992

Changelog category

Improvement

github-actions · 2024-11-28T09:06:02Z

⚪ 2024-11-28 09:06:01 UTC Pre-commit check linux-x86_64-relwithdebinfo for 5d1813f has started.
⚪ 2024-11-28 09:06:12 UTC Artifacts will be uploaded here
⚪ 2024-11-28 09:09:18 UTC ya make is running...
🟡 2024-11-28 10:13:17 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
30070	27232	0	2	2718	118

⚪ 2024-11-28 10:15:42 UTC ya make is running... (failed tests rerun, try 2)
🟡 2024-11-28 10:29:23 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
733 (only retried tests)	623	0	1	1	108

⚪ 2024-11-28 10:29:35 UTC ya make is running... (failed tests rerun, try 3)
🔴 2024-11-28 10:43:38 UTC Some tests failed, follow the links below.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
626 (only retried tests)	519	0	1	0	106

🟢 2024-11-28 10:43:50 UTC Build successful.
🟢 2024-11-28 10:44:11 UTC ydbd size 2.5 GiB changed* by +4.4 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash	main: `31e0e46`	merge: `5d1813f`	diff	diff %
ydbd size	2 695 008 432 Bytes	2 695 012 928 Bytes	+4.4 KiB	+0.000%
ydbd stripped size	482 192 560 Bytes	482 193 136 Bytes	+576 Bytes	+0.000%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-11-28T09:06:15Z

⚪ 2024-11-28 09:06:15 UTC Pre-commit check linux-x86_64-release-asan for 5d1813f has started.
⚪ 2024-11-28 09:06:26 UTC Artifacts will be uploaded here
⚪ 2024-11-28 09:09:20 UTC ya make is running...
🟡 2024-11-28 10:29:29 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
12937	12864	0	12	6	55

🟢 2024-11-28 10:30:34 UTC Build successful.
🟡 2024-11-28 10:31:06 UTC ydbd size 4.9 GiB changed* by +200.9 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash	main: `bf6d055`	merge: `5d1813f`	diff	diff %
ydbd size	5 294 621 088 Bytes	5 294 826 792 Bytes	+200.9 KiB	+0.004%
ydbd stripped size	1 361 097 392 Bytes	1 361 156 080 Bytes	+57.3 KiB	+0.004%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-11-28T11:19:29Z

⚪ 2024-11-28 11:19:29 UTC Pre-commit check linux-x86_64-relwithdebinfo for 6f76801 has started.
⚪ 2024-11-28 11:19:40 UTC Artifacts will be uploaded here
⚪ 2024-11-28 11:22:43 UTC ya make is running...
⚫ 2024-11-28 11:36:03 UTC Check cancelled

github-actions · 2024-11-28T11:19:37Z

⚪ 2024-11-28 11:19:36 UTC Pre-commit check linux-x86_64-release-asan for 6f76801 has started.
⚪ 2024-11-28 11:19:47 UTC Artifacts will be uploaded here
⚪ 2024-11-28 11:22:42 UTC ya make is running...
⚫ 2024-11-28 11:36:02 UTC Check cancelled

github-actions · 2024-11-28T11:37:51Z

⚪ 2024-11-28 11:37:50 UTC Pre-commit check linux-x86_64-relwithdebinfo for 8e85a8d has started.
⚫ 2024-11-28 11:39:56 UTC Check cancelled

github-actions · 2024-11-28T11:43:31Z

⚪ 2024-11-28 11:43:30 UTC Pre-commit check linux-x86_64-relwithdebinfo for b7c12a3 has started.
⚪ 2024-11-28 11:43:41 UTC Artifacts will be uploaded here
⚪ 2024-11-28 11:46:37 UTC ya make is running...
⚫ 2024-11-28 12:38:01 UTC Check cancelled

github-actions · 2024-11-28T11:44:03Z

⚪ 2024-11-28 11:44:02 UTC Pre-commit check linux-x86_64-release-asan for b7c12a3 has started.
⚪ 2024-11-28 11:44:44 UTC Artifacts will be uploaded here
⚪ 2024-11-28 11:48:20 UTC ya make is running...
⚫ 2024-11-28 12:38:03 UTC Check cancelled

github-actions · 2024-11-28T12:40:42Z

⚪ 2024-11-28 12:40:42 UTC Pre-commit check linux-x86_64-relwithdebinfo for fc9684b has started.
⚪ 2024-11-28 12:40:55 UTC Artifacts will be uploaded here
⚪ 2024-11-28 12:44:08 UTC ya make is running...
🟡 2024-11-28 13:44:41 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
30671	27835	0	1	2718	117

⚪ 2024-11-28 13:47:18 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-11-28 13:58:49 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
825 (only retried tests)	716	0	0	1	108

🟢 2024-11-28 13:58:59 UTC Build successful.
🟢 2024-11-28 13:59:19 UTC ydbd size 2.5 GiB changed* by +22.3 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash	main: `97c9f43`	merge: `fc9684b`	diff	diff %
ydbd size	2 686 355 384 Bytes	2 686 378 176 Bytes	+22.3 KiB	+0.001%
ydbd stripped size	482 203 696 Bytes	482 206 832 Bytes	+3.1 KiB	+0.001%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

github-actions · 2024-11-28T12:41:41Z

⚪ 2024-11-28 12:41:40 UTC Pre-commit check linux-x86_64-release-asan for fc9684b has started.
⚪ 2024-11-28 12:42:01 UTC Artifacts will be uploaded here
⚪ 2024-11-28 12:45:11 UTC ya make is running...
🟡 2024-11-28 13:54:39 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS	PASSED	ERRORS	FAILED	SKIPPED	MUTED^?
13339	13256	0	26	9	48

🟢 2024-11-28 13:55:53 UTC Build successful.
🟢 2024-11-28 13:56:23 UTC ydbd size 4.9 GiB changed* by -13.6 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash	main: `a02f6d5`	merge: `fc9684b`	diff	diff %
ydbd size	5 294 884 792 Bytes	5 280 647 400 Bytes	-13.6 MiB	-0.269%
ydbd stripped size	1 361 164 464 Bytes	1 361 203 888 Bytes	+38.5 KiB	+0.003%

^{*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation}

additional validation for s3 datasinks

a03f6c6

evanevanevanevannnn requested a review from a team as a code owner November 28, 2024 09:04

evanevanevanevannnn requested a review from dorooleg November 28, 2024 09:04

github-actions bot added improvement and removed improvement labels Nov 28, 2024

fixed issues

af45a1a

fixed issues

d6575ed

fixed error message

debae67

added validation for reading

ce24fcf

evanevanevanevannnn changed the title ~~Additional validation for s3 datasinks~~ Additional validation for s3 reads/writes Nov 28, 2024

github-actions bot added improvement and removed improvement labels Nov 28, 2024

newline added

4fd5d84

dorooleg approved these changes Nov 28, 2024

View reviewed changes

evanevanevanevannnn merged commit 6067a04 into ydb-platform:main Nov 28, 2024
10 checks passed

evanevanevanevannnn deleted the YQ_1992_fix branch November 28, 2024 14:11

StekPerepolnen mentioned this pull request Nov 29, 2024

viewer script execute swagger #12137

Merged

naspirato mentioned this pull request Dec 1, 2024

regression TPCC main 28.11-30.11 #12165

Open

GrigoriyPA pushed a commit to GrigoriyPA/ydb that referenced this pull request Feb 21, 2025

Additional validation for s3 reads/writes (ydb-platform#12082)

3bafa91

GrigoriyPA mentioned this pull request Feb 21, 2025

merge to ydb stable YQ-4070 supported insert values for s3 #14914

Closed

GrigoriyPA mentioned this pull request Feb 21, 2025

merge to ydb stable YQ-4070 supported insert values for s3 #14915

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Additional validation for s3 reads/writes #12082

Additional validation for s3 reads/writes #12082

evanevanevanevannnn commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

Additional validation for s3 reads/writes #12082

Additional validation for s3 reads/writes #12082

Conversation

evanevanevanevannnn commented Nov 28, 2024 • edited Loading

Changelog entry

Changelog category

github-actions bot commented Nov 28, 2024 • edited Loading

github-actions bot commented Nov 28, 2024 • edited Loading

github-actions bot commented Nov 28, 2024 • edited Loading

github-actions bot commented Nov 28, 2024 • edited Loading

github-actions bot commented Nov 28, 2024 • edited Loading

github-actions bot commented Nov 28, 2024 • edited Loading

github-actions bot commented Nov 28, 2024 • edited Loading

github-actions bot commented Nov 28, 2024 • edited Loading

github-actions bot commented Nov 28, 2024 • edited Loading

evanevanevanevannnn commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading

github-actions bot commented Nov 28, 2024 •

edited

Loading