Skip to content

ignoring columns with unsupported parquet and json types with type inferring #9524

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

evanevanevanevannnn
Copy link
Collaborator

Changelog entry

ignoring columns with unsupported parquet and json types (a.k.a. lists, structs, maps, dicts, etc) with type inferring

Changelog category

  • Improvement

Copy link

github-actions bot commented Sep 19, 2024

2024-09-19 14:57:10 UTC Pre-commit check linux-x86_64-release-clang14 for 1d8632e has started.
2024-09-19 14:57:19 UTC Artifacts will be uploaded here
2024-09-19 15:00:09 UTC ya make is running...
🔴 2024-09-19 15:06:00 UTC Build failed, see the logs.

Copy link

github-actions bot commented Sep 19, 2024

2024-09-19 14:57:35 UTC Pre-commit check linux-x86_64-release-asan for 1d8632e has started.
2024-09-19 14:57:47 UTC Artifacts will be uploaded here
2024-09-19 15:00:40 UTC ya make is running...
🔴 2024-09-19 15:08:25 UTC Build failed, see the logs.

Copy link

github-actions bot commented Sep 19, 2024

2024-09-19 14:57:43 UTC Pre-commit check linux-x86_64-relwithdebinfo for 1d8632e has started.
2024-09-19 14:57:52 UTC Artifacts will be uploaded here
2024-09-19 15:00:40 UTC ya make is running...
🔴 2024-09-19 15:07:06 UTC Build failed, see the logs.

@maximyurchuk maximyurchuk added the rebase-and-check Rebase PR with the current base branch and check label Sep 19, 2024
@github-actions github-actions bot removed the rebase-and-check Rebase PR with the current base branch and check label Sep 19, 2024
Copy link

github-actions bot commented Sep 19, 2024

2024-09-19 15:41:43 UTC Pre-commit check linux-x86_64-release-asan for 8b110a5 has started.
2024-09-19 15:41:53 UTC Artifacts will be uploaded here
2024-09-19 15:44:48 UTC ya make is running...
🔴 2024-09-19 17:35:57 UTC Some tests failed, follow the links below.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
10465 10260 0 44 47 114

🟢 2024-09-19 17:36:53 UTC Build successful.
🟢 2024-09-19 17:37:30 UTC ydbd size 5.6 GiB changed* by -21.4 KiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 56fbcfc merge: 8b110a5 diff diff %
ydbd size 6 060 489 768 Bytes 6 060 467 824 Bytes -21.4 KiB -0.000%
ydbd stripped size 1 516 100 592 Bytes 1 516 095 472 Bytes -5.0 KiB -0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Sep 19, 2024

2024-09-19 15:41:49 UTC Pre-commit check linux-x86_64-release-clang14 for 8b110a5 has started.
2024-09-19 15:41:59 UTC Artifacts will be uploaded here
2024-09-19 15:44:48 UTC ya make is running...
🟢 2024-09-19 15:53:04 UTC Build successful.

Copy link

github-actions bot commented Sep 19, 2024

2024-09-19 15:42:01 UTC Pre-commit check linux-x86_64-relwithdebinfo for 8b110a5 has started.
2024-09-19 15:42:11 UTC Artifacts will be uploaded here
2024-09-19 15:45:01 UTC ya make is running...
🟡 2024-09-19 16:46:04 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15109 13470 0 5 1602 32

2024-09-19 16:47:21 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-09-19 16:58:40 UTC Tests successful.

Test history | Ya make output

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
273 (only retried tests) 174 0 0 7 92

🟢 2024-09-19 16:58:47 UTC Build successful.
🟡 2024-09-19 16:59:26 UTC ydbd size 8.4 GiB changed* by +743.2 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: 62a72cf merge: 8b110a5 diff diff %
ydbd size 9 041 195 984 Bytes 9 041 957 048 Bytes +743.2 KiB +0.008%
ydbd stripped size 489 132 360 Bytes 489 271 016 Bytes +135.4 KiB +0.028%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@evanevanevanevannnn evanevanevanevannnn merged commit a5bf388 into ydb-platform:main Sep 20, 2024
14 of 18 checks passed
evanevanevanevannnn added a commit to evanevanevanevannnn/ydb that referenced this pull request Sep 20, 2024
evanevanevanevannnn added a commit to evanevanevanevannnn/ydb that referenced this pull request Sep 23, 2024
@evanevanevanevannnn evanevanevanevannnn deleted the YQ_3690_fix branch October 7, 2024 10:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants