Skip to content

ES|QL: label drivers in profile info for FORK #128318

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
May 23, 2025

Conversation

ioanatia
Copy link
Contributor

When we added streaming support for FORK, one piece of feedback was that we should check how we expose the profile info when executing FORK and add a test for it: #126705 (review)

I added labels for the drivers that get executed on the coordinator.
The data and node_reduce ones are not labelled with the sub plan number - I was thinking of changing that (although it's a bit more involved), but then remembered from #126705 that we might want to send the physical plans for the FORK sub plans in a single request. So I wasn't sure if I really needed to proceed, since we might change the DataNodeComputeHandler and left it as it is for now.

Anyway, we got profile info for all the FORK sub plans and a test to catch any regressions.

@ioanatia ioanatia added >non-issue Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) :Analytics/ES|QL AKA ESQL labels May 22, 2025
@ioanatia ioanatia requested review from dnhatn and nik9000 May 22, 2025 17:25
@ioanatia ioanatia marked this pull request as ready for review May 22, 2025 17:25
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-analytical-engine (Team:Analytics)

@ioanatia ioanatia mentioned this pull request May 21, 2025
16 tasks
@ioanatia ioanatia requested a review from ChrisHegarty May 22, 2025 17:29
Copy link
Member

@dnhatn dnhatn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

Copy link
Member

@nik9000 nik9000 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For sure an improvement! I'm not sure what you mean about sending physical plans. I imagine you have to send the qualifier to the data nodes regardless of what sort of plan you send, but y'all know your business better than I do.

@ioanatia ioanatia merged commit 6aed71f into elastic:main May 23, 2025
18 checks passed
@ioanatia ioanatia deleted the fork_profile_info branch May 23, 2025 08:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Analytics/ES|QL AKA ESQL >non-issue Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) v9.1.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants