Skip to content

spec: improve ls2ls spec #17114

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Feb 19, 2025
Merged

spec: improve ls2ls spec #17114

merged 2 commits into from
Feb 19, 2025

Conversation

yaauie
Copy link
Member

@yaauie yaauie commented Feb 18, 2025

Release notes

[rn:skip]

What does this PR do?

  • fixes upstream/downstream convention
    • upstream: the sending logstash (has an LS output)
    • downstream: the receiving logstash (has an LS input)
  • helper run_logstash_instance yields the LogstashService instance and handles the teardown (prevents teardown getting skipped when an exception occurs before it).
  • pass the pipeline id and node name to the LS instances via command line flags to make logging easier to differentiate
  • use the generator input's sequence id to ensure that the actual events generated are received by the downstream pipeline

Why is it important/What is the impact to the user?

No user impact; better tests same basic coverage.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • [ ] I have made corresponding changes to the documentation
  • [ ] I have made corresponding change to the default configuration files (and/or docker env variables)
  • I have added tests that prove my fix is effective or that my feature works

 - fixes upstream/downstream convention
   - upstream: the sending logstash (has an LS output)
   - downstream: the receiving logstash (has an LS input)
 - helper `run_logstash_instance` yields the `LogstashService` instance
   and handles the teardown.
 - pass the pipeline id and node name to the LS instances via command line
   flags to make logging easier to differentiate
 - use the generator input's sequence id to ensure that the _actual_ events
   generated are received by the downstream pipeline
@yaauie yaauie added the tests label Feb 18, 2025
@yaauie yaauie requested a review from mashhurs February 18, 2025 22:08
Copy link
Contributor

@mashhurs mashhurs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm~

Copy link

Quality Gate passed Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarQube

@elasticmachine
Copy link
Collaborator

💚 Build Succeeded

History

@mashhurs
Copy link
Contributor

It is green with issued pipeline, merging: https://buildkite.com/elastic/logstash-linux-jdk-matrix-pipeline/builds/392#_

@mashhurs mashhurs merged commit 9abad66 into elastic:main Feb 19, 2025
7 checks passed
@mashhurs
Copy link
Contributor

@logstashmachine backport 9.0

mashhurs added a commit to mashhurs/logstash that referenced this pull request Feb 19, 2025
* spec: improve ls2ls spec

 - fixes upstream/downstream convention
   - upstream: the sending logstash (has an LS output)
   - downstream: the receiving logstash (has an LS input)
 - helper `run_logstash_instance` yields the `LogstashService` instance
   and handles the teardown.
 - pass the pipeline id and node name to the LS instances via command line
   flags to make logging easier to differentiate
 - use the generator input's sequence id to ensure that the _actual_ events
   generated are received by the downstream pipeline

* start with port-offset 100

Co-authored-by: Mashhur <[email protected]>

---------

Co-authored-by: Mashhur <[email protected]>
(cherry picked from commit 9abad66)
@mashhurs
Copy link
Contributor

@logstashmachine backport 8.x

github-actions bot pushed a commit that referenced this pull request Feb 19, 2025
* spec: improve ls2ls spec

 - fixes upstream/downstream convention
   - upstream: the sending logstash (has an LS output)
   - downstream: the receiving logstash (has an LS input)
 - helper `run_logstash_instance` yields the `LogstashService` instance
   and handles the teardown.
 - pass the pipeline id and node name to the LS instances via command line
   flags to make logging easier to differentiate
 - use the generator input's sequence id to ensure that the _actual_ events
   generated are received by the downstream pipeline

* start with port-offset 100

Co-authored-by: Mashhur <[email protected]>

---------

Co-authored-by: Mashhur <[email protected]>
(cherry picked from commit 9abad66)
@mashhurs
Copy link
Contributor

@logstashmachine backport 8.18

github-actions bot pushed a commit that referenced this pull request Feb 19, 2025
* spec: improve ls2ls spec

 - fixes upstream/downstream convention
   - upstream: the sending logstash (has an LS output)
   - downstream: the receiving logstash (has an LS input)
 - helper `run_logstash_instance` yields the `LogstashService` instance
   and handles the teardown.
 - pass the pipeline id and node name to the LS instances via command line
   flags to make logging easier to differentiate
 - use the generator input's sequence id to ensure that the _actual_ events
   generated are received by the downstream pipeline

* start with port-offset 100

Co-authored-by: Mashhur <[email protected]>

---------

Co-authored-by: Mashhur <[email protected]>
(cherry picked from commit 9abad66)
@mashhurs
Copy link
Contributor

@logstashmachine backport 9.0

github-actions bot pushed a commit that referenced this pull request Feb 19, 2025
* spec: improve ls2ls spec

 - fixes upstream/downstream convention
   - upstream: the sending logstash (has an LS output)
   - downstream: the receiving logstash (has an LS input)
 - helper `run_logstash_instance` yields the `LogstashService` instance
   and handles the teardown.
 - pass the pipeline id and node name to the LS instances via command line
   flags to make logging easier to differentiate
 - use the generator input's sequence id to ensure that the _actual_ events
   generated are received by the downstream pipeline

* start with port-offset 100

Co-authored-by: Mashhur <[email protected]>

---------

Co-authored-by: Mashhur <[email protected]>
(cherry picked from commit 9abad66)
mashhurs pushed a commit that referenced this pull request Feb 19, 2025
* spec: improve ls2ls spec

 - fixes upstream/downstream convention
   - upstream: the sending logstash (has an LS output)
   - downstream: the receiving logstash (has an LS input)
 - helper `run_logstash_instance` yields the `LogstashService` instance
   and handles the teardown.
 - pass the pipeline id and node name to the LS instances via command line
   flags to make logging easier to differentiate
 - use the generator input's sequence id to ensure that the _actual_ events
   generated are received by the downstream pipeline

* start with port-offset 100

Co-authored-by: Mashhur <[email protected]>

---------

Co-authored-by: Mashhur <[email protected]>
(cherry picked from commit 9abad66)

Co-authored-by: Ry Biesemeyer <[email protected]>
mashhurs pushed a commit that referenced this pull request Feb 19, 2025
* spec: improve ls2ls spec

 - fixes upstream/downstream convention
   - upstream: the sending logstash (has an LS output)
   - downstream: the receiving logstash (has an LS input)
 - helper `run_logstash_instance` yields the `LogstashService` instance
   and handles the teardown.
 - pass the pipeline id and node name to the LS instances via command line
   flags to make logging easier to differentiate
 - use the generator input's sequence id to ensure that the _actual_ events
   generated are received by the downstream pipeline

* start with port-offset 100

Co-authored-by: Mashhur <[email protected]>

---------

Co-authored-by: Mashhur <[email protected]>
(cherry picked from commit 9abad66)

Co-authored-by: Ry Biesemeyer <[email protected]>
mashhurs pushed a commit that referenced this pull request Feb 19, 2025
* spec: improve ls2ls spec

 - fixes upstream/downstream convention
   - upstream: the sending logstash (has an LS output)
   - downstream: the receiving logstash (has an LS input)
 - helper `run_logstash_instance` yields the `LogstashService` instance
   and handles the teardown.
 - pass the pipeline id and node name to the LS instances via command line
   flags to make logging easier to differentiate
 - use the generator input's sequence id to ensure that the _actual_ events
   generated are received by the downstream pipeline

* start with port-offset 100

Co-authored-by: Mashhur <[email protected]>

---------

Co-authored-by: Mashhur <[email protected]>
(cherry picked from commit 9abad66)

Co-authored-by: Ry Biesemeyer <[email protected]>
@yaauie yaauie deleted the specs-improve-ls2ls branch February 19, 2025 17:23
v1v pushed a commit to v1v/logstash that referenced this pull request Feb 25, 2025
* spec: improve ls2ls spec

 - fixes upstream/downstream convention
   - upstream: the sending logstash (has an LS output)
   - downstream: the receiving logstash (has an LS input)
 - helper `run_logstash_instance` yields the `LogstashService` instance
   and handles the teardown.
 - pass the pipeline id and node name to the LS instances via command line
   flags to make logging easier to differentiate
 - use the generator input's sequence id to ensure that the _actual_ events
   generated are received by the downstream pipeline

* start with port-offset 100

Co-authored-by: Mashhur <[email protected]>

---------

Co-authored-by: Mashhur <[email protected]>
v1v added a commit to v1v/logstash that referenced this pull request Feb 25, 2025
…gify

* upstream/main: (27 commits)
  Add Windows 2025 to CI (elastic#17133)
  Update container acceptance tests with stdout/stderr changes (elastic#17138)
  entrypoint: avoid polluting stdout (elastic#17125)
  Fix acceptance test assertions for updated plugin remove (elastic#17126)
  Fix acceptance test assertions for updated plugin `remove` (elastic#17122)
  plugins: improve `remove` command to support multiple plugins (elastic#17030)
  spec: improve ls2ls spec (elastic#17114)
  allow concurrent Batch deserialization (elastic#17050)
  CPM handle 404 response gracefully with user-friendly log (elastic#17052)
  qa: use clean expansion of LS tarball per fixture instance (elastic#17082)
  Allow capturing heap dumps in DRA BK jobs (elastic#17081)
  Use centralized source of truth for active branches (elastic#17063)
  Update logstash_releases.json (elastic#17055)
  fix logstash-keystore to accept spaces in values when added via stdin (elastic#17039)
  Don't honor VERSION_QUALIFIER if set but empty (elastic#17032)
  Release note placeholder might be empty, making parsing lines nil tolerant. (elastic#17026)
  Fix BufferedTokenizer to properly resume after a buffer full condition respecting the encoding of the input string (elastic#16968)
  Add short living 9.0 next and update main in CI release version definition. (elastic#17008)
  Core version bump to 9.1.0 (elastic#16991)
  Add 9.0 branch to the CI branches definition (elastic#16997)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants