Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pass through swift-testing's experimental JSON streams from swift test #7534

Merged
merged 3 commits into from
May 8, 2024

Conversation

grynspan
Copy link
Contributor

@grynspan grynspan commented May 7, 2024

This PR adds two undocumented/unsupported experimental options to swift test to allow passing through JSON files/streams for input and output. These streams are still under development in swift-testing, so these options are not yet supported, but this change will allow interested coders to experiment with them.

…st`.

This PR adds two undocumented/unsupported experimental options to `swift test`
to allow passing through JSON files/streams for input and output. These streams
are still under development in swift-testing, so these options are not yet
supported, but this change will allow interested coders to experiment with them.
@grynspan grynspan added swift test Changes impacting `swift test` tool command-line interface labels May 7, 2024
@grynspan grynspan self-assigned this May 7, 2024
@grynspan
Copy link
Contributor Author

grynspan commented May 7, 2024

@swift-ci please test

@grynspan
Copy link
Contributor Author

grynspan commented May 7, 2024

@swift-ci please test

@grynspan grynspan requested a review from MaxDesiatov May 7, 2024 18:21
@grynspan
Copy link
Contributor Author

grynspan commented May 7, 2024

@swift-ci please test Windows

@MaxDesiatov MaxDesiatov added the needs tests This change needs test coverage label May 7, 2024
@grynspan
Copy link
Contributor Author

grynspan commented May 7, 2024

@swift-ci please test Windows

@grynspan
Copy link
Contributor Author

grynspan commented May 8, 2024

Windows failure does not appear related to this PR.

@grynspan
Copy link
Contributor Author

grynspan commented May 8, 2024

@swift-ci please test Windows

@grynspan grynspan merged commit 8ca3091 into main May 8, 2024
5 checks passed
@grynspan grynspan deleted the jgrynspan/pass-through-swift-testing-json-streams branch May 8, 2024 17:23
grynspan added a commit to swiftlang/swift-testing that referenced this pull request May 10, 2024
This PR defines a JSON schema for events output from swift-testing via
either `--experimental-event-stream-output` or `abiEntryPoint_v0()`. The
JSON schema needs to be formally reviewed separately.

We are already writing an experimental JSON stream using "snapshot"
types and we don't want to break folks experimenting with it before we
have a final JSON schema, so for now that remains the default. To opt
into the new schema, pass `--experimental-event-stream-version 0` (note
that this argument is not forwarded from `swift test`. See
swiftlang/swift-package-manager#7534.)

Resolves #368.

### Checklist:

- [x] Code and documentation should follow the style of the [Style
Guide](https://github.com/apple/swift-testing/blob/main/Documentation/StyleGuide.md).
- [x] If public symbols are renamed or modified, DocC references should
be updated.
grynspan added a commit that referenced this pull request May 10, 2024
Follow-on to #7534. swift-testing has an additional argument specifying the
schema version of the JSON being used that we also need to pass through SwiftPM.

See: swiftlang/swift-testing#383
grynspan added a commit that referenced this pull request May 10, 2024
…7551)

Follow-on to #7534. swift-testing has an additional argument specifying
the schema version of the JSON being used that we also need to pass
through SwiftPM.

See: swiftlang/swift-testing#383
furby-tm pushed a commit to wabiverse/swift-package-manager that referenced this pull request May 15, 2024
…st` (swiftlang#7534)

This PR adds two undocumented/unsupported experimental options to `swift
test` to allow passing through JSON files/streams for input and output.
These streams are still under development in swift-testing, so these
options are not yet supported, but this change will allow interested
coders to experiment with them.

---------

Co-authored-by: Max Desiatov <[email protected]>
furby-tm pushed a commit to wabiverse/swift-package-manager that referenced this pull request May 15, 2024
…wiftlang#7551)

Follow-on to swiftlang#7534. swift-testing has an additional argument specifying
the schema version of the JSON being used that we also need to pass
through SwiftPM.

See: swiftlang/swift-testing#383
grynspan added a commit that referenced this pull request May 15, 2024
…st` (#7534)

This PR adds two undocumented/unsupported experimental options to `swift
test` to allow passing through JSON files/streams for input and output.
These streams are still under development in swift-testing, so these
options are not yet supported, but this change will allow interested
coders to experiment with them.

---------

Co-authored-by: Max Desiatov <[email protected]>
grynspan added a commit that referenced this pull request May 15, 2024
…7551)

Follow-on to #7534. swift-testing has an additional argument specifying
the schema version of the JSON being used that we also need to pass
through SwiftPM.

See: swiftlang/swift-testing#383
grynspan added a commit that referenced this pull request May 15, 2024
Explanation: Pass through `--experimental-configuration-path`,
`--experimental-event-stream-output`, and
`--experimental-event-stream-version` as used by swift-testing. These
flags are needed for continued experimental support of swift-testing
when using the Swift 6 toolchain.
Scope: Hidden flags in `swift test`.
Original PR: #7534, #7551
Risk: No obvious risk. These flags have no effect on `swift test` itself
and are simply passed through verbatim to the swift-testing test
executable.
Testing: Tested at-desk that the flags are seen by swift-testing with an
appropriate toolchain.
Reviewer: @bnbarham, @MaxDesiatov, @stmontgomery

---------

Co-authored-by: Max Desiatov <[email protected]>
furby-tm pushed a commit to wabiverse/swift-package-manager that referenced this pull request May 15, 2024
…st` (swiftlang#7534)

This PR adds two undocumented/unsupported experimental options to `swift
test` to allow passing through JSON files/streams for input and output.
These streams are still under development in swift-testing, so these
options are not yet supported, but this change will allow interested
coders to experiment with them.

---------

Co-authored-by: Max Desiatov <[email protected]>
furby-tm pushed a commit to wabiverse/swift-package-manager that referenced this pull request May 15, 2024
…wiftlang#7551)

Follow-on to swiftlang#7534. swift-testing has an additional argument specifying
the schema version of the JSON being used that we also need to pass
through SwiftPM.

See: swiftlang/swift-testing#383
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
command-line interface needs tests This change needs test coverage swift test Changes impacting `swift test` tool
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants