Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

conformance: add conformance CLI and action #287

Merged
merged 6 commits into from
Aug 2, 2023

Conversation

jleightcap
Copy link
Contributor

@jleightcap jleightcap commented Jul 28, 2023

Summary

Begins #178.

Release Note

Documentation

@jleightcap jleightcap force-pushed the jl/conformance-suite branch 4 times, most recently from 38b72f1 to 6ced192 Compare July 28, 2023 16:01
Cargo.toml Outdated Show resolved Hide resolved
@flavio
Copy link
Member

flavio commented Aug 1, 2023

This looks really promising, thanks for having started the efforts on this topic!

Do you want to get all the subcommands implemented in one single PR? I would personally be fine to take the code as it currently is and then slowly add the missing tests via dedicated PRs. In the meantime we can allow the GH actions running the conformance test suite to fail

@woodruffw
Copy link
Member

Do you want to get all the subcommands implemented in one single PR? I would personally be fine to take the code as it currently is and then slowly add the missing tests via dedicated PRs. In the meantime we can allow the GH actions running the conformance test suite to fail

No strong preference from me 🙂 -- @jleightcap, if you'd to shore this up in its current state and break up the remaining work into subsequent PRs, that works for me.

Signed-off-by: Jack Leightcap <[email protected]>
@jleightcap
Copy link
Contributor Author

Thanks for the feedback 🙂

I've carved out this PR to just implement the CLI specification and add the conformance action. The action is currently attempting to run the test suite -- future PRs will cover that functionality then.

@jleightcap jleightcap marked this pull request as ready for review August 1, 2023 18:24
@jleightcap jleightcap changed the title conformance: add conformance testing conformance: add conformance CLI and action Aug 1, 2023
Copy link
Member

@woodruffw woodruffw left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work @jleightcap!

@@ -0,0 +1,21 @@
on: [push, pull_request]
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe we should leave that commented, at least until the full specification is implemented. Otherwise it could be confusing to see the failures happen on PR and on the main branch

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Makes sense to me -- perhaps we should make it workflow_dispatch for the time being, so that it isn't triggered automatically but can be still done manually.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, this currently doesn't make sense. Thanks for the workflow_dispatch pointer @woodruffw (0e0ee5e)

@flavio flavio merged commit 0824ce1 into sigstore:main Aug 2, 2023
6 checks passed
@woodruffw woodruffw deleted the jl/conformance-suite branch August 2, 2023 15:36
flavio added a commit that referenced this pull request Dec 13, 2023
What's Changed
==============
* chore(deps): Update rstest requirement from 0.17.0 to 0.18.1 by @dependabot in #282
* chore(deps): do not enable default features of chrono by @flavio in #286
* chore(deps): Update pem requirement from 2.0 to 3.0 by @dependabot in #289
* conformance: add conformance CLI and action by @jleightcap in #287
* chore: fix clippy warnings by @flavio in #292
* chore(deps): Bump actions/checkout from 3.5.3 to 3.6.0 by @dependabot in #291
* chore(deps): Update tough requirement from 0.13 to 0.14 by @dependabot in #290
* chore(deps): update to latest version of picky by @flavio in #293
* chore(deps): Bump actions/checkout from 3.6.0 to 4.0.0 by @dependabot in #294
* chore: add repository link to Cargo metadata by @flavio in #297
* chore(deps): Update cached requirement from 0.44.0 to 0.45.1 by @dependabot in #298
* chore(deps): Bump actions/checkout from 4.0.0 to 4.1.0 by @dependabot in #302
* chore(deps): Update cached requirement from 0.45.1 to 0.46.0 by @dependabot in #301
* chore(deps): Update testcontainers requirement from 0.14 to 0.15 by @dependabot in #303
* chore(deps): Bump actions/checkout from 4.1.0 to 4.1.1 by @dependabot in #304
* cosign/tuf: use trustroot by @jleightcap in #305
* Fix broken tests, update deps by @flavio in #313

New Contributors
================

* @jleightcap made their first contribution in #287

**Full Changelog**: v0.7.2...v0.8.0

Signed-off-by: Luke Hinds <[email protected]>
Co-authored-by: Flavio Castelli <[email protected]>
flavio added a commit that referenced this pull request Dec 13, 2023
What's Changed
==============
* chore(deps): Update rstest requirement from 0.17.0 to 0.18.1 by @dependabot in #282
* chore(deps): do not enable default features of chrono by @flavio in #286
* chore(deps): Update pem requirement from 2.0 to 3.0 by @dependabot in #289
* conformance: add conformance CLI and action by @jleightcap in #287
* chore: fix clippy warnings by @flavio in #292
* chore(deps): Bump actions/checkout from 3.5.3 to 3.6.0 by @dependabot in #291
* chore(deps): Update tough requirement from 0.13 to 0.14 by @dependabot in #290
* chore(deps): update to latest version of picky by @flavio in #293
* chore(deps): Bump actions/checkout from 3.6.0 to 4.0.0 by @dependabot in #294
* chore: add repository link to Cargo metadata by @flavio in #297
* chore(deps): Update cached requirement from 0.44.0 to 0.45.1 by @dependabot in #298
* chore(deps): Bump actions/checkout from 4.0.0 to 4.1.0 by @dependabot in #302
* chore(deps): Update cached requirement from 0.45.1 to 0.46.0 by @dependabot in #301
* chore(deps): Update testcontainers requirement from 0.14 to 0.15 by @dependabot in #303
* chore(deps): Bump actions/checkout from 4.1.0 to 4.1.1 by @dependabot in #304
* cosign/tuf: use trustroot by @jleightcap in #305
* Fix broken tests, update deps by @flavio in #313

New Contributors
================

* @jleightcap made their first contribution in #287

**Full Changelog**: v0.7.2...v0.8.0

Signed-off-by: Luke Hinds <[email protected]>
Co-authored-by: Flavio Castelli <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants