Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add test_suite and test_config under conformance #441

Merged
merged 14 commits into from
Feb 26, 2025

Conversation

aakash070
Copy link
Contributor

@aakash070 aakash070 commented Feb 18, 2025

  1. Adding env_config under conformance to represent a serializable format for CEL environment. This can be used to create a new or augment an existing CEL environment.
  2. Added new test suite structure to simple.proto. This new schema can support the existing features of simple test as well as be used by the CEL test runner for triggering unit tests to validate user expressions and policies. The conformance tests will be updated in a follow up pull request.

@TristonianJones
Copy link
Collaborator

/gcbrun

@TristonianJones
Copy link
Collaborator

/gcbrun

@@ -141,3 +145,107 @@ message UnknownSetMatcher {
// Success if we match any of these sets.
repeated cel.expr.UnknownSet unknowns = 1;
}

// A test suite is a collection of tests designed to evaluate the correctness of
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't mind putting the tests suite and test section into a separate file, just wanted it to live under conformance/test. Perhaps, conformance/test/suite.proto?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we also move test case to the new file, as it's only being referenced by test section? This new file will then act as a complete replacement of simple.proto.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it will also make the conformance tests migration to the new test suite a bit more straight forward.

Copy link
Collaborator

@TristonianJones TristonianJones left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a couple of minor comments and we're good to go.

…formance/test
@TristonianJones
Copy link
Collaborator

/gcbrun

@TristonianJones TristonianJones merged commit d564205 into google:master Feb 26, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants