Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support raising builtin errors for test runner #6489

Closed
jalseth opened this issue Dec 16, 2023 · 0 comments · Fixed by #6490
Closed

Support raising builtin errors for test runner #6489

jalseth opened this issue Dec 16, 2023 · 0 comments · Fixed by #6490
Assignees

Comments

@jalseth
Copy link
Member

jalseth commented Dec 16, 2023

What is the underlying problem you're trying to solve?

Obtain more helpful insights when builtins running in unit tests encounter errors, rather than just knowing that the unit test failed which currently silently hides these errors.

Describe the ideal solution

Users of the tester package are able to opt-in to having builtin errors raised when encountered.

Describe a "Good Enough" solution

N/A

Additional Context

In conftest, we have custom parse_config* builtins that assist with unit testing. By their nature, typos happen often in the configurations being unit tested, and these result in unit tests failing but the parsing errors are not raised. It would be nice to let users see these errors when encountered so they don't assume it is a problem with their policy logic.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant