Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Assign Vars value to metrics #1581

Closed

Conversation

szuananwar
Copy link
Collaborator

This pull is to assign metrics from variables defined in tests. A property name vars is defined with value for vars.

@szuananwar szuananwar self-assigned this Aug 4, 2023
@szuananwar szuananwar linked an issue Aug 4, 2023 that may be closed by this pull request
4 tasks
@codecov
Copy link

codecov bot commented Aug 4, 2023

Codecov Report

Patch coverage: 81.82% and project coverage change: +0.57% 🎉

Comparison is base (e755449) 77.81% compared to head (08d69e4) 78.38%.
Report is 345 commits behind head on devel.

❗ Current head 08d69e4 differs from pull request most recent head 6b2d17b. Consider uploading reports for the commit 6b2d17b to get more accurate results

Additional details and impacted files
@@            Coverage Diff             @@
##            devel    #1581      +/-   ##
==========================================
+ Coverage   77.81%   78.38%   +0.57%     
==========================================
  Files          58       57       -1     
  Lines        6626     6582      -44     
==========================================
+ Hits         5156     5159       +3     
+ Misses       1470     1423      -47     
Files Changed Coverage Δ
buildtest/buildsystem/checks.py 72.50% <ø> (+1.14%) ⬆️
buildtest/cli/cdash.py 88.61% <ø> (ø)
buildtest/executors/cobalt.py 21.51% <0.00%> (-0.60%) ⬇️
buildtest/executors/lsf.py 19.28% <0.00%> (-0.72%) ⬇️
buildtest/executors/pbs.py 21.43% <0.00%> (-0.49%) ⬇️
buildtest/executors/slurm.py 20.51% <0.00%> (-0.74%) ⬇️
buildtest/schemas/utils.py 100.00% <ø> (ø)
buildtest/system.py 54.50% <ø> (ø)
buildtest/tools/stylecheck.py 87.50% <0.00%> (ø)
buildtest/cli/buildspec.py 93.87% <87.50%> (ø)
... and 21 more

... and 2 files with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Comment on lines 225 to 242
"vars": {
"type": "object",
"additionalProperties": false,
"required": [
"value"
],
"properties": {
"type": {
"type": "string",
"description": "Specify the type of the variable",
"enum": [
"str",
"int",
"float"
]
}
}
},
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please remove this we have a definition for environment variables that work same as variables. This is defined in same file

    "env": {
      "type": "object",
      "description": "One or more key value pairs for an environment (key=value)",
      "minItems": 1,
      "items": {
        "type": "object",
        "minItems": 1,
        "propertyNames": {
          "pattern": "^[A-Za-z_][A-Za-z0-9_]*$"
        }
      }
    },

@@ -199,13 +199,17 @@
"regex": {
"$ref": "#/definitions/regex"
},
"vars": {
"$ref": "#/definitions/vars"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

change this to #/definitions/env that should fix the issue.

add support for vars to definitions.schema.json file
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

metrics assignment from variables
2 participants