You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Today, given a Test Plan Run with 3 tests and 6 assertions (where the NVDA Bot has collected all 3 AT responses and assigned 0 verdicts), the "Report Status" dialog will report "100% complete by NVDA Bot with 0 conflicts." This is misleading because the verdicts are absent, so they cannot be in conflict or in alignment with those in other Test Plan Runs.
Here are some potential solutions:
Treat unassigned verdicts as inherently conflicting. In the situation described above, the status text would instead read, "100% complete by NVDA Bot with 6 conflicts"
Extend the status text to fully document the relevant state. In the situation described above, the status text would instead read, "100% complete by NVDA Bot with 0 conflicts and 6 missing verdicts"
The text was updated successfully, but these errors were encountered:
Today, given a Test Plan Run with 3 tests and 6 assertions (where the NVDA Bot has collected all 3 AT responses and assigned 0 verdicts), the "Report Status" dialog will report "100% complete by NVDA Bot with 0 conflicts." This is misleading because the verdicts are absent, so they cannot be in conflict or in alignment with those in other Test Plan Runs.
Here are some potential solutions:
The text was updated successfully, but these errors were encountered: