Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Validate query purpose in spec tests #4770

Merged
merged 7 commits into from
Mar 11, 2023

Conversation

milaGGL
Copy link
Contributor

@milaGGL milaGGL commented Mar 10, 2023

#no-changelog
Port from firebase/firebase-js-sdk#7113

@github-actions
Copy link
Contributor

github-actions bot commented Mar 10, 2023

📝 PRs merging into main branch

Our main branch should always be in a releasable state. If you are working on a larger change, or if you don't want this change to see the light of the day just yet, consider using a feature branch first, and only merge into the main branch when the code complete and ready to be released.

Add the 'main-merge-ack' label to your PR to confirm merging into the main branch is intended.

@google-oss-bot
Copy link
Contributor

1 Warning
⚠️ Did you forget to add a changelog entry? (Add the 'no-changelog' label to the PR to silence this warning.)

Generated by 🚫 Danger

@google-oss-bot
Copy link
Contributor

google-oss-bot commented Mar 10, 2023

Coverage Report 1

Affected Products

  • firebase-firestore

    Overall coverage changed from 44.16% (436b03f) to 44.14% (3314644) by -0.02%.

    FilenameBase (436b03f)Merge (3314644)Diff
    LocalStore.java100.00%99.38%-0.62%
    LruGarbageCollector.java97.20%93.46%-3.74%

Test Logs

  1. https://storage.googleapis.com/firebase-sdk-metric-reports/8s8RpkLNvM.html

@github-actions
Copy link
Contributor

github-actions bot commented Mar 10, 2023

Unit Test Results

   158 files   -    614     158 suites   - 614   2m 1s ⏱️ - 32m 12s
1 116 tests  - 3 690  1 100 ✔️  - 3 676  16 💤  -   5  0  - 9 
2 232 runs   - 7 177  2 200 ✔️  - 7 158  32 💤  - 10  0  - 9 

Results for commit 6b03974. ± Comparison against base commit 436b03f.

♻️ This comment has been updated with latest results.

@google-oss-bot
Copy link
Contributor

google-oss-bot commented Mar 10, 2023

@milaGGL milaGGL requested a review from dconeybe March 10, 2023 23:42
@milaGGL milaGGL self-assigned this Mar 10, 2023
@google-oss-bot
Copy link
Contributor

google-oss-bot commented Mar 11, 2023

Startup Time Report 1

Note: Layout is sometimes suboptimal due to limited formatting support on GitHub. Please check this report on GCS.

Notes

Startup Times

  • fire-fst

    DeviceStatisticsDistributions
    oriole-32
    Percentile436b03f3314644DiffSignificant (?)
    p10353 ±52 μs328 ±32 μs-25.0 μs (-7.1%)NO
    p25377 ±74 μs340 ±37 μs-37.7 μs (-10.0%)NO
    p50419 ±103 μs363 ±62 μs-56.1 μs (-13.4%)NO
    p75474 ±130 μs408 ±112 μs-66.3 μs (-14.0%)NO
    p90553 ±190 μs474 ±176 μs-79.2 μs (-14.3%)NO

    20 test runs in comparison
    CommitTest Runs
    436b03f
    • 2023-03-10_17:37:29.817186_rGhv
    • 2023-03-10_17:37:29.821088_uCOu
    • 2023-03-10_17:37:29.821103_xcTX
    • 2023-03-10_17:37:29.821113_JXzZ
    • 2023-03-10_17:37:29.821118_qcpR
    • 2023-03-10_17:37:29.821124_QwAb
    • 2023-03-10_17:37:29.821129_fbPe
    • 2023-03-10_17:37:29.821134_ufAI
    • 2023-03-10_17:37:29.821139_TKQh
    • 2023-03-10_17:37:29.821145_iDGz
    3314644
    • 2023-03-11_05:35:37.693000_Spzn
    • 2023-03-11_05:35:37.693819_EnEs
    • 2023-03-11_05:35:37.693833_RvHb
    • 2023-03-11_05:35:37.693843_nWzL
    • 2023-03-11_05:35:37.693849_muTh
    • 2023-03-11_05:35:37.693855_TxDh
    • 2023-03-11_05:35:37.693860_LmOa
    • 2023-03-11_05:35:37.693865_nDOi
    • 2023-03-11_05:35:37.693870_MsTO
    • 2023-03-11_05:35:37.693875_RFHt
    redfin-30
    Percentile436b03f3314644DiffSignificant (?)
    p10631 ±28 μs625 ±26 μs-5.77 μs (-0.9%)NO
    p25649 ±34 μs640 ±30 μs-8.81 μs (-1.4%)NO
    p50682 ±45 μs662 ±37 μs-19.7 μs (-2.9%)NO
    p75724 ±61 μs694 ±48 μs-29.3 μs (-4.0%)NO
    p90804 ±118 μs734 ±61 μs-69.4 μs (-8.6%)NO

    20 test runs in comparison
    CommitTest Runs
    436b03f
    • 2023-03-10_17:37:29.817186_rGhv
    • 2023-03-10_17:37:29.821088_uCOu
    • 2023-03-10_17:37:29.821103_xcTX
    • 2023-03-10_17:37:29.821113_JXzZ
    • 2023-03-10_17:37:29.821118_qcpR
    • 2023-03-10_17:37:29.821124_QwAb
    • 2023-03-10_17:37:29.821129_fbPe
    • 2023-03-10_17:37:29.821134_ufAI
    • 2023-03-10_17:37:29.821139_TKQh
    • 2023-03-10_17:37:29.821145_iDGz
    3314644
    • 2023-03-11_05:35:37.693000_Spzn
    • 2023-03-11_05:35:37.693819_EnEs
    • 2023-03-11_05:35:37.693833_RvHb
    • 2023-03-11_05:35:37.693843_nWzL
    • 2023-03-11_05:35:37.693849_muTh
    • 2023-03-11_05:35:37.693855_TxDh
    • 2023-03-11_05:35:37.693860_LmOa
    • 2023-03-11_05:35:37.693865_nDOi
    • 2023-03-11_05:35:37.693870_MsTO
    • 2023-03-11_05:35:37.693875_RFHt
  • timeToInitialDisplay

    DeviceStatisticsDistributions
    oriole-32
    Percentile436b03f3314644DiffSignificant (?)
    p10199 ±22 ms198 ±11 ms-1.73 ms (-0.9%)NO
    p25207 ±26 ms204 ±12 ms-2.89 ms (-1.4%)NO
    p50218 ±31 ms212 ±15 ms-5.14 ms (-2.4%)NO
    p75230 ±39 ms222 ±17 ms-7.38 ms (-3.2%)NO
    p90241 ±44 ms236 ±17 ms-5.11 ms (-2.1%)NO

    20 test runs in comparison
    CommitTest Runs
    436b03f
    • 2023-03-10_17:37:29.817186_rGhv
    • 2023-03-10_17:37:29.821088_uCOu
    • 2023-03-10_17:37:29.821103_xcTX
    • 2023-03-10_17:37:29.821113_JXzZ
    • 2023-03-10_17:37:29.821118_qcpR
    • 2023-03-10_17:37:29.821124_QwAb
    • 2023-03-10_17:37:29.821129_fbPe
    • 2023-03-10_17:37:29.821134_ufAI
    • 2023-03-10_17:37:29.821139_TKQh
    • 2023-03-10_17:37:29.821145_iDGz
    3314644
    • 2023-03-11_05:35:37.693000_Spzn
    • 2023-03-11_05:35:37.693819_EnEs
    • 2023-03-11_05:35:37.693833_RvHb
    • 2023-03-11_05:35:37.693843_nWzL
    • 2023-03-11_05:35:37.693849_muTh
    • 2023-03-11_05:35:37.693855_TxDh
    • 2023-03-11_05:35:37.693860_LmOa
    • 2023-03-11_05:35:37.693865_nDOi
    • 2023-03-11_05:35:37.693870_MsTO
    • 2023-03-11_05:35:37.693875_RFHt
    redfin-30
    Percentile436b03f3314644DiffSignificant (?)
    p10231 ±5 ms250 ±4 ms+19.1 ms (+8.3%)MAYBE
    p25237 ±5 ms257 ±5 ms+20.3 ms (+8.6%)MAYBE
    p50244 ±5 ms264 ±5 ms+20.4 ms (+8.4%)MAYBE
    p75251 ±5 ms274 ±6 ms+23.5 ms (+9.3%)MAYBE
    p90258 ±5 ms291 ±11 ms+32.1 ms (+12.4%)MAYBE

    20 test runs in comparison
    CommitTest Runs
    436b03f
    • 2023-03-10_17:37:29.817186_rGhv
    • 2023-03-10_17:37:29.821088_uCOu
    • 2023-03-10_17:37:29.821103_xcTX
    • 2023-03-10_17:37:29.821113_JXzZ
    • 2023-03-10_17:37:29.821118_qcpR
    • 2023-03-10_17:37:29.821124_QwAb
    • 2023-03-10_17:37:29.821129_fbPe
    • 2023-03-10_17:37:29.821134_ufAI
    • 2023-03-10_17:37:29.821139_TKQh
    • 2023-03-10_17:37:29.821145_iDGz
    3314644
    • 2023-03-11_05:35:37.693000_Spzn
    • 2023-03-11_05:35:37.693819_EnEs
    • 2023-03-11_05:35:37.693833_RvHb
    • 2023-03-11_05:35:37.693843_nWzL
    • 2023-03-11_05:35:37.693849_muTh
    • 2023-03-11_05:35:37.693855_TxDh
    • 2023-03-11_05:35:37.693860_LmOa
    • 2023-03-11_05:35:37.693865_nDOi
    • 2023-03-11_05:35:37.693870_MsTO
    • 2023-03-11_05:35:37.693875_RFHt

  1. https://storage.googleapis.com/firebase-sdk-metric-reports/VcvmE6AgFr/index.html

Copy link
Contributor

@dconeybe dconeybe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks for making this improvement to the spec tests. I just left two minor comments.

@milaGGL milaGGL merged commit 8655160 into master Mar 11, 2023
@milaGGL milaGGL deleted the mila/validate-QueryPurpose-in-spec branch March 11, 2023 06:30
@firebase firebase locked and limited conversation to collaborators Apr 11, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants