-
-
Notifications
You must be signed in to change notification settings - Fork 2.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
rt(threaded): basic self-tuning of injection queue #5720
Merged
Merged
Commits on May 24, 2023
-
rt(threaded): basic self-tuning of injection queue
Each multi-threaded runtime worker prioritizes pulling tasks off of its local queue. Every so often, it checks the injection (global) queue for work submitted there. Previously, "every so often," was a constant "number of tasks polled" value. Tokio sets a default of 61, but allows users to configure this value. If workers are under load with tasks that are slow to poll, the injection queue can be starved. To prevent starvation in this case, this commit implements some basic self-tuning. The multi-threaded scheduler tracks the mean task poll time using an exponentially-weighted moving average. It then uses this value to pick an interval at which to check the injection queue. This commit is a first pass at adding self-tuning to the scheduler. There are other values in the scheduler that could benefit from self-tuning (e.g. the maintenance interval). Additionally, the current-thread scheduler could also benfit from self-tuning. However, we have reached the point where we should start investigating ways to unify logic in both schedulers. Adding self-tuning to the current-thread scheduler will be punted until after this unification.
Configuration menu - View commit details
-
Copy full SHA for df96c16 - Browse repository at this point
Copy the full SHA df96c16View commit details
Commits on May 25, 2023
-
Configuration menu - View commit details
-
Copy full SHA for b7af661 - Browse repository at this point
Copy the full SHA b7af661View commit details -
Configuration menu - View commit details
-
Copy full SHA for e93894b - Browse repository at this point
Copy the full SHA e93894bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 987d081 - Browse repository at this point
Copy the full SHA 987d081View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6db32b2 - Browse repository at this point
Copy the full SHA 6db32b2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2e59745 - Browse repository at this point
Copy the full SHA 2e59745View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9ff9218 - Browse repository at this point
Copy the full SHA 9ff9218View commit details -
Configuration menu - View commit details
-
Copy full SHA for 073412b - Browse repository at this point
Copy the full SHA 073412bView commit details -
Configuration menu - View commit details
-
Copy full SHA for d07794e - Browse repository at this point
Copy the full SHA d07794eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 266a11d - Browse repository at this point
Copy the full SHA 266a11dView commit details -
Configuration menu - View commit details
-
Copy full SHA for d91022d - Browse repository at this point
Copy the full SHA d91022dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 034096b - Browse repository at this point
Copy the full SHA 034096bView commit details
Commits on May 26, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 0dc2b8f - Browse repository at this point
Copy the full SHA 0dc2b8fView commit details -
Configuration menu - View commit details
-
Copy full SHA for e3ab179 - Browse repository at this point
Copy the full SHA e3ab179View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4350c47 - Browse repository at this point
Copy the full SHA 4350c47View commit details -
Configuration menu - View commit details
-
Copy full SHA for 616a9ca - Browse repository at this point
Copy the full SHA 616a9caView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0bb5765 - Browse repository at this point
Copy the full SHA 0bb5765View commit details -
Configuration menu - View commit details
-
Copy full SHA for eb4a7d3 - Browse repository at this point
Copy the full SHA eb4a7d3View commit details -
Configuration menu - View commit details
-
Copy full SHA for b9eee6a - Browse repository at this point
Copy the full SHA b9eee6aView commit details
Commits on May 27, 2023
-
Configuration menu - View commit details
-
Copy full SHA for c1784a9 - Browse repository at this point
Copy the full SHA c1784a9View commit details
Commits on May 30, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 1bb42a9 - Browse repository at this point
Copy the full SHA 1bb42a9View commit details -
Configuration menu - View commit details
-
Copy full SHA for c5d5fe9 - Browse repository at this point
Copy the full SHA c5d5fe9View commit details
Commits on May 31, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 5d4c19f - Browse repository at this point
Copy the full SHA 5d4c19fView commit details -
Configuration menu - View commit details
-
Copy full SHA for da2a153 - Browse repository at this point
Copy the full SHA da2a153View commit details -
Configuration menu - View commit details
-
Copy full SHA for 297099e - Browse repository at this point
Copy the full SHA 297099eView commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.