Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

process subjects in batches #67

Merged
merged 1 commit into from
May 22, 2024
Merged

process subjects in batches #67

merged 1 commit into from
May 22, 2024

Conversation

bdehamer
Copy link
Collaborator

@bdehamer bdehamer commented May 17, 2024

Removes the 64 subject limit in favor of processing subjects in batches.

Subjects are now processed in batches of 50, with a 5 second sleep between batches to reduce the chances of being rate-limited by the GH API.

image

@bdehamer bdehamer requested a review from a team as a code owner May 17, 2024 23:43
Signed-off-by: Brian DeHamer <bdehamer@github.com>
@kommendorkapten
Copy link

This has been verified to work with total number of attestations larger than 100 right? @bdehamer

@bdehamer
Copy link
Collaborator Author

@kommendorkapten I did a test here with 150.

Copy link

@kommendorkapten kommendorkapten left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚢

@bdehamer bdehamer merged commit 80d9f23 into main May 22, 2024
15 checks passed
@bdehamer bdehamer deleted the bdehamer/batch-processing branch May 22, 2024 14:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants