Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parameterize concurrency (number of workers). Users should be able to… #501

Merged
merged 2 commits into from
Nov 11, 2022
Merged

Parameterize concurrency (number of workers). Users should be able to… #501

merged 2 commits into from
Nov 11, 2022

Conversation

raghu-nandan-bs
Copy link
Contributor

Changes proposed on the PR:

  • parameterize option for number of concurrent workers
    this is required because if the number of CRs are pretty high, we see workerQueue getting piled up and sync events may even miss an entire cycle.

for example, when running around 100 CRs concurrently, we see that wait time in queue is consistently around 30-40s

when number of workers are less

@raghu-nandan-bs raghu-nandan-bs requested a review from a team as a code owner October 22, 2022 12:19
@ese
Copy link
Member

ese commented Nov 11, 2022

Thanks @raghu-nandan-bs, We will merge in #502

@ese ese merged commit fa05625 into spotahome:master Nov 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants