Menu
▾
▴
#17 # workers > # fragments fails
When using a larger number of workers than the number
of DB fragments the scheduler process can become
overwhelmed with assignment requests from idle
workers. The idle processes are waiting to copy
fragments, but the queue only permits as many copy
assignments as the number of workers so the workers
"busy wait" for an assignment.
Logged In: YES
user_id=756995
As a temporary measure, workers now sleep for 1s when they
get a DO_NOTHING assignment from the scheduler. This
ought to keep the scheduler from getting overwhelmed.