bug fix

fix bug when there are multiple workers without any affine chunks

This loop was going into infinite loop since `proc` doesn't change here.