How many requests do we handle concurrently?
If the system gets really loaded, too many concurrent threads will create vicious cycles
and make everyone slow (or worst case choke every request by OOME), so better to err
on the conservative side (and have inbound connections wait in the queue)