It seems very likely that you may be hitting the maximum number of unauthenticated connections. I believe the default is 10. Anytime someone has connected, but has not yet fully authenticated, they are in this bucket. This can really show up on publically available SSH daemons - perhaps your conn...
[ more ]