It's more about the size of your hands. Smaller hands mean having more control over the ball, which gets more important at longer ranges when accuracy becomes crucial. For the same reason, small hands are bad for rebounding - it's harder to grab the balls.