Stamina is always dropping slightly on every player, regardless of age
But you'll only see a down arrow when he actually goes from ~X.1 to (X-1).9
To slow the drop in stamina, you can try and get a trainer with fitness specialty
Or train stamina every so often