Once a man reaches 40 years of age, it becomes more difficult for him to stay in shape and maintain his sexual health and wellness. If he lacks a proper exercise and nutrition regimen, then fatigue, weight issues, and loss of sex drive could strike him even sooner.