Low sperm count can have adverse effects on your family life if you and your partner are trying to have a baby. The reason why men may have low sperm count defers from person to person. But, one of the most common and most-heard reasons would be the exposure to ‘heat’.