Most likely causes for this; are anxiety, loose vagina of your wife, lack of foreplay (very usual after 20 years of married life!), reduced interest in sex, prostatitis (rare, infection of prostate) etc. If you think any of these is a reason in your case then try to address it. If you are not able to put your finger to any of these then consult Psychiatrist nearby.