Hello and welcome to HCM.
As an
Urologist, let me advise you that,
male infertility, is always treated by an Urologist, whereas,
female factor infertility, is treated by a gynecologist.
A
sperm count of 20 million/ml.semen, is enough for pregnancy to occur, if all other parameters of sperms are normal.
Semen test should be done, after 2 days abstinence.(no sex).
You must get your male hormones like blood FSH, LH,and PRL done.
Also, get a scrotal doppler scan done, to assess all factors correctly.
You may send a copy of all reports here, in my name, for an expert opinion.