Sorry to say I was told the same thing from my GP/Ob - Cant recall if my fertility specialist told me the same thing or not.
I have PCOS and when 1st did blood tests to see IF I was ovulating, it showed I either didnt ovulate or if I did ovulate it was really late in the cycle. Just to make the point my late ovulation wasnt about haveing long cycles (40+ days long) it was that I was ovulating just a few days before AF arrived. I was told that this would mean poor egg quality.
On the plus side I turned up pg all by myself just as I was about to start clomid. As I was tracking my cycles over the 10/11 months it took to get pg I assumed I was ovulating at a time I wasnt, I was using maybe baby to tell me when I ovulated but as I didnt know I had PCOS I wasnt aware that saliva ovulation predictors can give false positives for ovulating in some cases of PCOS.
Cut a long storey short when I found out I was ovulating much later in my cycle than I thought I was I started DTD ALL cycle not just mainly when I 'thought' I was ovulating or when I assumed the most likley time would be, by the 2nd month of this I got my BFP so my 'poor egg quality' didnt mean a thing and here I am 31 weeks pregnant.
This all may have just been a coincidence but Ive started to think my not being aware that I was ovulating late meant that I wasnt DTD at the right time.
Good Luck