I have known couples who have had 6 years of TTC and have never given up. I know of some that when they were about to surrender, they had a beautiful baby. IVF is a method that many people in your position use. Many babies, millions, have been born by this method. They are healthy and beautiful babies. Do not think about it so much If you do not care about the way to get your baby, then go for it! Find a good clinic, change that silly doctor and start treatment. The faster you do it, the better. There is no worse battle than the one that does not fight. You can win this battle.
Stay positive. You will see that everything will be fine. My best wishes. A hug