Giving up? in Watching Life Fly By

I think I need to give up trying to get pregnant. My daughter is 3.5yrs old, and we’ve been trying since she was 11 months. I get sick easily from various medications the doctors try. I ended up having a terrible ovulation week this past week. I was doubled over in pain, diarrhea, and had 2 migraines. I cannot have intercourse like that. So, it was a wasted month unless his sperm randomly lived 4-6 days and caught the egg release.
I am going to talk to my husband tonight about all of my emotions on this. I want a baby so badly, but I don’t see it happening and it’s consuming me. I’m becoming depressed, anxious and irritable. I am snapping at our daughter and at him. I find myself trying to go to sleep as soon as our daughter is asleep just to avoid the physical and mental pain.