If that's the case, then あなた have a huge decision to make. First off, remember it's not the child's fault that this happened so don't put the child through hell. Second, this person sounds like a jerk so he isn't worth your time または happiness. If あなた would rather be happy than be miserable I would break things off.
If あなた need to blow off some steam about things (I know how that goes) just send me a message and blow off some steam. あなた don't have to, but it might help. Just label it Blowing off Steam または something. I'm not trying to sound harsh with my アドバイス または anything though, so please don't take it like that.