Hi there,
this sounds very difficult, you are not to blame or responsible for his behaviour. Your gut feelings are telling you that something is not going well. When you say you cannot find a way to leave this man, is this what you want to do? It is very hard being a parent, do you feel trapped?