It sounds like your relationship might be emotionally abusive. Do you see a future with this man? If you pictured your ideal relationship, what would it look like?
You are allowed to leave a relationship for any reason and you have more than enough reason to bail out of this. I know it can feel like abandoning someone when they have an addiction, but you have to put yourself first. You don’t owe him your time or your mental health.