I don’t think leaving would help matters. It would seem like you are running away from your responsibilities and they are toward your wife and child and of course yourself.
I’m in the same boat. I go to work and break down crying. No one knows what I’m going through. Just that I’m not the happy person I used to be. The people at work would not believe me if I told them as they knew how close my husband and I were, so I put on a mask and hide as much as possible. Hoping life will get better. I do the same to our mutual friends and family, mask on and excuses made.
Help yourself, you need to succeed then your wife will not be anxious and hopefully return to near normal. I’m saying this because if my husband came in now, gave me a hug and started to behave how he used to toward me I could start healing myself. I know I could never be the same person he married but I would be happy if I could become half the person I used to be. I’m tired, exhausted and so unhappy. The damage has been done so far but it is worth trying to get some more treasured memories.