Desperately unhappy

I feel like it’s never going to be right. I’m only happy when everyone I love is here with me, all under one roof.
But the kids are stopping it from happening. My other half can’t live with them. I can’t live without him.
I’m hurting every day and now I just want it to end. I feel like saying to him ‘go and find a girl who doesn’t have kids. Someone who can give you 100% attention the whole time. Someone that you don’t have to share.’ But it’s going to hurt him and kill me.