Simon Cowell is revealing that he regrets having an affair with his current girlfriend and mother of his child, Lauren Silverman, when she was married to his former friend, Andrew Silverman.

The couple might be happy now, with a 2-month-old son, but in an interview with The Mirror, Cowell said he’s “not proud” of how they got together.

“It is not something I am proud of or wanted to happen in terms of hurting anyone. It just happened. You have to deal with it and man up to it. You have to accept the responsibility and the criticism,” he admitted. “All I can say is, my advice to you is if it happens to you, you just have to deal with it a day at a time and own up to your responsibilities.”

He added of their son Eric, “But then of course you have a baby and you look at the baby and you kinda go, ‘This is what happened from it.’”

LA Times notes Cowell got candid when he revealed he was diagnosed with depression before the scandal broke about his affair with Silverman, but now that he has two people in his life he’s responsible for, he feels complete.

“The great thing about Lauren is she loves what I do, so she sits in if I am watching Britain’s Got Talent, for example, and she has got a good opinion. And I seem to have got my mojo back again,” he said.

He added, “It is a weird existence when you live on your own. On the phone all night, blah blah blah. Now the house is full of people, it has become a home rather than a house.”