A former bodyguard spoke out about working with Brad Pitt and Angelina Jolie, saying he essentially “fathered” their six kids.

Speaking to the United Kingdom’s The Sun, Mark Billingham said despite being in the SAS at one time, the hardest job he had was being a guard to the famous couple, who are now in the midst of a divorce.

Billingham, who is currently an instructor on the U.K. series SAS: Who Dares Wins, spoke about the series and ended up talking about the time he worked for Brangelina. He was their bodyguard for 18 months.

He said he grew so close to the family that he was practically an unofficial father figure. In the interview, he said “Angie and Brad are very worried about who goes near their children. It was clear from the start we had a great chemistry and they trusted me with the kids.”

Billingham that said anyone else who was brought in was not allowed to be near them or even hold them like he could.

He said the reason he left his job was because he was unable to spend time with his own children. “I never had a private life. I was exhausted. I lost direction in my own family life.”  Billingham said the news of their divorce was surprising.

He also revealed he does still “do bits and pieces” for them, including helping Jolie when she went on a trip for the UN to Iraq.