Andy Cohen Opens Up About the Self-Doubt He Experiences as a Single Dad: 'A Whole New World of Worry' ngocc

Andy Cohen is getting candid about the extra pressure he feels raising two kids as a single dad.

As a guest on David Duchovny's podcast Fail Better, the Watch What Happens Live host, 56, revealed that while he didn't used to feel self-doubt frequently, becoming a father to son Ben, 5, and Lucy, 2, has given him "a whole world of worry."

"I told you earlier that I wasn't someone that had a lot of self-doubt," he tells Duchovny, "But, I mean, this will do it to you — being a parent. You start to question everything, especially as a single parent."

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories. 

Cohen continues to list the questions that "keep him up at night," sharing, "Everything from what kind of world am I bringing my child into to, you know, what's gonna happen to us? What happens if something happens to me? Are they gonna be okay?"

"I mean, there's a whole world of worry that I never had," he adds.

Duchovny replies, "I think you said at one point that you want your kids to be around, at least to know that there are other single, gay parents out there. So that's important to you as well, is it?"

The PEOPLE Puzzler crossword is here! How quickly can you solve it? Play now!
"You don't want to feel alone" Cohen shares. "You don't wanna feel like, 'Oh, I'm not, you know, I'm the only one without a mom, or I'm the only one without two dads, or a mom and a dad, whatever.'

"And they don't, I have to say," he proudly shares of Ben and Lucy. "There are other single parents that they know, and there's a lot of gay dads in their lives, so they see."

Cohen then recalls a story that illustrates Ben's outlook on his family dynamic.

"It was so interesting to me," he begins. "A year or two ago, my son said, he was like, 'I want another daddy.' And I thought it was so interesting that he knew that if someone else came into this family, it was gonna be a daddy."

Cohen jokingly adds, "I was like, 'I read that gay to you?'"