If you have the option of not having our kids around then it is the clear choice. I train with my kids around sometimes, they are 4 and 6. Not every day is the same, it gets annoying when I have to stop them from fighting or they try to talk to me during a set.
When my first kid was about 1-1 1/2 y.o. he used to freak out when I did chin ups. He would scream “No Dada! No!!” and cry, like I was doing something horrible.