"Sometimes in TV, it can get really stale, especially if you're doing these 23-episode years. It's a lot of work, and to put your family through that, on a location, is not always the greatest thing in the world."