Yes, although (thinking personally, right now my kids are still little): before you have kids, you lack the audience and the experience; once your kids have grown out of picture books, you've lost the audience; and while you're bringing up little kids, you have no time to write books!

I've considered book-writing on occasion, but never seriously considered childrens' books, mainly because I have no illustration skills.