a book?

I've been reading like a mad women for the last10 months. And it woke up the little girl in me who loved to write stories when she was tired of doodling in her sketch book.
So I'm starting my outline of a story based on an incident that happened to me as a child that has great bones to build a haunting young adult story around. But I keep having this little voice in my head saying.... You're to busy as a working mom and fine artist who doesn't get much fine art time lately. But I so want to do it.
What should I do? I'm torn.