Why do you think I had to wait to be certified at the tender age of 43? Nope, it wasn't for lack of interest (hey, I grew up watching Sea Hunt every afternoon)...it was because it took that long for my kids to go off to college! Well, mostly...when I certified we still had one in high school, but the time (and money) demands were starting to taper off a bit.
And now, here come all these grandkids! That's all right. My granddaughter, 2 1/2 years old, will scramble along on the floor and say, "Look! I'm fwimmin'--like Poppy!" She's seen my underwater videos (and no, I don't crawl along on the bottom, either...it's the best imitation she can do on dry land thank-you-very-much!).
Best wishes in managing to balance family and diving. While I can certainly appreciate a person's love for diving, it still doesn't compare with the importance of good family time. Hopefully, you won't have to make it an "either/or" decision.