My wife does haven't any kids (although she had to help me raise my daughter). One of her coworkers also made an inappropriate comment similar to what you mentioned. Utterly flabbergasting what people think of their own opinion and how self-centered to not see how hurtful something like that can be.
I love babies. My daughter is transgender so chances are slim to none that I'll ever be a grandfather. Guess who's problem that is. Mine. Not hers.
I don't really understand how there can be an issue around this kind of choice.