Traveling Parent

We are re-locating our (military) family from California to Georgia. For the move, I've made arrangements to leave our 15 month old with my mother-in-law in WV. I'll be flying out to CA for a week to pack everything up and the husband and I will be driving cross-country, picking up our son, and continuing on to GA.
My side of the family insists that I am being selfish and not thinking of my child, and that I should stay in WV while my husband makes the cross-country drive alone.
I've already made the decision to go, I'm just curious on what other people have to say on the matter. Is it right for me to travel, or wrong of me to leave my child- even for 2 weeks?