No, I don't think you have anything to worry about there.
I even have 2 sisters...one is 4'10, the other, 4'11, and they each have 3 children. Dwarves and midgets (who aren't just storybook characters are able to have children too. The only thing your height might affect is the height of your children, but then again, you never know about that either: you could have tall children too