I don't date girls unless I actually think the relationship has a chance of lasting awhile, hopefully even go the distance, meaning eventually engaged and married (I'm not one of the guys that just wants to bang her and leave, believe it or not)... so yea, I mean I'm not ready to say I love you and move into the same house or anything, but one could say she is special to me
Haha I'm pretty similar, I don't actually date a girl unless I consider it worthwhile, but I still have no problem with one night stands.
Anyways, to answer your question, if it bugs you now, just think like 5 years down the road. You may be used to her being a little taller, but it could also just build up. I would say if it makes you uncomfortable then leave her, I know it sounds shallow but no point in tormenting yourself.