That's how I see it to. The more qualifying factors, the stronger the attraction.
I've notice the same thing. Girls that I was meh about when I first saw them, worked me over eventually with their personality.
And to throw a wrench into the works, there is also biological attraction. I've heard the reason some peoples B.O. (Or they just feel "off".) even straight out of a bath may be off putting to someone is you share much of the same DNA and it's natures way of saying "find someone else". Not that I have proof to back it up, it makes sense.
Scent and pheromes most definetly affect me.
I even have memories associated with scent. I smelled something that reminded me of an old boyfriend at a friends house the other day.
It wasn't a particularly erotic or powerful smell. In fact, it was a combination or old books, old house, and fruit infused tea. It was interesting how much memory came flooding back.
Scents I also would normally not find attractive, like sweat, smell enticing when a male I am involved romantically with mows the lawn or does some other manly feat. I dunno why, but I like it.