Even in real life garlic don't bother Vampires. Garlic bother Vampires just as much as it does to humans.
In Skyrim wise, I don't think garlic bother Vampires. I think I was a Vampire Lord and it never bothered me. Don't quote me on it, been ages since I played as a VL.
In TES, it's a myth.
Vincenti in Oblivion commented on being allergic to them, but it's not universal. Nor was it lethal.
So, no. Feel free to eat all the garlics you want.