I use one and and always caught by guards when trespassing.

I'm not running, jumping, bringing out my weapon, touching anything, opening anything - nothing but walking.

I also had my followers wait behind me.

What's going on?

Shouldn't invisibility make you invisible?

From what I've read, it could be because they can still hear you.