Sneaking: this is my primary concern. Sneaking in lets say leather armor should be easier to sneak in than sneaking in chainmail or a shiny plate armor. If you stand in a dark corner, the dark color in the leather shouldnt give away your position as easy as if you were hiding with a shiny chainmail.
Movement/Actions:
Heavy; Heavy armor should decrease your ability to make fast and swift attacks, heavy armor should make your character feel more clunky and focus more on raw power than fast, agile attacks. It should really feel like you're this badass dude in the heavy armor swinging your two handed axe to kill. You are the hulk, not the flash.
Medium; Medium armors should be like a mix of heavy and light armor. A hybrid.
Light; Light armors should make your character feel more agile, more swift and faster in general. Wearing light armor makes your movements more fluid and quicker. Instead of swinging the badass 2 handed axe, maybe you are using two short blades do deal more spike damage than burst.
I hope you see my point, armors shouldnt only give your character armor, it should affect other things aswell and I've given you a few examples on what I think is a good idea