Take off your chest armor to look bad ass, equip the coolest looking things you can find, not just by how good they are and dont complain that perks ruin the game. You chose to enchant your gear and make it easy. Take that gear off and shut up, then keep playing.
My new character wears a dress, a really cheap-looking green hood, and steel boots when she's out and about. The only time I kit her up is when going into ruins or deliberate fights. And then she only wears steel apparel. (Until I find something that looks better on her.)
You're right. The game is a lot more enjoyable this way.