You don't need to be invisible for the whole game, just do your dungeon diving, save your gold, sell sell sell till you got enough to pay the bounty, kind of adds a bit of fun having to sneak past gaurds till you can pay off your bounty.
Also let this be a lesson to save, save often, save allot, and then save some more

Actually I just checked, they don't even give me the option to pay the gold, it's either go to jail or resist arrest.
did you remove the Cowl in front of anyone? And I mean ANYONE. if you do this everyone will know you are the gray fox and well you already know what happends
In my previous games I did that a good few times(even in the current game I did that many times), what's the problem with this?
Duplication glitch ain't even an option, they don't want money. I'd also really like to get my fame back, I had like 100 fame pts now I only got 20 and 139 infamy pts. I understand I can do the Pilgrimage Quest, but it will make my fame go away and I won't be able to get the powers of certain heaven/doom stones.