If you're doing fine on adept and enjoying it just keep it there. I gotta admit your chosen playstyle is pretty damn funny but oh well. If you want a hand go marry 1 of the male warriors or something in game and have him follow you around for a little protection. If you don't wanna do that just see what happens against a boss fight and adjust accordingly. You shouldn't have too much trouble until you run into a dragon, chief of some kind, and draugr deathlords.
Edit: Make sure you have plenty of health potions or a healing spell ready also.