I haven't touched the difficulty level in the options, but I wonder if it is maximized it to be extremely hard even when crafting is maxed out and wearing daedric armor, will it still be hard or easy? I just don't want to turn it up yet and get knocked out 100 miles away by a puny goblin.

With perks in Smithing and Enchanting even Master difficulty becomes Novice. It's laughable.