You can kill a basic dragon being under lvl 10, everywhere you go the enemies are close to your level. I don't die if I won't let the enemies beat me. And I'm not even 30 in the crafting skills.

I also play on adept difficulty since higher just decrease the player damage and increase enemies damage, makins so I have to hit a simple dog about 30 times :/
I wish that changing the difficulty increased the minimum lvl of areas and places.
What do you guys think about all of this?

I'm ok with how it works. I find that Master difficulty is pretty good for my type of PC builds. I know bandits level (up to a certain ceiling) as your PC levels so the fights against them do get harder.

Also, you'll have harder fights against groups of baddies. If you haven't already tried it, go find a giant and try some of that combat...

But then, the game becomes unbalanced for destruction users, since you cannot upgrade your spells, like warriors can hone their swords.
Anyway I think that raising the difficulty overally unbalances the game. It just makes it more unfair.
It should be both challenging and fair. I feel cheated having to hit a naked bandit tens of times when he can strike me down in two moves using his iron sword..

I don't like turning the difficulty slider up for a variety of reasons, but I do believe the default setting for difficulty is just not very much fun. For myself, I opted to use the mods "Deadly Dragons" and "Deadly Monsters". This way I can adjust the settings for health, armor class, damage done, and magic resistance using sliders for nearly every critter in the game.

What I really don't like is taking the trouble to build up smithing for instance, putting perk points in it so that I can make (for instance) Elven armor and weapons, only to discover that I won't be able to come up with any quicksilver to make them until Elven weapons are basically not much more useful than an iron dagger. Personally, I think the weapons system really needs revamping. Arguably, the best-looking sword in the game is the iron greatsword... and it's also the least useful. Its only saving grace that you can get one at the start of the game and use it all the way through. Or you COULD use it all the way through, if it wasn't eventually like using a toothpick to kill a mammoth, eh? Easier to kill a Bull Netch with a fork, eh Morrowind fans?