You know all those (0/5) perks? Leave them at 1. Anything more is overkill. Craft all you want using your skills. Meaning, don't use fortify blacksmith gear or potions to improve your weapons and armor. Use your skill only. Same with alchemy and enchanting. With that only, you have a very challenging game on expert.