I use enchanting, alchemy, and smithing all *without* fortify restoration. That has hard limits on your enchants. On Master or Legendary, you'll want it. On Adept, you probably don't need it, though I won't be sure until I finish a game on Adept.
I consider Fortify Restoration to be a bug / exploit that the developers missed and probably have marked as a very low priority bug (meaning never). They are probably only fixing game breaking bugs that affect the majority of players now.