You do realize that the whole point of the window-based GUI in the first place was to "dumb down" computers for the average person to be able to use. If you're really hardcoe, you don't click buttons and open windows; you do everything by command line.
I personally wouldn't call it "dumbing" it down for the user, GUI just simplifies everything instead of typing down a 100 character long directory, you can just get in it with a few simple clicks.