You just don't give up, do you?
Look at the motion controls of the Wii for an example of why we don't want this. Look at how many titles use the motion controls to their fullest and actually keep the game enjoyable. Now look at the number of games that attempt to use it and it just ends up being a pointless gimmick because they tried to apply it to something it has no business being in.
TES does not fit well unless it's being controlled with a controller or a mouse and keyboard. Period, full stop, the end, fin, Ende, al final, and any other way that I can say it that didn't come to mind.