This would obviously work best if we are able to defend against various strikes. Low strikes, side attacks, attacks from behind, high attacks etc.
I doubt they will do any of these suggestions, but it would make for a very interesting Expert or Hard setting experience. Then combat wouldn't be about how many strikes but where you strike, where you aim your arrows, where you choose to strike an opponent carrying a longsword, or an opponent carrying a mace, if he carries a shield, where are his/her weaknesses. Do they lack armor on their right arm, do they have more armor on their torso and head, but their legs and arms are exposed......etc etc. Then you would be looking for weak spots and attempting to defend against their strengths.
There are boxing games that have great abilities to choose where you wish to strike your opponent. So it is possible to implement such a combat system for more experienced gamers. A point system for skills would simply affect your overall strength/speed etc, but your ability to read your opponent and fight based on what you see, and not how many times you mash a button or click your mouse.