I wish I'd took notes of where I got each dragon shout from, which shopkeepers have the most cash and so on. We have quills and rolls of paper, why not be able to take down some notes in-game? If you have an empty scroll and a quill, allow the player to keep notes on a scroll. Editable scrolls wouldn't need to be that complex, just a flashing cursor where we can input text, the first line of text could be the title of the scroll.
This wouldn't be ideal for console users, but I'm sure that PC gamers would appreciate this as an option (I know I would)