Bug: You can mention this topic infinitely, each time recieving a new key.
edit: Also if you speak with him again he will greet you with:
"Someone is going to going to regret this mistake. Dearly."
The morrowind wiki page states that if you choose the "proper authorization" route - the guards will refuse to attack you.
This is false, the guards still attack you.