I almost always take the Lord Stone (if the char is not overpowered as to reach the caps) because the magic resistance is very useful (a Dunmer will only receive 37.5% of fire damage (50% (fire resistance) of 75% (you resist a 25% of any magic attack thanks to the Lord Stone)).
I seldom use the Crown aside for training but, if I had to, I would put the Lady Stone if a vampire (allows a little stat regeneration under the sun) or the Shadow stone (automatic invisibility has saved me more than once).
If you won't use Conjuration and you wear the Crown full-time I'd recommend the Atronach Stone (very useful against Dragon Priests and magic users) and coupled with the Lord Stone only half of the magic attacks will harm you (the other half will recover your magicka) and those who do will only deal 75% of damage and even less if it's fire (half of it).BTW, if using a Breton, the Atronach Stone on the Crown coupled with their racial power allows to absorb 100% of magicka during 60 seconds without compromising the ability to summon in the long term.