Under the assumption that you can't just delete the expansion from your hard drive... it may be possible to install "When Vampires Attack" at some point in the future, if it's not already available (check the mods page).
This mod prevents NPCs from being complete [censored] idiots and charging at master vampires with rusty iron daggers and whatnot (they will instead run inside).
http://www.gamesas.com/topic/1606882-will-skyrim-se-force-install-all-expansionsdlc-on-xbox-one/
one post please - use the post you created, linked above by Korth Thanks.