So, here's a question for you: Did you ever switch allegiances or stick it through to the end loyally?
What do I mean by loyally? When Moore asked you to kill the BoS, you did it. When Moore asked you to kill the Khans, you did it. Etc. Meaning you FOLLOWED YOUR ORDERS for your respective factions.
So, did you?
Me, I've never once had doubts about working for Mr. House given the worst he has you do is kill raiders in power armour. Hardly a morally objective issue.