The most negative reaction is always taken. If my character only joins House Redoran, members of the temple like him. If he then joins the fighters' guild, the boost in disposition from House Redoran disappears and drops below the standard disposition (e.g. 40 for 30 personality). Is this normal and either way, how can I change it?
In the mundane world do you always like everyone you know? Do they all like you?
Get used to it.
EDIT: I wrote the above last night when I was half asleep. Sorry for sounding catty.
The Temple and House Redoran are conservative Dunmer factions and tend to resent Imperial Guilds as occupiers.
If you do some business with Redoran and Temple Merchants and use a little flattery and Bribery in the course of the transactions it will help their dispositions.
Also if your Personality is only thirty use or train your various skills (Speechcraft, Mercantile, and Illusion.)to improve that attribute. It helps a lot interacting with NPCs. There are a few members of the temple (and House Redoran)that will only deal with faction members though no matter what.
Hope this is more helpful.
However if you're RPing and identify with your char, remember the first paragraph.