Oh, no ..... I joined House Hlaalu again last night.... I always seem to get a fixation on the Bad People at the Corner Club in Balmora for some reason. I just have to take them out and then I just cannot stop myself from reporting it to Nileno Dorvayn. She wants the murderer found and appreciates that I solved the case and then she seems so nice and welcoming that I end up joining..... I am thinking of loading a previous save game so I can join Telvanni or Rhedoran instead. Not sure that the Hlaalu stronghold is so great since I have not built the other two. And I'm also wondering which house gives the best or most interesting rewards along the way of the quests. I appreciate your opinions on this subject anyone?

You should know that each House is aimed at a certain type of gameplay.
Hlaalu is for Stealth.
Telvanni is for Mages.
Redoran is for Combat.

Just like any other Faction/Guild, they have favored Skills and Attributes that you need to level-up before you can progress in Rank.
Joining a House with a character not suited towards the correlating archetype can make the quests and Rank progression much more difficult. (and in some cases almost impossible)

All three Houses give (or allow you to find) equal type of rewards. But as mentioned above, the rewards will be aimed at a specific type of character.... so if you're playing outside the proper Class you will likely be awarded with useless items.

One thing to consider is that the House Hlaalu stronghold has a much better location than the other strongholds provided by the other two houses. The House Hlaalu manor is just a short walk from Balmora, allowing it to be reasonably used as a base of operations due to its proximity to a dozen merchants, Caius Cosades, guilds, etc.

The Redoran Stronghold is marginally further from Ald-Ruhn than the Hlaalu Stronghold is from Balmora, which is a city with more merchants than Ald-Ruhn but otherwise it's a toss-up.

Conversely, the Telvanni Stronghold is in the middle of nowhere, and a rather lengthy swim from the nearest large town, Sadrith Mora. So it's generally thought of as the most poorly positioned stronghold, yet also the coolest by virtue of being a Telvanni mushroom tower.

But ultimately you shouldn't choose which Great House you join based on the stronghold you get, you're better off if you pick a Great House that best fits your character's skill set...otherwise you won't be able to advance far enough in a Great House to get the stronghold anyways.