So started a new character and been wandering aimlessly doing small quests for people. Now I want to start deciding which house to buy. I don't want to buy the house in Whiterun because I don't want to start encountering dragons just yet. So what do you think is a good house to start with?

Markarth.

You're welcome.

Edit: Since you editted in a proper question: Markarth has the nicest layout and the most practical storage, it is not as conveniently located as Whiterun but overall the house is the best one, imo.

yes markarth is the best imo, windhelm is good too i hear.

Yeah, I was doing a spell check on the word "deciding" ( had a moment of complete brainfreeze) and when i typed in my title description I accidentally pressed enter, lol.

Does Markarth have an enchanting table and/or an alchemy lab?

Both.

In my opinion, and for the following reasons...
Honeyside in Riften

Reasoning:
1. It does not force the MQ on characters. Breezehome requires you begin the MQ.
2. It does not force any Faction questline on characters. Hjerim requires you to choose sides in the Civil War.
3. It does not require a minimum Level. Proudspire Manor requires your character to be a minimum of Lvl20.
4. It does not require a minimum Level. Vlindrel Hall requires your character to be a minimum of Lvl20 to receive the required quest.

This leaves Honeyside.
It can be purchased at any level, needs only minimal favor questing, affordable, and does not require your character to join any faction.
Nor does if force you to begin any questline you never intend to complete.

A simple choice, really.
One person's opinion. Your mileage may vary. :read:

Forgot to mention, this actually does make a difference to me...despite Markarth being a problem area this house actually feels more secure than the others, you have a single strong looking metal door and your house karl stays between your bed and the door!

Edit: You need to be lvl20 for Markarth though iirc.

I agree. Additionally it has a door leading to "Skyrim" as well as a door leading to "Riften"... So you can go out your back porch and immediately return to exploration.

I understand that the Windhelm house is the one with the most storage space, though I am personally content with Breezehome.

I thought about Honeyside myself but I'm sceptical about living in such a neighbourhood. With the Thieves Guild and all xD

Think I'm gonna go with Honeyside in Riften since I'm only lvl 8. Thanks for your input guys!

I have only used two houses in the game -- Breezehome and Honeyside. I am in agreement with Nefarious One. And I have my own reasons for favoring this house.

01. One door access to Skyrim without having to go through a main gate.

02. Everything you need is nearby -- minus a smelter. ( Are you truly going to go mine ore and make ingots? If not, a smelter becomes pointless. )

03. Alchemy table improvement and Enchanting table improvement.

04. Plenty of storage places for the organizing player.

I enjoy it especially being an Argonian and thieves guild member.

My first character bought the Honeyside house, but he was also a Thieves Guild member. I don't know if that is enough to keep other thieves out of your stuff though. With my current character playing the MQ, I will probably buy the one in Whiterun.

Btw, can you buy more than one, or is it once and done?

You can buy them all if you want.

you can buy more than one house, and even move your spouse between them once you get one.

You can buy more than one. Which is awesome because my Breezehome house is for all my smithing stuff, and my new house in Solitude is my showcase home, with armor/gear everywhere. I'm gonna eventually have them all.

would members of the thieves guild steal from your house in riften ?

Windhelm, but you gotta start the Civil War Questline and it is bugged the hell out to where you gotta check up on it all the time in my experience.

Finally bought and upgraded all of them earlier, and I'd say:

Solitude < Riften < Whiterun < Windhelm < Markarth

Just my opinion though, mind.