"Please indicate how much you agree or disagree...."

Post » Thu Mar 06, 2014 11:37 pm

So I have done 2 beta surveys for Zenimax now.

They have one of the most stupidly worded questions I have ever seen in a survey:

"Please indicate how much you agree or disagree with the following"

-Not at all

-Slightly

-Somewhat

-Quite a bit

-Very much

....ummm......what?

It really makes no sense if you think about it. I know what they are getting at...I think...but whoever wrote that survey needs to take an english class and a logic class.

It doesn't matter which option you choose, you're not sure if you're agreeing or disagreeing!

In other words:

"I agree or disagree not at all"

"I agree or disagree slightly"

"I agree or disagree somewhat"

Etc etc....

So which is it?!

I noticed it during the last survey and assumed it would be gone this time, but no.

Anyone else?

User avatar
Laura Wilson
 
Posts: 3445
Joined: Thu Oct 05, 2006 3:57 pm

Post » Thu Mar 06, 2014 4:02 pm

I do not agree at all.

I slightly agree.

I somewhat agree.

I agree quite a bit.

I very much agree.

User avatar
Lalla Vu
 
Posts: 3411
Joined: Wed Jul 19, 2006 9:40 am

Post » Thu Mar 06, 2014 6:58 pm

Oh I get what they were going for, but all the choices could go either in the 'agree' column or the 'disagree' column.

All they needed to say was "Please indicate how much you agree with the following"

User avatar
ruCkii
 
Posts: 3360
Joined: Mon Mar 26, 2007 9:08 pm

Post » Thu Mar 06, 2014 11:06 am

meh, i was just thinking; I don't know how to answer this...

*skips to next question*

User avatar
Ian White
 
Posts: 3476
Joined: Thu Jul 19, 2007 8:08 pm

Post » Thu Mar 06, 2014 9:56 am

In other words, it could also mean:

I do not at all disagree

I slightly disagree

I somewhat disagree

I disagree quite a bit

I very much disagree

See the problem?

User avatar
Meghan Terry
 
Posts: 3414
Joined: Sun Aug 12, 2007 11:53 am

Post » Thu Mar 06, 2014 11:02 am

I do not disagree at all.

I slightly disagree.

I somewhat disagree.

I disagree quite a bit.

I very much disagree.

It works both ways. :)

The wording of the question SHOULD HAVE BEEN: "How much you AGREE with the following", not "How much do you AGREE OR DISAGREE with the following".

User avatar
Beast Attire
 
Posts: 3456
Joined: Tue Oct 09, 2007 5:33 am

Post » Thu Mar 06, 2014 3:20 pm

Yeah, the form has been like this since I started testing in September, and we have managed, somehow, to cope :wink:

Just treat it as if the "or disagree" weren't there. And relax.

User avatar
Sammygirl500
 
Posts: 3511
Joined: Wed Jun 14, 2006 4:46 pm

Post » Thu Mar 06, 2014 8:10 am

Um, read the questions and it makes it quite clear how the response is meant. Example:

"I felt that combat was too easy"

-Not at all

-Slightly

-Somewhat

-Quite a bit

-Very much

User avatar
abi
 
Posts: 3405
Joined: Sat Nov 11, 2006 7:17 am

Post » Thu Mar 06, 2014 12:08 pm

I guess it can cause some confusion if you are not used to answering this kind of question on surveys.

It just seems obvious to me. If a sentence is worded like "My character was unique" and you disagree with the sentence, it just makes sense to answer "not at all", as in "My character was not unique at all".

User avatar
des lynam
 
Posts: 3444
Joined: Thu Jul 19, 2007 4:07 pm

Post » Thu Mar 06, 2014 10:04 pm

I had to re-read a few questions, moreover I had to re-read the options to answer the questions that were asked, and more than once! Added to that, the Q&A format did jump around a little too which added to my confusion. (I'm Irish, and not the sharpest tool in the shed, if you put me in a 44 gallon drum and told me to pee in the corner, I'd be there all week)

I figured that the survey was put together quickly off an older template or something, it felt to me like it was rushed. Given the time frame I understand, but considering I'm getting a snapshot of the game before release, then yeah I'm okay with answering a badly worded survey. I'm getting something I like for something in return and selfishly the survey may well help me in getting what I want for MY game. (ESO isn't your game..it's mine, ALL MINE!)

If the survey had been for anything else... anything else at all and I wouldn't have bothered.

User avatar
Laura Wilson
 
Posts: 3445
Joined: Thu Oct 05, 2006 3:57 pm

Post » Thu Mar 06, 2014 10:49 am

That particular question is easy and straight forward. But they weren't all written that way.

The ones I am referring to simply don't make sense.

So...um...read the question and you'd see, quite clearly, what I am talking about.

User avatar
carrie roche
 
Posts: 3527
Joined: Mon Jul 17, 2006 7:18 pm

Post » Thu Mar 06, 2014 1:01 pm

I'm an ESL and had a hard time coping with some of the questions especially this one: The game wasn't enough like other MMORPGs... I don't know what to answer instantly unless I reread it and anolyze it hard.

User avatar
teeny
 
Posts: 3423
Joined: Sun Feb 25, 2007 1:51 am

Post » Thu Mar 06, 2014 10:19 pm

I'm sorry, but nothing about the survey's questions come off as difficult. If you have ever gone through high school or applied for a job, the wording of these questions are standard affair.

Yeah, these are the type of questions that have double answers -- person a) hates the game because it is too much like other MMOs, person B) likes the game because it is too much like other MMOs. The goal of this type of question isn't to gauge if people like/dislike something about the game; it's so the developers can gauge this against their own goals for the game, without customer preference involved.

User avatar
Glu Glu
 
Posts: 3352
Joined: Sun Apr 01, 2007 5:39 am

Post » Thu Mar 06, 2014 6:10 pm

Sure...that makes perfect sense, and as I said before I understand what they were going for. But the questions I am referring to were simply written incorrectly. No two ways about it. Re-read my original post and pay close attention...I think you'll see what I'm saying.

It's not a big deal. I understand what they meant. But it was clumsy and they are probably getting inaccurate data because of it.

User avatar
Paula Ramos
 
Posts: 3384
Joined: Sun Jul 16, 2006 5:43 am

Post » Thu Mar 06, 2014 5:38 pm

Look...I don't mean to offend you, but you clearly have problems with reading comprehension.

Again, I get what they were going for.

Let me ask you this:

How much do you AGREE or DISAGREE with my complaints?

-Not at all

-Slightly

-Somewhat

-Quite a bit

-Very much

No matter which you choose, you are AGREEING and also DISAGREEING....

Get it?

-I agree/disagree not at all

-I agree/disagree slightly

etc

Please comprehend this. I'm begging you.

User avatar
Ludivine Poussineau
 
Posts: 3353
Joined: Fri Mar 30, 2007 2:49 pm

Post » Thu Mar 06, 2014 3:24 pm

Thank you MercyKilling!

It's nice that someone actually understands what I'm saying here :)

User avatar
SexyPimpAss
 
Posts: 3416
Joined: Wed Nov 15, 2006 9:24 am

Post » Thu Mar 06, 2014 3:37 pm

very much this.
Read the whole chabang, dumdidum when people quote out of context like op instead if readimg and undeerstanding. Like a sunday magazine..
User avatar
Lindsay Dunn
 
Posts: 3247
Joined: Sun Sep 10, 2006 9:34 am

Post » Thu Mar 06, 2014 9:20 pm

I understand your complaint.

I just see what works for most of the questions (because only a few of them were confusing) and apply the rule to the others. The rule being "how much you AGREE (not disagree) with the question", because that's what makes sense on the context.

Also, about your example, you might want to edit that because it doesn't fit the way the survey was worded at all. Instead, try that:
"How do you agree or disagree with the next statements?
1 - My complaint is absolutely valid and understandable.

(not at all / slightly / somewhat / quite a bit / very much)

2 - My complaint doesn't make any sense.

(not at all / slightly / somewhat / quite a bit / very much)"

It makes all the difference in the world and it still proves your point (I think), since the first sentence is obvious and the second can be confusing because of the possibility of a double negative. Feel free to ignore it if you disagree.

User avatar
Donatus Uwasomba
 
Posts: 3361
Joined: Sun May 27, 2007 7:22 pm

Post » Thu Mar 06, 2014 5:10 pm

i get these kind of odd surveys from school all the time, so i answered these like i answer those~

User avatar
Maddy Paul
 
Posts: 3430
Joined: Wed Feb 14, 2007 4:20 pm

Post » Thu Mar 06, 2014 9:47 pm

do you guys really think they even read the surveys after? I am for one pretty sure they dont for example

Combat is way to easy but yet they made it easier

gutripper doshia and baelrath were the ONLY 3 challenging fights I encountered in all of my beta time and it took me a while to figure out how to beat them.....now they made them easier, why even ask us our opinion if your just gonna dumb down combat anyways? or did everyone actually say combat was too hard?

User avatar
Louise Andrew
 
Posts: 3333
Joined: Mon Nov 27, 2006 8:01 am

Post » Thu Mar 06, 2014 11:55 pm

Would you agree or disagree that it isn't 'standard affair' but 'standard fare' ?

Perhaps some people see difficult as not being difficult. But perhaps really what is happening is they don't comprehend or understand in the first place making the difficult look easy.

I for one found the survey, 'jumpy' for a better term as the terminology used jumped around in structure, I still filled it out regardless.

Perhaps ZOS will do a survey on the survey. :D

User avatar
Charles Weber
 
Posts: 3447
Joined: Wed Aug 08, 2007 5:14 pm

Post » Thu Mar 06, 2014 3:47 pm

I didn't have a problem with any of the questions, but then I never played WOW either, so I'm not [censored].

But here is how it works. For instance the question:

Combat was too easy.

If you agreed with this then you would answer : -Very Much (yes combat was easy, I just hit my left mouse button and stuff died)

If you Disagreed then you would answer: -Not at all (No combat was hard, there was red stuff on the ground that if I stood in it I took damage and died!)

If you were middle of the road you would answer: -somewhat. ( I have no clue what I was doing I just banged my face on the keyboard )

Wait til you get to the math with letters, now that is hard!!

User avatar
lolly13
 
Posts: 3349
Joined: Tue Jul 25, 2006 11:36 am

Post » Thu Mar 06, 2014 8:37 am

Cool...that's fine. Again....I GET IT.

But don't you think they should have had an editor or someone who could have pointed out the obvious, instead of making people "see what works for most of the questions (because only a few of them were confusing) and apply the rule to the others"?

That's what I had to do of course, but not everybody will understand that.

I am totally nitpicking I'll admit. But there should be no debate about whether the particular questions to which I am referring made sense or not. They didn't...and it could lead to inaccurate data.

Ok...I was just throwing it out there. For those of you who understood the issue I commend you. For the rest, back to school with you!

User avatar
Julie Ann
 
Posts: 3383
Joined: Thu Aug 23, 2007 5:17 am

Post » Thu Mar 06, 2014 10:41 am

Oh my god...

Creslien....that particular question (statement, actually), "Combat was too easy", is totally straightforward and the choices make perfect sense in that context.

But that's not what I'm referring to at all. Please go back and re-read the OP.

Ah screw it...it doesn't matter.

Reading comprehension, people.

User avatar
LuCY sCoTT
 
Posts: 3410
Joined: Sun Feb 04, 2007 8:29 am

Post » Thu Mar 06, 2014 8:07 pm

HA!

Perfect reply.

Thank you Kijima.

This is exhausting....goodnight people.

User avatar
sas
 
Posts: 3435
Joined: Thu Aug 03, 2006 8:40 am

Next

Return to Othor Games