E1n1verse

WoW Survey Deisgn: Putting the Horse Before the Cart?

I've been thinking about the design of the study I want to do on motivation in World of Warcraft. My immediate approach, similar to introductory programming students, was to jump right into the meat of it and start writing survey questions instead of planning. In order to get the data you need in the study, you need to know what questions you want answered. You need to plan. Without knowing that, how can you write survey questions to elicit those answers? So what is it I want to know?

The requirements to complete the "Insane in the Membrane" achievement.
Image from WoWWiki (2009)

I want to say something about the kinds of motivations people have for playing World of Warcraft. Specifically, I want to enumerate factors that motivate players to persist in the game even when it involves tasks that are repetitive, boring, or seemingly impossibly long. For example, there's an achievement in World of Warcraft called "Insane in the Membrane" that gives the completer a reward of an in-game title of "The Insane." This achievement requires you to raise your reputation points with different game factions to exalted, the highest level. Generally, you need about 21,000 points to reach exalted. Points are gained by completing quests, collecting and turning in items, or sometimes killing certain types of things. If you only had to gain exalted reputation with one or two factions, this would not be difficult. However, you need to do this with eight different factions, most of which are not factions you would be accruing large amounts of reputation with during the normal course of play. To increase the difficulty, several of the factions involved have rival factions. With those factions, as you gain reputation with one, you lose reputation points with the rival faction, making the process of completing this achievement complex in addition to time-consuming. The WoWWiki (2009) page describes some strategies for completing this achievement and the complexities of the faction-rival relationships.

Most tasks players undertake are not going to be as complex, time-consuming, or mind-numbing to complete as the aptly-named "Insane in the Membrane". There are, however, many smaller day-to-day activities necessary for successful raiding or to get some particular piece of gear, such as doing daily quests to earn gold, or harvesting materials for potions or enchantments, or completing instance and after instance to get badge rewards or reputation rewards. I'm making it sound like getting achievements or gear is the be-all, end-all, but I think the situation is more complex than that. It's that hypothesis I want to verify.

Other things I would like to be able to comment on include the relationships between gender and motivation, or motivation and age, or possibly even motivation and nationality. I do not necessarily believe there will be a relationship between motivation and nationality necessarily, but how can you definitively say if you do not look for the correlation? That gives me the following questions I want answered:

1. What motivates people to play World of Warcraft?
2. What motivates people to persist in very boring or difficult tasks?
3. Is there a relationship between gender and stated motivations? If so, what is it?
4. Is there a relationship between age and stated motivations? If so, what is it?
5. Is there a relationship between nationality and stated motivations? If so, what is it?
6. Is there a relationship between character roles and classes and motivation?

With those six questions in mind and the original study idea of determining motivation via analysis of free-form essays about motivation, I can now go ahead and develop the specific survey questions that will help elicit data to answer those questions. Going back to considering my approach-whether I should start with planning versus start with survey question-it was not as clearcut as I expected. By starting with some potential survey questions and then thinking about the answers I would get from them, I gained a better idea about what answers I wanted, a kind of iterative development process. Sometimes putting the horse first helps you know where and how to put the cart!

References:

WoWWiki. (2009) Insane in the Membrane, [online] WoWWiki. Available from http://www.wowwiki.com/Insane_in_The_Membrane (Accessed November 6, 2009).