The number of medical studies performed through online surveys has increased dramatically in recent years. Despite their numerous advantages (eg, sample size, facilitated access to individuals presenting stigmatizing issues), selection bias may exist in online surveys. However, evidence on the representativeness of self-selected samples in online studies is patchy. Objective: Our objective was to explore the representativeness of a self-selected sample of online gamers using online players' virtual characters (avatars). Methods: All avatars belonged to individuals playing World of Warcraft (WoW), currently the most widely used online game. Avatars' characteristics were defined using various games' scores, reported on the WoW's official website, and two self-selected samples from previous studies were compared with a randomly selected sample of avatars. Results: We used scores linked to 1240 avatars (762 from the self-selected samples and 478 from the random sample). The two self-selected samples of avatars had higher scores on most of the assessed variables (except for guild membership and exploration). Furthermore, some guilds were overrepresented in the self-selected samples. Conclusions: Our results suggest that more proficient players or players more involved in the game may be more likely to participate in online surveys. Caution is needed in the interpretation of studies based on online surveys that used a self-selection recruitment procedure. Epidemiological evidence on the reduced representativeness of sample of online surveys is warranted.
Schonlau Matthias, Will Web Surveys Ever Become Part of Mainstream Research?, 10.2196/jmir.6.3.e31
Rhodes S D, Collecting behavioural data using the world wide web: considerations for researchers, 10.1136/jech.57.1.68
McCabe Sean Esteban, Boyd Carol J, Couper Mick P, Crawford Scott, D'Arcy Hannah, Mode effects for collecting alcohol and other drug use data: Web and U.S. mail., 10.15288/jsa.2002.63.755
McCabe Sean Esteban, Boyd Carol J., Young Amy, Crawford Scott, Feasibility Study for Collecting Alcohol and other Drug Use Data among Secondary School Students: A Web-Based Survey Approach, 10.2190/tgmb-0x3q-6pv1-9a6w
McCabe Sean Esteban, Comparison of Web and Mail Surveys in Collecting Illicit Drug Use Data: A Randomized Experiment, 10.2190/4hey-vwxl-dvr3-hakv
Gosling Samuel D., Vazire Simine, Srivastava Sanjay, John Oliver P., Should We Trust Web-Based Studies? A Comparative Analysis of Six Preconceptions About Internet Questionnaires., 10.1037/0003-066x.59.2.93
Whitehead Lisa, Methodological Issues in Internet-Mediated Research: A Randomized Comparison of Internet Versus Mailed Questionnaires, 10.2196/jmir.1593
Ritter Philip, Lorig Kate, Laurent Diana, Matthews Katy, Internet Versus Mailed Questionnaires: A Randomized Comparison, 10.2196/jmir.6.3.e29
Kypri Kypros, Gallagher Stephen J., Cashell-Smith Martine L., An Internet-based survey method for college student drinking research, 10.1016/j.drugalcdep.2004.04.001
McCabe Sean Esteban, Screening for Drug Abuse Among Medical and Nonmedical Users of Prescription Drugs in a Probability Sample of College Students, 10.1001/archpediatrics.2007.41
Eysenbach Gunther, Wyatt Jeremy, Using the Internet for Surveys and Health Research, 10.2196/jmir.4.2.e13
Ramo D. E., Hall S. M., Prochaska J. J., Reaching young adult smokers through the Internet: Comparison of three recruitment mechanisms, 10.1093/ntr/ntq086
Ramo Danielle E, Prochaska Judith J, Broad Reach and Targeted Recruitment Using Facebook for an Online Survey of Young Adult Substance Use, 10.2196/jmir.1878
Edwards Philip James, Roberts Ian, Clarke Mike J, DiGuiseppi Carolyn, Wentz Reinhard, Kwan Irene, Cooper Rachel, Felix Lambert M, Pratap Sarah, Methods to increase response to postal and electronic questionnaires, 10.1002/14651858.mr000008.pub4
Fenner Yeshe, Garland Suzanne M, Moore Elya E, Jayasinghe Yasmin, Fletcher Ashley, Tabrizi Sepehr N, Gunasekaran Bharathy, Wark John D, Web-Based Recruiting for Health Research Using a Social Networking Site: An Exploratory Study, 10.2196/jmir.1978
Ramo Danielle E, Prochaska Judith J, Prevalence and co-use of marijuana among young adult cigarette smokers: An anonymous online national survey, 10.1186/1940-0640-7-5
Owen Jason E., Bantum Erin O’Carroll, Criswell Kevin, Bazzo Julie, Gorlick Amanda, Stanton Annette L., Representativeness of two sampling procedures for an internet intervention targeting cancer-related distress: a comparison of convenience and registry samples, 10.1007/s10865-013-9509-6
Mayr Andreas, Gefeller Olaf, Prokosch Hans-Ulrich, Pirkl Anna, Fröhlich Antje, de Zwaan Martina, Web-based data collection yielded an additional response bias—but had no direct effect on outcome scales, 10.1016/j.jclinepi.2012.03.005
Zanetta Dauriat Francesca, Zermatten Ariane, Billieux Joël, Thorens Gabriel, Bondolfi Guido, Zullino Daniele, Khazaal Yasser, Motivations to Play Specifically Predict Excessive Involvement in Massively Multiplayer Online Role-Playing Games: Evidence from an Online Survey, 10.1159/000326070
Kuss Daria J., Louws Jorik, Wiers Reinout W., Online Gaming Addiction? Motives Predict Addictive Play Behavior in Massively Multiplayer Online Role-Playing Games, 10.1089/cyber.2012.0034
Billieux Joël, Van der Linden Martial, Achab Sophia, Khazaal Yasser, Paraskevopoulos Laura, Zullino Daniele, Thorens Gabriel, Why do you play World of Warcraft? An in-depth exploration of self-reported motivations to play online and in-game behaviours in the virtual world of Azeroth, 10.1016/j.chb.2012.07.021
World of warcraft-Site officiel2014-06-26http://eu.battle.net/wow/fr/6Qd2EhVIB
Billieux Joël, Chanal Julien, Khazaal Yasser, Rochat Lucien, Gay Philippe, Zullino Daniele, Van der Linden Martial, Psychological Predictors of Problematic Involvement in Massively Multiplayer Online Role-Playing Games: Illustration in a Sample of Male Cybercafé Players, 10.1159/000322525
Research randomizer2014-06-19http://www.randomizer.org/6QRsWJ2Bq
Cranford James A., McCabe Sean Esteban, Boyd Carol J., Slayden Janie, Reed Mark B., Ketchie Julie M., Lange James E., Scott Marcia S., Reasons for nonresponse in a web-based survey of alcohol involvement among first-year college students, 10.1016/j.addbeh.2007.07.008
Bibliographic reference
Khazaal, Yasser ; Van Singer, Mathias ; Chatton, Anne ; Achab, Sophia ; Zullino, Daniele ; et. al. Does self-selection affect samples'representativeness in online surveys an investigation in online video game research. In: Journal of Medical Internet Research, Vol. 16, no. 7 (2014)