Suchergebnisse

Several studies have measured a gamification effect in the surveys among adults. However, no experiments have been published with a focus on younger respondents. In this article, data quality between three conditions is compared among children and adolescents 7–15 years old as follows: (1) a text-only survey, (2) a visual survey with an attractive design and images, and (3) a gamified survey. To test a gamification effect, an experiment using a volunteer online access panel in Russia was conducted among 1,050 children. The gamified survey produced completion time more than a third longer than the text-only survey. A higher overall item nonresponse rate was found in both the gamified and visual surveys. However, this was mainly due to the Flash-based questions in these conditions. Fewer respondents straight-lined and used middle responses in the gamified and visual surveys. It was also less burdensome to complete the gamified survey. Children requested help to answer survey questions less often. They found it more enjoyable and easier. Moreover, the subjective evaluation of the completion time was not different from the two other conditions. Overall, we suggest that a gamification effect in web surveys among children should be explored further.

The considerable growth in the number of smart mobile devices with a fast Internet connection provides new challenges for survey researchers. In this article, I compare the data quality between two survey modes: self-administered web surveys conducted via personal computer and those conducted via mobile phones. Data quality is compared based on five indicators: (a) completion rates, (b) response order effects, (c) social desirability, (d) non-substantive responses, and (e) length of open answers. I hypothesized that mobile web surveys would result in lower completion rates, stronger response order effects, and less elaborate answers to open-ended questions. No difference was expected in the level of reporting in sensitive items and in the rate of non-substantive responses. To test the assumptions, an experiment with two survey modes was conducted using a volunteer online access panel in Russia. As expected, mobile web was associated with a lower completion rate, shorter length of open answers, and similar level of socially undesirable and non-substantive responses. However, no stronger primacy effects in mobile web survey mode were found.

"A large number of findings in survey research suggest that misreporting in sensitive questions is situational and can vary in relation to context. The methodological literature demonstrates that social desirability biases are less prevalent in self-administered surveys, particularly in Web surveys, when there is no interviewer and less risk of presenting oneself in an unfavorable light. Since there is a growing number of users of mobile Web browsers, the authors focused our study on the effects of different devices (PC or cell phone) in Web surveys on the respondents' willingness to report sensitive information. To reduce selection bias, we carried out a two-wave cross-over experiment using a volunteer online access-panel in Russia. Participants were asked to complete the questionnaire in both survey modes: PC and mobile Web survey. The authors hypothesized that features of mobile Web usage may affect response accuracy and lead to more socially desirable responses compared to the PC Web survey mode. They found significant differences in the reporting of alcohol consumption by mode, consistent with our hypothesis. But other sensitive questions did not show similar effects. They also found that the presence of familiar bystanders had an impact on the responses, while the presence of strangers did not have any significant effect in either survey mode. Contrary to expectations, the authors did not find evidence of a positive impact of completing the questionnaire at home and trust in data confidentiality on the level of reporting. These results could help survey practitioners to design and improve data quality in Web surveys completed on different devices." (author's abstract)

The article is devoted to the issue to what extent mass media produces strong attitudes in an authoritarian political environment. A growing body of research scrutinizes how contemporary autocracies use media to promote legitimizing messages and undermine opposition. This study contributes to the literature by showing whether public opinion formed under authoritarianism is strong in the face of counterframing. While Russian state-owned TV-channels extensively promoted the idea that Donald Trump's victory will be positive for Russian-American relations, we run an experimental study with various treatments. We revealed two major findings: (1) participants are strongly exposed to counterframing and (2) those who watch news on state-owned TV-channels are more susceptible to the counterframing effect.

This paper investigates the effects on response and breakoff rates in Web surveys of e-mail invitation design elements including: subject line, estimated survey duration, and invitation length. The analysis is focused not only on the main effects, but also on an issue which has not yet been studied systematically: interaction effects between these design elements. A factorial complete block design Web experiment – among students, faculty, and administrative staff at the Higher School of Economics in Russia – varying the estimated length of the survey (10 vs. 20 minutes), subject line (formal "monitoring" vs. informal "help" request), and invitation length (short vs. long) was conducted. We discuss the results of the experiment and argue that we should not ignore interaction effects between design elements to understand response in Web surveys more thoroughly.

While grids or matrix questions are a widely used format in PC web surveys, there is no agreement on the format in mobile web surveys. We conducted a two-wave experiment in an opt in panel in Russia, varying the question format (grid format and item-by-item format) and device respondents used for survey completion (smartphone and PC). The 1,678 respondents completed the survey in the assigned conditions in the first wave and 1,079 in the second wave. Overall, we found somewhat higher measurement error in the grid format in both mobile and PC web conditions. We found almost no significant effect of the question format on test–retest correlations between the latent scores in two waves and no differences in breakoff rates between the question formats. The multigroup comparison showed some measurement equivalence between the question formats. However, the difference varied depending on the length of a scale with a longer scale producing some differences in the measurement equivalence between the conditions. The levels of straightlining were higher in the grid than in the item-by-item format. In addition, concurrent validity was lower in the grid format in both PC and mobile web conditions. Finally, subjective indicators of respondent burden showed that the grid format increased reported technical difficulties and decreased subjective evaluation of the survey.