Suchergebnisse

AbstractEstablished face-to-face surveys encounter increasing pressures to move online. Such a mode switch is accompanied with methodological challenges, including the need to shorten the questionnaire that each respondent receives. Split Questionnaire Designs (SQDs) randomly assign respondents to different fractions of the full questionnaire (modules) and, subsequently, impute the data that are missing by design. Thereby, SQDs reduce the questionnaire length for each respondent. Although some researchers have studied the theoretical implications of SQDs, we still know little about their performance with real data, especially regarding potential approaches to constructing questionnaire modules. In a Monte Carlo study with real survey data, we simulate SQDs in three module-building approaches: random, same topic, and diverse topics. We find that SQDs introduce bias and variability in univariate and especially in bivariate distributions, particularly when modules are constructed with items of the same topic. However, single topic modules yield better estimates for correlations between variables of the same topic.

Tools to measure perceptions of child wellbeing using a questionnaire are commonplace in educational research. However, the design and development of these tools vary widely. This case study considers a new approach used by researchers who were part of a collaborative, mixed-methods study of child wellbeing, resulting in Australia's first nationally representative and internationally comparable online questionnaire of child wellbeing in the middle years of schooling. The researchers, expert in quantitative methods, worked in partnership with social policy researchers, experts in qualitative research methods, to develop a large-scale questionnaire of child wellbeing. The questionnaire design was informed by children's perspectives on their own wellbeing using qualitative research methods. In particular, the perspectives of children in Australia who may experience disadvantage or marginalization were gathered. Attention was also given to ensuring that questionnaire administration was flexible, interactive, age-appropriate, and sensitive to children's needs. Furthermore, the questionnaire needed to be quantitative in kind, internationally comparable with other questionnaires, and self-completed online by students in Years 4, 6, and 8 in schools across Australia. This case study presents some of the methodological challenges and opportunities in large-scale questionnaire design and online implementation as well as learnings that may be useful for educational researchers and tertiary students undertaking or working in the field of questionnaire research.

Large-scale surveys are increasingly moving from (face-to-face or telephone-based) interviewer-administered to self-administered online modes. To ensure high measurement quality and maximum comparability and equivalence between the source questionnaire and its adaptation - across modes as well as across survey waves - various aspects of question design must be considered and several decisions need to be made concerning question presentation and wording. This survey guideline summarizes good practices on how to transition questionnaires from interviewer- to self-administered web surveys and gives recommendations and examples for major adaptation issues as well as general questionnaire design elements relevant to web surveys. In this context, we focus on the switch from an interviewer-based to an online mode (although mixed-mode designs are also conceivable).

Demographic surveys frequently seek information from multiple household members. Such surveys have two main design options: a person-level approach, which presents all questions to each eligible person, & a household screening approach, which first identifies whether anyone in the household has the characteristic of interest. Person-by-person enumeration can be inefficient & tedious, but may reduce underreporting error. The household-level approach is efficient, but suspect with regard to data quality. Published research offers scant empirical evidence concerning the impacts of these two designs. This paper presents results from the US Census Bureau's 1999 Questionnaire Design Experimental Research Survey, which included a split-ballot test of the two designs. We find some evidence, for some topics, that household screening increases the risk of underreporting, but we also find evidence that it produces more reliable data. We find the expected increase in interview efficiency with the household-level design, & some evidence that interviewers prefer it. 1 Table, 9 References. Adapted from the source document.

This chapter examines the technical challenges involved in translating and adapting measurement instruments, i.e., questionnaires, for migration research. The first part outlines good practices in questionnaire translation. In line with the technology-based focus of this book, the second part focuses on computerized surveys and on the interplay between technology, language, and culture. Frameworks from the software localization field are consulted and transferred to the context of computerized multilingual surveys with respect to their impact on source questionnaire design and on translation and adaptation. Real-life examples come from our own experiences in international and migration research, as well as from a review of existing reports and research articles. The main goal of this chapter is to raise awareness of the additional technology layer that impacts translation and adaptation, with an ultimate goal to improve translation and adaptation processes, and the outcomes of migration research.

The role of schools in democratic education is essential to build more equitable and inclusive societies. The literature highlights the lack of instruments for evaluating support strategies in this field with adequate psychometric properties. The aim of this work was to create the questionnaire "Coexistence and democratic participation in schools" based on validation by expert judges and reliability analysis through a pilot study. Sixteen experts in the subject and methodological aspects participated as judges, and 136 school principals participated in the pilot study. A content validity analysis and a reliability study of the instrument were carried out. The results indicate an adequate content validity and an acceptable reliability, with a correlation level between .6 and .7 for most of the items and acceptable reliability, with a Cronbach's alpha value of .876 for the Coexistence dimension, and a Cronbach's alpha value of .886 for the Participation dimension. From the judges' evaluations and the pilot test, it became clear that the behavior of some items needed to be revised based on the correlations of each item with its subscale. ; El papel de los centros educativos en la formación democrática es fundamental para construir sociedades más equitativas e inclusivas. La literatura destaca la falta de instrumentos de evaluación de estrategias de apoyo en este ámbito con propiedades psicométricas adecuadas. El objetivo del trabajo fue construir el cuestionario "Convivencia y participación democrática en los centros educativos" a partir de la validación por jueces y análisis de fiabilidad mediante un estudio piloto. Respecto a los jueces, participaron 16 expertos en la temática y aspectos metodológicos y en cuanto al pilotaje, se contó con 136 directores de escuela. Se analizó la validez de contenido y fiabilidad del instrumento y los resultados indican una validez de contenido adecuada, con un nivel de correlación entre .6 y .7 en la mayoría de los ítems y una fiabilidad aceptable, con una alfa de Cronbach de ...