Suchergebnisse

Consent materials often contain complex information, legalese, and other features that render them difficult to comprehend in such a way that consent is truly informed. I propose that researchers adapt cognitive interviewing, normally used for the pretesting of survey questionnaires, to evaluate the understandability of consent materials and the way in which subjects use this information to make decisions regarding participation. Cognitive interviewing involves the intensive probing of small samples of volunteer subjects to elucidate thought processes that otherwise remain hidden. Cognitive interviewing can be applied: (a) to further the basic science of informed consent; (b) to pretest materials for a specific study; and (c) as an embedded procedure for assessing subject thought processes in the course of obtaining consent.

Evaluation des techniques d'entretien cognitif: Est-ce que les résultats sont généralisables sur le terrain? Les techniques d'entretien cognitif sont assez répandues dans le pré-test des questionnaires d'enquête. Mais jusqu'à aujourd'hul il n'y a eu que peu d'évaluation de l'apport de ces techniques. Cet article fait une analyse critique des démonstrations de validité des méthodes d'entretien cognitif et suggère que les chercheurs vérifient le degré dont ces résultats de pré-test sont applicables au travail sur le terrain pour les enquêtes. Pour démontrer ces propos. l'auteur étudie cinq questions d'enquête testées en laboratoire cognitif. Sur la base de ces résultats de pré-test, des prévisions ont été faites concernant l'impact des modifications de questions sur les données qui devaient être obtenues sur le terrain. Trois tests à questionnaires jumeaux ("split-ballot") des différentes versions des questions ont été conduits. et on a trouvé que les prévisions des tests cognitifs ont été respectées. Ces résultats montrent qu'il y a un impact réel du travail en laboratoire cognitif sur le travail sur le terrain.

Méthodes de pré-test de questionnaire, les différentes techniques et organisations produisent-elles des résultats semblables ? : Depuis 20 ans, il y a eu un accroissement significatif dans l'utilisation de formes nouvelles de pré-tests de questionnaires. Diverses techniques d'évaluations ont été utilisées pour signaler les points forts et faibles de ces méthodes. Des études limitées ont été faites sur l'efficacité des interviews cognitifs dans la résolution des problèmes de questionnaire. Mais ces études n'ont pas distingué les effets des méthodes des effets de l'organisation. L'objectif de cette recherche est de déterminer comment des méthodes diverses utilisées par trois instituts d'enquête par questionnaire (U.S. Census Bureau, Westat Inc. et Research Triangle Institute) arrivent à prédire les problèmes. Pour cette recherche, plusieurs chercheurs dans chacun des instituts ont utilisé trois méthodes de pré-test (revue informelle par experts, un système formel d'évaluation cognitive, et l'interview cognitif) sur trois questionnaires dans une expérience tridimensionnelle de tris multiples. Une classification est faite des problèmes identifiés par les méthodes et ces problèmes sont comparés les uns aux autres. Nous calculons le degré d'accord entre les instituts et entre les méthodes. Nous concluons sur l'utilité et l'adéquation de chaque méthode, et le degré d'accord et le caractère systématique de ces résultats.

Insightful observations on common question evaluation methods and best practices for data collection in survey research Featuring contributions from leading researchers and academicians in the field of survey research, Question Evaluation Methods: Contributing to the Science of Data Quality sheds light on question response error and introduces an interdisciplinary, cross-method approach that is essential for advancing knowledge about data quality and ensuring the credibility of conclusions drawn from surveys and censuses. Offering a variety of expert analyses of question evaluation methods, the book provides recommendations and best practices for researchers working with data in the health and social sciences. Based on a workshop held at the National Center for Health Statistics (NCHS), this book presents and compares various question evaluation methods that are used in modern-day data collection and analysis. Each section includes an introduction to a method by a leading authority in the field, followed by responses from other experts that outline related strengths, weaknesses, and underlying assumptions. Topics covered include: Behavior coding Cognitive interviewing Item response theory Latent class analysis Split-sample experiments Multitrait-multimethod experiments Field-based data methods A concluding discussion identifies common themes across the presented material and their relevance to the future of survey methods, data analysis, and the production of Federal statistics. Together, the methods presented in this book offer researchers various scientific approaches to evaluating survey quality to ensure that the responses to these questions result in reliable, high-quality data. Question Evaluation Methods is a valuable supplement for courses on questionnaire design, survey methods, and evaluation methods

"Building on the success of the volume from the first Questionnaire Development, Evaluation, and Testing (QDET) conference edited by Stanley Presser (Wiley, 2004), this book brings together international experts in survey methodology in one volume to publish the results of the first conference in over a decade on questionnaire design and evaluation (QDET-2). The dramatic expansion of electronic and self-administered surveys since that time has led to a need for greater guidance on the design and evaluation of instruments relying upon these modes. It will also move beyond recent emphasis on academic and government research, to incorporate more approaches derived from the commercial sector. Methodologists have worked actively on optimal approaches for the development and evaluation of modern survey instruments, but such information has not been systematically disseminated in one forum that brings together various stakeholders in survey quality. This book, edited by leaders in the field, provides an opportunity to organize chapters into a cohesive unit that points to new directions for research and guides an emerging generation of methodologists. The book is a proactive forum to prepare researchers to meet the next generation of challenges, making it of interest to both researchers and practitioners internationally in government, academia, and the private sector"--

"The authors present results from a qualitative evaluation of the Spanish-language version of a dietary intake questionnaire and characterize the types of findings which emerged from several rounds of cognitive testing. Cognitive interviews were used to test the Spanish translation of the National Health Interview Survey (NHIS) Cancer Control Supplement dietary questions, with 36 Spanish-speaking and 9 English-speaking participants. Analyses of the results identified a) translation issues, b) culture-specific issues, and c) general design issues that affected both English and Spanish speakers. Results indicated that general design-oriented difficulties were particularly frequent. Their findings suggest that when appropriately structured, cognitive interviews that feature flexible probing can be useful for identifying a range of problems in survey translations, even after translations have been developed using currently accepted methods. They make several recommendations concerning practices that may be optimal in the conduct of empirical cross-cultural questionnaire evaluations." (author's abstract)

Kognitive Interviews werden - in der Regel im Pretest - eingesetzt um zu untersuchen, wie die Befragten Fragen verarbeiten und verstehen. Die Verfasser legen Ergebnisse einer Untersuchung vor, bei der Fragen aus der interkulturell vergleichenden Forschung untersucht wurden. Sie verwenden ein Codierungs-System, das das Verständnis von Schlüsselbegriffen durch die Befragten, die Fähigkeiten der Befragten, sich zur Beantwortung der Fragen notwendige Informationen zu beschaffen, Entscheidungsprozesse bei der Bewertung oder Bearbeitung solcher Informationen und die Vorstellungen berücksichtigt, die ein Befragter mit einer bestimmten Antwort verbindet. Diese Codes wurden auf die unstrukturierten schriftlichen Notizen der Interviewer angewendet. Die Verfasser ergänzen die Codierung und Tabellierung der Ergebnisse durch die schriftlichen Kommentare der Interviewer. Sie fragen zudem nach Merkmalen der Befragten, die einen Einfluss auf die Fragenbeantwortung haben könnten (Geschlecht, Ethnizität, Alter, Sprache). Der Beitrag schließt mit einer Bewertung der Stärken, Schwächen und methodologischen Brauchbarkeit dieses Forschungsansatzes. (ICE)

INTRODUCTION: Emerging tobacco products have become increasingly popular, and the US Food and Drug Administration extended its authority to all products meeting the definition of a tobacco product in 2016. These changes may lead to shifts in public perceptions about tobacco products and regulation, and national surveys are attempting to assess these perceptions at the population level. This article describes the item development and cognitive interviewing of the tobacco product and regulation perception items included in two tobacco-focused cycles of the Health Information National Trends Survey (HINTS-FDA), referred to as HINTS-FDA. METHODS: Cognitive interviewing was used to investigate how respondents comprehended and responded to tobacco product and regulation perception items. Adult participants (n = 20) were selected purposively to oversample current tobacco users and were interviewed in two iterative rounds. Weighted descriptive statistics from the fielded HINTS-FDA surveys (N = 5474) were also calculated. RESULTS: Items were generally interpreted as intended, and participants meaningfully discriminated between tobacco products when assessing addiction perceptions. Response selection issues involved inconsistent reporting among participants with little knowledge or ambivalent opinions about either government regulation or tobacco products and ingredients, which resolved when a "don't know" response option was included in the survey. The fielded survey found that a non-negligible proportion of the population do not have clear perceptions of emerging tobacco products or government regulation. CONCLUSIONS: A "don't know" response option is helpful for items assessing many emerging tobacco products but presents several analytic challenges that should be carefully considered. Multiple items assessing specific tobacco product and regulation perception items are warranted in future surveys. IMPLICATIONS: The findings from this study can serve as a foundation for future surveys that assess constructs related to ...

AbstractWhile it is clear that self-reported racial/ethnic discrimination is related to illness, there are challenges in measuring self-reported discrimination or unfair treatment. In the present study, we evaluate the psychometric properties of a self-reported instrument across racial/ethnic groups in a population-based sample, and we test and interpret findings from applying two different widely-used approaches to asking about discrimination and unfair treatment. Even though we found that the subset of items we tested tap into a single underlying concept, we also found that different groups are more likely to report on different aspects of discrimination. Whether race is mentioned in the survey question affects both frequency and mean scores of reports of racial/ethnic discrimination. Our findings suggest caution to researchers when comparing studies that have used different approaches to measure racial/ethnic discrimination and allow us to suggest practical empirical guidelines for measuring and analyzing racial/ethnic discrimination. No less important, we have developed a self-reported measure of recent racial/ethnic discrimination that functions well in a range of different racial/ethnic groups and makes it possible to compare how racial/ethnic discrimination is associated with health disparities among multiple racial/ethnic groups.