Open-Ended versus Closed Probes: Assessing Different Formats of Web Probing

Autor/inn/en	Neuert, Cornelia E.; Meitinger, Katharina; Behr, Dorothée
Titel	Open-Ended versus Closed Probes: Assessing Different Formats of Web Probing
Quelle	In: Sociological Methods & Research, 52 (2023) 4, S.1981-2015 (35 Seiten) PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Neuert, Cornelia E.) ORCID (Meitinger, Katharina)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	0049-1241
DOI	10.1177/00491241211031271
Schlagwörter	Internet; Online Surveys; Test Items; Evaluation; Responses; Data Collection + Suchen Sie Ihr Suchwort? Test content; Testaufgabe; Evaluierung; Data capture; Datensammlung
Abstract	The method of web probing integrates cognitive interviewing techniques into web surveys and is increasingly used to evaluate survey questions. In a usual web probing scenario, probes are administered immediately after the question to be tested (concurrent probing), typically as open-ended questions. A second possibility of administering probes is in a closed format, whereby the response categories for the closed probes are developed during previously conducted qualitative cognitive interviews. Using closed probes has several benefits, such as reduced costs and time efficiency, because this method does not require manual coding of open-ended responses. In this article, we investigate whether the insights gained into item functioning when implementing closed probes are comparable to the insights gained when asking open-ended probes and whether closed probes are equally suitable to capture the cognitive processes for which traditionally open-ended probes are intended. The findings reveal statistically significant differences with regard to the variety of themes, the patterns of interpretation, the number of themes per respondent, and nonresponse. No differences in number of themes across formats by sex and educational level were found. (As Provided).
Anmerkungen	SAGE Publications. 2455 Teller Road, Thousand Oaks, CA 91320. Tel: 800-818-7243; Tel: 805-499-9774; Fax: 800-583-2665; e-mail: journals@sagepub.com; Web site: https://sagepub.com
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01