What to Do Instead of Significance Testing? Calculating the 'Number of Counterfactual Cases Needed to Disturb a Finding'

Autor/inn/en	Gorard, Stephen; Gorard, Jonathan
Titel	What to Do Instead of Significance Testing? Calculating the 'Number of Counterfactual Cases Needed to Disturb a Finding'
Quelle	In: International Journal of Social Research Methodology, 19 (2016) 4, S.481-490 (10 Seiten) PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1364-5579
DOI	10.1080/13645579.2015.1091235
Schlagwörter	Statistical Significance; Testing; Sampling; Attrition (Research Studies); Reliability; Effect Size; Research Problems; Robustness (Statistics); Heuristics; Computation + Suchen Sie Ihr Suchwort? Testdurchführung; Testen; Reliabilität; Forschungskritik; Widerstandsfähigkeit; Heuristik
Abstract	This brief paper introduces a new approach to assessing the trustworthiness of research comparisons when expressed numerically. The 'number needed to disturb' a research finding would be the number of counterfactual values that can be added to the smallest arm of any comparison before the difference or 'effect' size disappears, minus the number of cases missing key values. This way of presenting the security of findings has several advantages over the use of significance tests, effect sizes and confidence intervals. It is not predicated on random sampling, full response or any specific distribution of data. It bundles together the sample size, magnitude of the finding and the level of attrition in a way that is standardised and therefore comparable between studies. (As Provided).
Anmerkungen	Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2020/1/01