A Demonstration of Regression False Positive Selection in Data Mining

Autor/in	Pinder, Jonathan P.
Titel	A Demonstration of Regression False Positive Selection in Data Mining
Quelle	In: Decision Sciences Journal of Innovative Education, 12 (2014) 3, S.199-217 (19 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
ISSN	1540-4595
DOI	10.1111/dsji.12037
Schlagwörter	Data Collection; Data Analysis; Regression (Statistics); Predictive Measurement; Models; Experiments; Simulation; Statistical Significance; Inferences; Risk; Error of Measurement; Correlation + Suchen Sie Ihr Suchwort? Data capture; Datensammlung; Auswertung; Regression; Regressionsanalyse; Analogiemodell; Erprobung; Simulation program; Simulationsprogramm; Inference; Inferenz; Risiko; Messfehler; Korrelation
Abstract	Business analytics courses, such as marketing research, data mining, forecasting, and advanced financial modeling, have substantial predictive modeling components. The predictive modeling in these courses requires students to estimate and test many linear regressions. As a result, false positive variable selection ("type I errors") is nearly certain to occur. This article describes an in-class demonstration that shows the frequency and impact of false positives on data mining regression-based predictive modeling. In this demonstration, 500 randomly generated independent (X) variables are individually regressed against a single, randomly generated (Y) variable, and the resulting 500 p-values are sorted and examined. This experiment is repeated and the distribution of the number of variables significant at the 5% level resulting from this simulation is presented and discussed. The demonstration provides a tangible example in which students see the reality and risks of incorrectly inferring statistical significance of independent regression variables. Students have expressed a deeper understanding and appreciation of the risks of type I errors through this demonstration. This demonstration is innovative because the scale of the simulation allows the students to experience the near certainty that the correlations shown in the results are truly random. (As Provided).
Anmerkungen	Wiley-Blackwell. 350 Main Street, Malden, MA 02148. Tel: 800-835-6770; Tel: 781-388-8598; Fax: 781-388-8232; e-mail: cs-journals@wiley.com; Web site: http://www.wiley.com/WileyCDA
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2017/4/10