Rubric-Based Holistic Review Represents a Change from Traditional Graduate Admissions Approaches in Physics

Autor/inn/en	Young, Nicholas T.; Verboncoeur, N.; Lam, Dao Chi; Caballero, Marcos D.
Titel	Rubric-Based Holistic Review Represents a Change from Traditional Graduate Admissions Approaches in Physics
Quelle	In: Physical Review Physics Education Research, 19 (2023) 1, Artikel 010134 (20 Seiten)Infoseite zur Zeitschrift PDF als Volltext Verfügbarkeit
Zusatzinformation	ORCID (Young, Nicholas T.) ORCID (Verboncoeur, N.) ORCID (Caballero, Marcos D.)
Sprache	englisch
Dokumenttyp	gedruckt; online; Zeitschriftenaufsatz
Schlagwörter	Scoring Rubrics; Admission Criteria; Equal Education; Graduate Students; Physics; Science Education; Minority Group Students; Gender Differences; Ethnic Groups; Departments; Longitudinal Studies; Grade Point Average; Decision Making; College Faculty; Science Teachers; Holistic Approach; Student Characteristics; Institutional Characteristics; College Admission + Suchen Sie Ihr Suchwort? Scoring formulas; Auswertungsbogen; Admission; Admission procedures; Zulassungsbedingung; Zulassungsverfahren; Zulassung; Graduate Study; Student; Students; Aufbaustudium; Graduiertenstudium; Hauptstudium; Studentin; Physik; Naturwissenschaftliche Bildung; Geschlechterkonflikt; Ethnie; Department; Abteilung; Longitudinal study; Longitudinal method; Longitudinal methods; Längsschnittuntersuchung; Decision-making; Entscheidungsfindung; Fakultät; Science; Teacher; Teachers; Science teacher; Wissenschaft; Lehrer; Lehrerin; Lehrende; Holistischer Ansatz; Hochschulzugang; Hochschulzulassung
Abstract	Rubric-based admissions are claimed to help make the graduate admissions process more equitable, possibly helping to address the historical and ongoing inequities in the U.S. physics graduate school admissions process that have often excluded applicants from minoritized races, ethnicities, genders, and backgrounds. Yet, no studies have examined whether rubric-based admissions methods represent a fundamental change in the admissions process or simply represent a new tool that achieves the same outcome. To address that, we developed supervised machine learning models of graduate admissions data collected from our department over a seven-year period. During the first four years, our department used a traditional admission process and switched to a rubric-based process for the following three years, allowing us to compare which parts of the applications were driving admissions decisions. We find that faculty focused on applicants' physics GRE scores and grade-point averages when making admissions decisions before the implementation of the rubric. While we were able to develop a sufficiently good model whose results we could trust for the data before the implementation of the rubric, we were unable to do so for the data collected after the implementation of the rubric, despite multiple modifications to the algorithms and data such as implementing Tomek Links. Our inability to model the second dataset despite being able to model the first combined with model comparison analyses suggests that rubric-based admission does change the underlying process. These results suggest that rubric-based holistic review is a method that could make the graduate admission process in physics more equitable. (As Provided).
Anmerkungen	American Physical Society. One Physics Ellipse 4th Floor, College Park, MD 20740-3844. Tel: 301-209-3200; Fax: 301-209-0865; e-mail: assocpub@aps.org; Web site: https://journals.aps.org/prper/
Erfasst von	ERIC (Education Resources Information Center), Washington, DC
Update	2024/1/01