Creating Definitions of Teaching Excellence Using Multi-Dimensional Scaling

David Nelson; Emily Bonem; Jason FitzSimmons

doi:10.20343/teachlearninqu.14.44

Authors

David Nelson Purdue University
Emily Bonem Purdue University https://orcid.org/0000-0002-1919-3143
Jason FitzSimmons Purdue University

DOI:

https://doi.org/10.20343/teachlearninqu.14.44

Keywords:

teaching excellence, concept-mapping, competence in higher education, concept-mapping process, faculty development

Abstract

This article explores efforts to define teaching excellence in higher education. We propose a flexible but structured concept-mapping process using multi-dimensional scaling (MDS). When used in collaboration with a group of institutional experts and recognized leaders in pedagogy, this concept-mapping approach can quickly delineate multiple categories that align with teaching excellence, localized to the institution and its stakeholders. Analysis included perspectives from tenure-track faculty, clinical/professional faculty, and students. Results indicate differences between students and faculty in their understanding of excellent teaching and significant alignment between different types of faculty instructors. This methodology could also be used with administrators, accreditors, and other higher education stakeholders to further understand and expand the definitions of teaching excellence.

Author Biographies

David Nelson, Purdue University

David Nelson (USA) is the associate director at Purdue’s Center for Instructional Excellence and a courtesy faculty member of the John Martinson Honors College. He teaches courses on learning science and artificial intelligence, and he leads a student-driven lab that explores student perceptions of learning in the AI era.
Emily Bonem, Purdue University

Emily M. Bonem (USA) is the assistant director of scholarship of teaching and learning at Purdue’s Center for Instructional Excellence. Her research focuses on creating autonomy-supportive learning environments to improve the quality of student motivation in higher education.
Jason FitzSimmons, Purdue University

Jason FitzSimmons (USA) is the strategic initiative project manager for the Office of the Provost at Purdue University. He leads institutional initiatives comprised of cross-functional teams focused on transforming education, enhancing the student experience, and strengthening institutional support of Purdue’s land grant mission.

References

Allan, Kathryn L. 2007. “Excellence: A New Keyword for Education?” Critical Quarterly 49 (1): 54–78. https://doi.org/10.1111/j.1467-8705.2007.00749.x.

Bain, Ken. 2004. What the Best College Teachers Do. Professional Development Collection. Harvard University Press.

Behari-Leak, Kasturi, and Sioux McKenna. 2017. “Generic Gold Standard or Contextualised Public Good? Teaching Excellence Awards in Post-Colonial South Africa.” Teaching in Higher Education 22 (4): 408–22. https://doi.org/10.1080/13562517.2017.1301910.

Benekos, Peter J. 2016. “How to Be a Good Teacher: Passion, Person, and Pedagogy.” Journal of Criminal Justice Education 27 (2): 225–37. https://doi.org/10.1080/10511253.2015.1128703.

Biggs, John. 2001. The Reflective Institution: Assuring and Enhancing the Quality of Teaching and Learning. Higher Education 41 (3): 221–38. https://doi.org/10.1023/A:1004181331049.

Borg, Ingwer, and Patrick J. F. Groenen. 2005. Modern Multidimensional Scaling: Theory and Applications. 2nd ed. Springer Series in Statistics. Springer. https://doi.org/10.1007/0-387-28981-X.

Brackenridge, Celia H., Daz Bishopp, Sybille Moussalli, and James Tapp. 2008. “The Characteristics of Sexual Abuse in Sport: A Multidimensional Scaling Analysis of Events Described in Media Reports.” International Journal of Sport and Exercise Psychology 6 (4): 385–406. https://doi.org/10.1080/1612197X.2008.9671881.

Chism, Nancy Van Note. 2006. “Teaching Awards: What Do They Award?” The Journal of Higher Education 77 (4): 589–617. https://doi.org/10.1080/00221546.2006.11772308.

Chism, Nancy Van Note, and Grady W. Chism. 2007. Peer Review of Teaching: A Sourcebook. 2nd ed. Anker Pub. Co.

Corbo, Joel C., Daniel L. Reinholz, Melissa H. Dancy, Stanley Deetz, and Noah Finkelstein. 2016. “Framework for Transforming Departmental Culture to Support Educational Innovation.” Physical Review Physics Education Research 12: 010113. https://doi.org/10.1103/PhysRevPhysEducRes.12.010113.

D’Andrea, Vaneeta-Marie, Maria João Rosa, Bjørn Stensaker, and Don F. Westerheijden. 2007. “Improving Teaching and Learning in Higher Education: Can Learning Theory Add Value to Quality Review?” In Higher Education Dynamics, 209–23. Springer Netherlands. https://doi.org/10.1007/978-1-4020-6012-0_8.

Emery, Charles R., Tracy R. Kramer, and Robert G. Tian. 2003. “Return to Academic Standards: A Critique of Student Evaluations of Teaching Effectiveness.” Quality Assurance in Education 11 (1): 37–46. https://doi.org/10.1108/09684880310462074.

Fanghanel, Joëlle. 2007. “Teaching Excellence in Context: Drawing from a Socio-Cultural Approach.” In International Perspectives on Teaching Excellence in Higher Education, edited by Alan Skelton. Routledge.

French, Amanda, and Matt O’Leary. 2017. Teaching Excellence in Higher Education: Challenges, Changes and the Teaching Excellence Framework. Great Debates in Higher Education. Emerald Publishing Limited.

Gunn, Vicky, and Anna Fisk. 2013. “Considering Teaching Excellence in Higher Education: 2007–2013: A Literature Review Since the CHERI Report 2007.” Research Report. Higher Education Academy.

Hammer, Dana, Peggy Piascik, Melissa Medina, Amy Pittenger, Renee Rose, Freddy Creekmore, Robert Soltis, Alicia Bouldin, Lindsay Schwarz, and Steven Scott. 2010. “Recognition of Teaching Excellence.” American Journal of Pharmaceutical Education 74 (9): 164. https://doi.org/10.5688/aj7409164.

Jackson, Kristin M., and William M. K. Trochim. 2002. “Concept Mapping as an Alternative Approach for the Analysis of Open-Ended Survey Responses.” Organizational Research Methods 5 (4): 307–36. https://doi.org/10.1177/109442802237114.

Lim, Juyun, and Harry T. Lawless. 2005. “Qualitative Differences of Divalent Salts: Multidimensional Scaling and Cluster Analysis.” Chemical Senses 30 (9): 719–26. https://doi.org/10.1093/chemse/bji064.

Lopes, António M., José P. Andrade, and J. A. Tenreiro Machado. 2016. “Multidimensional Scaling Analysis of Virus Diseases.” Computer Methods and Programs in Biomedicine 131: 97–110. https://doi.org/10.1016/j.cmpb.2016.03.029.

Olsson, Thomas, and Torgny Roxå. 2008. “Evaluating Rewards for Excellent Teaching—A Cultural Approach.” In Engaging Communities, Proceedings of the 31st HERDSA Annual Conference, edited by Mark Barrow and Katherine Sutherland, 261–272. Higher Education Research and Development Society of Australasia. https://herdsa.org.au/publications/conference-proceedings/research-and-development-higher-education-place-learning-and-70.

Saunders, Daniel B., and Gerardo Blanco Ramírez. 2017. “Against ‘Teaching Excellence’: Ideology, Commodification, and Enabling the Neoliberalization of Postsecondary Education.” Teaching in Higher Education 22 (4): 396–407. https://doi.org/10.1080/13562517.2017.1301913.

Simonson, Shawn R., Brittnee Earl, and Megan Frary. 2022. “Establishing a Framework for Assessing Teaching Effectiveness.” College Teaching 70 (2): 164–80. https://doi.org/10.1080/87567555.2021.1909528.

Simonson, Shawn R. n.d. “Implementing a Framework for Assessing Teaching Effectiveness (IFATE).” CTL (blog). Accessed November 29, 2024. https://www.boisestate.edu/ctl/initiatives/implementing-a-framework-for-assessing-teaching-effectiveness-ifate/.

Skelton, Alan. 2005. Understanding Teaching Excellence in Higher Education: Towards a Critical Approach. 1st ed. Key Issues in Higher Education Series. Routledge. https://doi.org/10.4324/9780203412947.

Stronge, James H. 2010. Effective Teachers—Student Achievement: What the Research Says. 1st ed. James H. Stronge Research-to-Practice Series. Eye on Education. https://doi.org/10.4324/9781315854977.

Wattiaux, Michel., Jeanette Moore, Robin Rastani, and Peter Crump. 2010. “Excellence in Teaching for Promotion and Tenure in Animal and Dairy Sciences at Doctoral/Research Universities: A Faculty Perspective.” Journal of Dairy Science 93 (7): 3365–76. https://doi.org/10.3168/jds.2010-3070.

Weaver, Gabriela C., Ann E. Austin, Andrea Follmer Greenhoot, and Noah D. Finkelstein. 2020. “Establishing a Better Approach for Evaluating Teaching: The TEval Project.” Change: The Magazine of Higher Learning 52 (3): 25–31. https://doi.org/10.1080/00091383.2020.1745575.

Willness, Chelsea, and Patti McDougall. 2017. “Building a Shared Framework for Teaching Quality at the University of Saskatchewan.” Accessed November 29, 2024. https://teaching.usask.ca/documents/gmctl/gmcte-teaching-quality-framework-phase-i.pdf.

Creating Definitions of Teaching Excellence Using Multi-Dimensional Scaling

Authors

DOI:

Keywords:

Abstract

Author Biographies

References

Downloads

Published

Issue

Section

License