Institutional Approaches to Evaluate Teaching Effectiveness: The Role of Summative Peer Review of Teaching for Promotion and Tenure

Authors

  • Keif Godbout-Kinney Memorial University of Newfoundland
  • Gavan Watson Memorial University of Newfoundland

Keywords:

Student evaluations of teaching, promotion and tenure, summative peer review, Canadian universities, EDI

Abstract

A growing body of literature has identified student evaluations of teaching (SETs) as introducing bias against minority faculty members and not serving as a reliable or valid measure of teaching effectiveness. This lack of reliability and validity presents issues for university tenure and promotion committees, as these institutional processes necessarily require accurate, objective, and holistically informed modes of evaluation to recognize teaching achievements. Summative peer review of teaching (SPRT) is an alternative mode of assessment that aims to provide evidence of teaching effectiveness to inform promotion and tenure. SPRT, as an institutional practice, has been adopted at a small cohort of institutions of higher education, marking a potential shift in practice. This article examines SETs to articulate the problematic elements introduced by SETs, specifically to examine if SPRT can serve as a viable alternative. By describing the SPRT processes that four institutions have taken, the authors aim to articulate these emerging approaches to collecting evidence of teaching effectiveness. In this descriptive work, it is our secondary contention that SPRT, through intentional design and facilitation, can offer a process that does not introduce bias in the same way as SETs and thus, can also be used to satisfy the growing need for practices that help achieve, in part, institutional goals related to equity, diversity, and inclusion (EDI).

Author Biography

Gavan Watson, Memorial University of Newfoundland

Associate vice-president (teaching and learning), director of CITL, and adjunct professor in the Faculty of Education at Memorial University.

References

Bernstein, D., Burnett, A., Goodburn, A., & Savory, P. (2006). Making teaching and learning visible: Course portfolios and the peer review of teaching. Anker Pub. Co. Inc.

Bharuthram, S. (2012). Making a case for the teaching of reading across the curriculum in highereducation. South African Journal of Education, 32(2), 205–214. https://doi.org/10.15700/saje.v32n2a557

Blackmore, J. A. (2005). A critical evaluation of peer review via teaching observation within higher education. The International Journal of Educational Management, 19(2), 218-232.

Burrell, S. L., Donovan, S. K., & Williams, T. P. (Eds.). (2020). Breaking down silos for equity, diversity, and Inclusion (Edi): Teaching and collaboration across disciplines. Rowman & Littlefield.

Canadian Association of University Teachers. (2018, April). Underrepresented & underpaid: Diversity & equity among Canada’s post-secondary education teachers. https://www.caut.ca/sites/default/files/caut_equity_report_2018-04final.pdf

Chism, N. V. (2007). Peer review of teaching: A sourcebook (2nd ed.). Anker Pub. Co. Inc.

Dall’Alba, G. (1994). The role of teaching in higher education: Enabling students to enter a field of study and practice. Learning and Instruction, 3(4), 299–313. https://doi.org/10.1016/0959-4752(93)90021-q

Donnelly, R. (2007). Perceived impact of peer observation of teaching in higher education. http://arrow.dit.ie/cgi/viewcontent.cgi?article=1023&context=ltcart

Frey, L., Botan, C., & Kreps, G. (1999). Investigating communication: An introduction to research methods (2nd ed.). Allyn & Bacon.

Griffen, A. J. (Ed.). (2021). Challenges to integrating diversity, equity, and inclusion programs in organizations. IGI Global.

Hammersley-Fletcher, L., & Orsmond, P. (2004). Evaluating our peers: Is peer observation a meaningful process? Studies in Higher Education, 29(4), 489-503.

Hammersley, M. (1989). The dilemma of qualitative method: Herbert Blumer and the Chicago tradition. Routledge.

Hornstein, H. A. (2017). Student evaluations of teaching are an inadequate assessment tool for evaluating faculty performance. Cogent Education, 4(1), 1304016. https://doi.org/10.1080/2331186x.2017.1304016

Jereb, E., Jerebic, J., & Urh, M. (2018). Revising the importance of factors pertaining to student satisfaction in higher education. Organizacija, 51(4), 271–285. https://doi.org/10.2478/orga-2018-0020

Kreitzer, R. J., & Sweet-Cushman, J. (2021). Evaluating student evaluations of teaching: A review of measurement and equity bias in SETs and recommendations for ethical reform. Journal of Academic Ethics, 20, 73-84. https://doi.org/10.1007/s10805-021-09400-w

Marsh, H. W., & Roche, L. A. (1994). The use of students’ evaluations of university teaching to improve teaching effectiveness. Australian Government Publishing Service.

Murray, H. G. (1983). Low-inference classroom teaching behaviors and student ratings of college teaching effectiveness. Journal of Educational Psychology, 75(1), 138–149. https://doi.org/10.1037/0022-0663.75.1.138

Murray, H. G. (2005). Annual Meeting of the Society for Teaching and Learning in Higher Education. In Student evaluation of teaching: Has it made a difference? (pp. 1–15). St Peter’s Bay: Society for Teaching and Learning in Higher Education.

Napier, J., Riazi, M., & Jacenyik-Trawoger, C. (2014). Leadership: A cultural perspective on review as quality assurance versus quality enhancement. In J. Sachs & M. Parsell (Eds.), Peer review of learning and teaching in higher education: International perspectives (pp. 53-66). Springer.

Noben, I., Deinum, J. F., & Hofman, W. H. (2020). Quality of teaching in higher education: Reviewing teaching behaviour through classroom observations. International Journal for Academic Development, 1–14. https://doi.org/10.1080/1360144x.2020.1830776

Parsell, M. (2011, September 22). The PEER model [Plenary paper]. International Symposium on Leadership and Communication in Peer Review, Macquarie University.

Peterson, D. A., Biederman, L. A., Andersen, D., Ditonto, T. M., & Roe, K. (2019). Mitigating gender bias in student evaluations of teaching. PLOS ONE, 14(5), e0216241.. https://doi.org/10.1371/journal.pone.0216241

Sword. H. (2017). Air & light & time & space: How successful academics write. Harvard University Press.

Texas A&M University. (n.d.). Center for teaching excellence: Home. https://cte.tamu.edu/

University of Alberta. (n.d.). Centre for teaching and learning. https://www.ualberta.ca/centrefor-teaching-and-learning/index.html

University of British Columbia. (n.d.). Centre for teaching, learning and technology. http://ctlt.ubc.ca/

University of Toronto. (n.d.). Centre for teaching support & innovation. https://teaching.utoronto.ca/

UNSW. (n.d.). Summative peer review of teaching. https://www.teaching.unsw.edu.au/summative-peer-review

Uttl, B., White, C. A., & Gonzalez, D. W. (2017). Meta-analysis of faculty’s teaching effectiveness: Student evaluation of teaching ratings and student learning are not related. Studies in Educational Evaluation, 54, 22–42. https://doi.org/10.1016/j.stueduc.2016.08.007

Wood, M., & Su, F. (2017). What makes an excellent lecturer? Academics’ perspectives on the discourse of ‘teaching excellence’ in higher education. Teaching in Higher Education, 22(4), 451–466. https://doi.org/10.1080/13562517.2017.1301911

Downloads

Published

2022-12-21

Issue

Section

Articles