Identifying keys to success in innovative teaching: Student engagement and instructional practices as predictors of student learning in a course using a team-based learning approach
DOI:
https://doi.org/10.20343/teachlearninqu.5.2.10Keywords:
Student Engagement, Student Learning, Team-Based Learning, General Chemistry, Predictors of Learning OutcomesAbstract
When implementing innovative teaching techniques, instructors often seek to gauge the success of their methods. Proposing one approach to assessing classroom innovation, this study examines the ability of students’ ratings of engagement and instructional practices to predict their learning in a cooperative (team-based) framework. After identifying the factor structures underlying measures of student engagement and instructional practices, these factors were used as predictors of self-reported student learning in a general chemistry course delivered using a team-based learning approach. Exploratory factor analyses showed a four-factor structure of engagement: teamwork involvement, investment in the learning process, feelings about team-based learning, level of academic challenge; and a three-factor structure of instructional practices: instructional guidance, fostering self-directed learning skills, and cognitive level. Multiple linear regression revealed that feelings about team-based learning and perceptions of instructional guidance had significant effects on learning, beyond other predictors, while controlling gender, GPA, class level, number of credit hours, whether students began college at their current institution, expected highest level of education, racial or ethnic identification, and parental level of education. These results yield insight into student perceptions about team-based learning, and how to measure learning in a team-based learning framework, with implications for how to evaluate innovative instructional methods.
Metrics
References
Abrams, H. G., & Jernigan, L. P. (1984). Academic support services and the success of high-risk college students. American Educational Research Journal, 21(2), 261-274.
ACT. (2002). Mathematics and science achievement and course-taking for college-bound high school students. Retrieved from https://forms.act.org/research/researchers/briefs/2002-2.html
Anaya, G. (1999). College impact on student learning: Comparing the use of self-reported gains, standardized test scores, and college grades. Research in Higher Education, 40(5), 499-526.
Artino, A.R. (2007). Self-regulated learning in online education: A review of the empirical literature. International Journal of Instructional Technology and Distance Learning 4(16). 3-18.
Astin, A. W. (1984). Student involvement: A developmental theory for higher education. Journal of College Student Development, 40, 518-529.
Astin, A. W. (1993). What matters in college?: Four critical years revisited (Vol. 1). San Francisco, CA: Jossey-Bass.
Bandura, A. (1994). Self-efficacy. In R. J. Corsini (Ed.), Encyclopedia of psychology (2nd ed., Vol 3, pp. 368-369). New
York: Wiley.
Bean, J. (2005). A conceptual model of college student engagement. Paper presented at the Annual Meeting of the Association for the Study of Higher Education, Philadelphia, PA.
Beatty, S. J., Kelley, K. A., Metzger, A. H., Bellebaum, K. L., & McAuley, J. W. (2009). Team-based learning in therapeutics workshop sessions. American Journal of Pharmaceutical Education, 73(6), 1-7
Best, R. M., Rowe, M., Ozuru, Y., & McNamara, D. S. (2005). Deep-level comprehension of science texts: The role of the reader and the text. Topics in Language Disorders, 25(1), 65-83.
Cabrera, A. F., Colbeck, C. L., & Terenzini, P. T. (2001). Developing performance indicators for assessing classroom teaching practices and student learning. Research in Higher Education, 42(3), 327-352.
Chickering, A. W., & Gamson, Z. F. (1987). Seven principles for good practice in undergraduate education. AAHE bulletin, 3-7.
Clark, M. C., Nguyen, H. T., Bray, C., & Levine, R. E. (2008). Team-based learning in an undergraduate nursing course. Journal of Nursing Education, 47(3), 111-117.
Clair, K. S., & Chihara, L. (2012). Team-based learning in a statistical literary class. Journal of Statistics Education, 20(1), 1-20.
Dana, S. W. (2007). Implementing team-based learning in an introduction to law course. Journal of Legal Studies Education, 24(1), 59.
Dorman, C. F., Elith, J., Bacher, S. Buchmann, C., Carl, G., Carre, G. & Munkemuller, T. (2013). Collinearity: A review of methods to deal with it and a simulation study evaluating their performance.
Ecography, 36(1), 27-46.
Drummond, C. K. (2012). Team-based learning to enhance critical thinking skills in entrepreneurship education. Journal of Entrepreneurship Education, 15, 57-60.
Fassinger, P.A. (1995). Understanding classroom interaction: Students’ and professors’ contributions to students’ silence. The Journal of Higher Education, 82-96.
Field, A. (2009). Discovering statistics using SPSS. Thousand Oaks, CA: Sage publications.
Fink, L. D. (2002). Beyond small groups: Harnessing the extraordinary power of learning teams. In Michaelsen, L.K., Knight, A. B., & Fink, L. D. (Eds.), Team-based learning: A transformative use of small groups (pp. 3-26). Westport, CT: Greenwood publishing group.
Fink, L. D. (2007). The power of course redesign to increase student engagement and learning. Peer Review, 9(1),
-17.
Friday, E., Friday-Stroud, S. S., Green, A. L., & Hill, A. Y. (2006). A multi-semester comparison of student performance between multiple traditional and online sections of two management courses. Journal of Behavioral and Applied Management, 8(1), 66-81.
Grant-Vallone, E. (2011). Successful group work: Using cooperative learning and team-based learning in the classroom. Journal on Excellence in College Teaching, 21(4), 99-121.
Guthrie, J. T., Anderson, E., Alao, S., & Rinehart, J. (1999). Influences of concept-oriented reading instruction on strategy use and conceptual learning from text. The Elementary School Journal, 99(4), 343-366.
Haidet, P., & Facile, M. L. (2006). Team-based learning: A promising strategy to foster active learning in cancer education. Journal of Cancer Education, 21(3), 125-128.
Haidet, P., Morgan, R. O., O’Malley, K., Moran, B.J., & Richards, B. F. (2004). A controlled trial of active versus passive learning strategies in a large group setting. Advances in Health Sciences Education, 9(1), 15-27.
Hadwin, A. F., Järvelä, S., & Miller, M. (2011). Self-regulated, co-regulated, and socially shared regulation of learning. Handbook of Self-Regulation of Learning and Performance, 30, 65-84.
Hutcheson, G. D., & Sofroniou, N. (1999). The multivariate social scientist: Introductory statistics using generalized linear models. Thousand Oaks, CA: Sage.
Jacobson, T. E. (2011). Team-based learning in an information literacy course. Communications in Information Literacy, 5(2), 82-101.
Johnson, D. W., & Johnson, R. (1985). Classroom conflict: Controversy versus debate in learning groups. American Educational Research Journal, 22(2), 237-256.
Johnson, D. W., Johnson, R., & Smith, K. A. (2014). Cooperative learning: Improving University instruction by basing practice on validated theory. Journal on Excellence in College Teaching, 25(3&4), 85-118.
Johnson, D. W., Maruyama, G., Johnson, R., Nelson, D., & Skon, L. (1981). Effects of cooperative, competitive, and individualistic goal structures on achievement: A meta-analysis. Psychological Bulletin, 89(1), 47-62.
Kitsantas, A., Zimmerman, B. J., & Cleary, T. (2000). The role of observation and emulation in the development of athletic self-regulation. Journal of Educational Psychology, 92(4), 811-8-817.
Knabb, M. T. (2000). Discovering teamwork: A novel cooperative learning activity to encourage group interdependence. The American Biology Teacher, 62(3), 211-213.
Koles, P. G., Stolfi, A., Borges, N. J., Nelson, S., & Parmelee, D. X. (2010). The impact of team-based learning on medical students’ academic performance. Academic Medicine, 85(11), 1739-1745.
Kuh, G. D., Cruce, T. M., Shoup, R., Kinzie, J., & Gonyea, R. M.
(2008). Unmasking the effects of student engagement on first-year college grades and persistence. The Journal of Higher Education, 79(5), 540-563.
Meyers, L. S., Gamst, G., & Guarino, A. J. (2006). Applied multivariate research: Design and interpretation. Thousand Oaks, CA: Sage.
Michaelsen, L. K., Knight, A. B., & Fink, L. D. (Eds.). (2002). Team-based learning: A transformative use of small groups. Westport, CT: Greenwood publishing group.
National Survey of Student Engagement. 2012. Retrieved from http://nsse.indiana.edu/html/
Nunn, C. E. (1996). Discussion in the college classroom: Triangulating observational and survey results. The Journal of Higher Education, 67(3), 243-266.
Oakes, J. (1990). Opportunities, achievement, and choice: Women and minority students in science and mathematics. Review of Research in Education, 16(1), 153-222.
O’Connor, B. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavior Research Methods, Instruments, & Computers, 32(3), 369-402.
Osborne, J. W., & Costello, A. (2009). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Pan-Pacific Management Review, 12(2), 131-146.
Parmelee, D. X., DeStephen, D., & Borges, N. J. (2009). Medical students’ attitudes about team-based learning in a pre-clinical curriculum. Medical Education Online, 14, 1.
Parmelee, D. X., & Michaelsen, L. K. (2010). Twelve tips for doing effective team-based learning (TBL). Medical Teacher, 32(2), 118-122.
Pascarella, E. T., & Terenzini, P. T. (2005). How college affects students: A third decade of research (Vol. 2). San Francisco, CA: Jossey-Bass.
Paterson, J., & Sneddon, J. (2011). Conversations about curriculum change: Mathematical thinking and teambased learning in a discrete mathematics course. International Journal of Mathematical Education in Science and Technology, 42(7), 879-889.
Pekrun, R. (2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18(4), 315-341.
Pekrun, R., & Perry, R. (2014). Control-value theory of achievement emotions. International Handbook of Emotions in Education, 120-141.
Pett, M. A., Lackey, N. R., & Sullivan, J. J. (2003). Making sense of factor analysis: The use of factor analysis for instrument development in health care research. Thousand Oaks, CA: Sage.
Pike, G. R. (2011). Using college students' self-reported learning outcomes in scholarly research. New Directions for Institutional Research, 2011(150), 41-58.
Pintrich, P. R., & De Groot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82(1), 33-40.
Prince, M. (2004). Does active learning work? A review of the research. Journal of engineering education, 93(3), 223-231.
Rassuli, A., & Manzer, J. P. (2005). “Teach us to learn”: Multivariate analysis of perception of success in team learning. Journal of Education for Business, 81(1), 21-27.
Rotter, J. B. (1966). Generalized expectancies for internal versus external control of reinforcement. Psychological Monographs: General and Applied, 80(1), 1-28.
Schreiner, L. A., & Louis, M. C. (2011). The engaged learning index: Implications for faculty development. Journal on Excellence in College Teaching, 22(1), 5-28.
Skinner, E. A., & Belmont, M. J. (1993). Motivation in the classroom: Reciprocal effects of teacher behavior and student engagement across the school year. Journal of Educational Psychology, 85(4), 571-581.
Smith, K., Johnson, D. W., & Johnson, R. T. (1981). Can conflict be constructive? Controversy versus concurrence seeking in learning groups. Journal of Educational Psychology, 73(5), 651-663.
Springer, L., Stanne, M. E., & Donovan, S. S. (1999). Effects of small-group learning on undergraduates in science, mathematics, engineering, and technology: A meta-analysis. Review of Educational Research, 69(1), 21-51.
Stevens, J. P. (2012). Applied multivariate statistics for the social sciences. New York, NY: Routledge.
Svanum, S., & Bigatti, S. M. (2009). Academic course engagement during one semester forecasts college success: Engaged students are more likely to earn a degree, do it faster, and do it better. Journal of College Student Development, 50(1), 120-132.
Thomas, M. D., & McPherson, B. J. (2011). Teaching positive psychology using team-based learning. The Journal of Positive Psychology, 6(6), 487-491.
Thomas, T. (2012). Adapting team-based learning to the interpersonal communication class. International Journal of Pedagogies and Learning, 7(1), 51-61.
Thompson, B. M., Schneider, V. F., Haidet, P., Perkowski, L. C., & Richards, B. F. (2007). Factors influencing implementation of team-based learning in health sciences education. Academic Medicine, 82(10), S53-S56.
Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory Into Practice, 41(2), 64-70.
Zwaan, R. A., & Singer, M. (2003). Text comprehension. In Graesser, A. C., Gernsbacher, M. A., and Goldman, S. R. (Eds.). Handbook of discourse processes (Vol 3, pp. 83-121). New Jersey: Lawrence Erlbaum Associates, Inc.
