Assessing the Predictive Nature of Teacher and Student Writing Self-Regulation Discrepancy

Main Article Content

Michael Broda
Eric Ekholm
Sharon Zumbrunn

Abstract


In this study, we examine the extent to which the discrepancy between teacher-reported and student-reported self-regulatory behaviours during writing were associated with students’ end-of-year writing grades after controlling for student writing ability and other demographic characteristics. Results of our study, conducted with a sample of 201 middle grades students enrolled in a large, comprehensive suburban school district in the Mid-Atlantic U.S., suggest a significant and positive relationship between teacher discrepancy and grades, after controlling for writing ability, student self-regulation, gender, race/ethnicity, and SES. This has clear implications for the classroom, as it suggests that even after accounting for student difference in terms of ability background, and demographics, the effort that teachers perceive their students making in the fall are still associated with students’ year-end performance in their class. This represents some of the first frontline evidence of the predictive relationship between self-regulation discrepancy and student achievement in writing.


Article Details

How to Cite
Broda, M., Ekholm, E., & Zumbrunn, S. (2020). Assessing the Predictive Nature of Teacher and Student Writing Self-Regulation Discrepancy. Frontline Learning Research, 8(4), 52–73. https://doi.org/10.14786/flr.v8i4.505
Section
Articles

References

Agresti, A. (2012). Categorical data analysis (3rd Ed.). New York, NY: John Wiley & Sons.

Allison, P. D. (2009). Fixed effects regression models. Thousand Oaks, CA: SAGE.

Auwarter, A. E., & Aruguete, M. S. (2008). Effects of student gender and socioeconomic status on teacher perceptions. The Journal of Educational Research, 101(4), 242-246. https://doi.org/10.3200/JOER.101.4.243-246

Brant, R. (1990). Assessing proportionality in the proportional odds model for ordinal logistic regression. Biometrics, 46, 1171–1178. https://doi.org/10.2307/2532457

Brookhart, S. M., Guskey, T. R., Bowers, A. J., McMillan, J. H. Smith, J.K., Smith, L. F., … & Welsh, M. E. (2016). A century of grading research: Meaning and value in the most common educational measure. Review of Educational Research, 86(4), 803-848. https://doi.org/10.3102%2F0034654316672069

Brophy, J. E. (1983). Research on the self-fulfilling prophecy and teacher expectations. Journal of Educational Psychology, 75(5), 631-661. https://doi.org/10.1037/0022-0663.75.5.631

Bowers, A. J. (2011). What’s in a grade? The multidimensional nature of what teacher-assigned grades assess in high school. Educational Research and Evaluation, 17(3), 141-159. https://doi.org/10.1080/13803611.2011.597112

Casillas, A., Robbins, S., Allen, J., Kuo, Y. L., Hanson, M. A., & Schmeiser, C. (2012). Predicting early academic failure in high school from prior academic achievement, psychosocial characteristics, and behavior. Journal of Educational Psychology, 104(2), 407-420. https://doi.org/10.1037/a0027180

Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Lawrence Erlbaum Associates.

Collie, R. J., Martin, A. J., & Curwood, J. S. (2016). Multidimensional motivation and engagement for writing: Construct validation with a sample of boys. Educational Psychology, 36(4), 771-791. https://doi.org/10.1080/01443410.2015.1093607

de Boer, H., Bosker, R. J., & van der Werf, M. P. (2010). Sustainability of teacher expectation bias effects on long-term student performance. Journal of Educational Psychology, 102(1), 168-179. https://doi.org/10.1037/a0017289

Duckworth, A. L., & Yeager, D. S. (2015). Measurement matters: Assessing personal qualities other than cognitive ability for educational purposes. Educational Researcher, 44(4), 237–251. https://doi.org/10.3102/0013189X15584327

Ekholm, E., Zumbrunn, S., & Conklin, S. (2015). The relation of college student self-efficacy toward writing and writing self-regulation aptitude: Writing feedback perceptions as a mediating variable. Teaching in Higher Education, 20(2), 197-207. https://doi.org/10.1080/13562517.2014.974026

Graham, S. (2018). A writer(s) within community model of writing. In C. Bazerman, V. Berninger, D. Brandt, S. Graham, J. Langer, S. Murphy, P. Matsuda, D. Rowe, & M. Schleppegrell, (Eds.), The lifespan development of writing (pp. 271-325). National Council of English.

Graham, S., & R. Harris, K. (2000). The role of self-regulation and transcription skills in writing and writing development. Educational Psychologist, 35(1), 3-12. https://doi.org/10.1207/S15326985EP3501_2

Graham, S., Harris, K. R., & Mason, L. (2005). Improving the writing performance, knowledge, and self-efficacy of struggling young writers: The effects of self-regulated strategy development. Contemporary Educational Psychology, 30(2), 207-241. https://doi.org/10.1016/j.cedpsych.2004.08.001

Graham, S., Harris, K. R., & Santangelo, T. (2015). Research-based writing practices and the Common Core: Meta-analysis and meta-synthesis. The Elementary School Journal, 115(4), 498-522. https://doi.org/10.1086/681964

Graham, S., McKeown, D., Kiuhara, S., & Harris, K. R. (2012). A meta-analysis of writing instruction for students in the elementary grades. Journal of Educational Psychology, 104(4), 879-896. https://doi.org/10.1037/a0029185

Graham, S., & Perin, D. (2007). A meta-analysis of writing instruction for adolescent students. Journal of Educational Psychology, 99(3), 445-476. https://doi.org/10.1037/0022-0663.99.3.445

Hacker, D. (2018). A metacognitive model of writing: An update from a developmental perspective. Educational Psychologist, 53(4), 220-237. https://doi.org/10.1080/00461520.2018.1480373

Harvey, K. E., Suizzo, M. A., & Jackson, K. M. (2016). Predicting the grades of low-income–ethnic-minority students from teacher-student discrepancies in reported motivation. The Journal of Experimental Education, 84(3), 510-528. https://doi.org/10.1080/00220973.2015.1054332

Hayes, J. R. (2012). Modeling and remodeling writing. Written Communication, 29(3), 369-388. https://doi.org/10.1177/0741088312451260

Hayes, J. R., & Flower, L. S. (1980). Identifying the organization of writing processes. In L. Gregg & E. Steinberg (Eds.), Cognitive processes in writing (pp. 3 –30). Lawrence Erlbaum Associates, Inc.

Hayes, J. R., & Flower, L. S. (1986). Writing research and the writer. American Psychologist, 41(10), 1106-1113. https://doi.org/10.1037/0003-066X.41.10.1106

Hinnant, J. B., O’Brien, M., & Ghazarian, S. R. (2009). The longitudinal relations of teacher expectations to achievement in the early school years. Journal of Educational Psychology, 101(3), 662–670. https://doi.org/10.1037/a0014306

Hox, J. J. (2010). Multilevel analysis: Techniques and applications (2nd ed.). Routledge.

Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118

Jussim, L., Eccles, J., & Madon, S. (1996). Social perception, social stereotypes, and teacher expectations: Accuracy and the quest for the powerful self-fulfilling prophecy. In Advances in experimental social psychology (Vol. 28, pp. 281-388). Academic Press.

Jussim, L., & Harber, K. D. (2005). Teacher expectations and self-fulfilling prophecies: Knowns and unknowns, resolved and unresolved controversies. Personality and Social Psychology Review, 9(2), 131-155. https://doi.org/10.1207/s15327957pspr0902_3

Kline, R. (2016). Principles and practice of structural equation modeling (4th ed.) Guilford Press.

Long, J. & Freese, J. (2014). Regression models for categorical dependent variables using Stata (3rd ed.). Stata Press.

Madon, S., Jussim, L., & Eccles, J. (1997). In search of the powerful self-fulfilling prophecy. Journal of Personality and Social Psychology, 72(4), 791-809. https://doi.org/10.1037/0022-3514.72.4.791

Madon, S., Jussim, L., Keiper, S., Eccles, J., Smith, A., & Palumbo, P. (1998). The accuracy and power of sex, social class, and ethnic stereotypes: A naturalistic study in person perception. Personality and Social Psychology Bulletin, 24(12), 1304-1318. https://doi.org/10.1177/01461672982412005

McDonald, R. P. (1970). The theoretical foundations of principal factor analysis, canonical factor analysis, and alpha factor analysis. British Journal of Mathematical and Statistical Psychology, 23(1), 1-21. https://doi.org/10.1111/j.2044-8317.1970.tb00432.x

McKown, C., & Weinstein, R. S. (2002). Modeling the role of child ethnicity and gender in children's differential response to teacher expectations. Journal of Applied Social Psychology, 32(1), 159-184. https://doi.org/10.1111/j.1559-1816.2002.tb01425.x

McMillan, J. H. (2001). Secondary teachers' classroom assessment and grading practices. Educational Measurement: Issues and Practice, 20(1), 20-32. https://doi.org/10.1111/j.1745-3992.2001.tb00055.x

McNeish, D. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412-433. https://doi.org/10.1037/met0000144

Meece, J. L., Glienke, B. B., & Burg, S. (2006). Gender and motivation. Journal of School Psychology, 44(5), 351-373. https://doi.org/10.1016/j.jsp.2006.04.004

Muthén, L. K., & Muthén, B. O. (1998-2017). Mplus User’s Guide (8th ed.). Los Angeles, CA: Muthén & Muthén.

Pajares, F., Miller, M. D., & Johnson, M. J. (1999). Gender differences in writing self-beliefs of elementary school students. Journal of Educational Psychology, 91(1), 50-61. https://doi.org/10.1037/0022-0663.91.1.50

Pintrich, P. R., & De Groot, E. V. (1990). Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 82(1), 33-40. https://doi.org/10.1037/0022-0663.82.1.33

Rist, R. (1970). Student social class and teacher expectations: The self-fulfilling prophecy in ghetto education. Harvard Educational Review, 40(3), 411-451. https://doi.org/10.17763/haer.40.3.h0m026p670k618q3

Rosenthal, R., & Jacobson, L. (1968). Pygmalion in the classroom. The Urban Review, 3(1), 16-20. https://doi.org/10.1007/BF02322211

Salahu-Din, D., Persky, H., & Miller, J. (2008). The nation’s report card: Writing 2007 (NCES Report No. 2008-468). National Center for Education Statistics.

Santangelo, T., Harris, K. R., & Graham, S. (2016). Self-regulation and writing: An overview and meta-analysis. In C. MacArthur, S. Graham, & J. Fitzgerald (Eds.), Handbook of writing research (Vol. 2, pp. 174– 193). Guilford.

Stotsky, S. (1983). Research on reading/writing relationships: A synthesis and suggested directions. Language Arts, 60(5), 627-642. URL: https:// www.jstor.org/stable/41961512

Tenenbaum, H. R., & Ruck, M. D. (2007). Are teachers' expectations different for racial minority than for European American students? A meta-analysis. Journal of Educational Psychology, 99(2), 253-273. https://doi.org/10.1037/0022-0663.99.2.253

Virginia Department of Education (2015). Virginia standards of learning assessments technical report: 2014-2015 administration cycle. Retrieved from http://www.doe.virginia.gov/testing/test_administration/technical_reports/sol_technical_report_2014-15_administration_cycle.pdf

Willingham, W. W., Pollack, J. M., & Lewis, C. (2002). Grades and test scores: Accounting for observed differences. Journal of Educational Measurement, 39(1), 1-37. https://doi.org/10.1111/j.1745-3984.2002.tb01133.x

Winne, P. H., & Hadwin, A. F. (1998). Studying as self-regulated learning. In Hacker, D. J, Dunlosky, J., & Graesser, A.C. (Eds.), Metacognition in educational theory and practice (pp. 277-304). Routledge.

Woodcock, R., & Johnson, M.B. (1977). The Woodcock-Johnson Psycho-Educational Battery. DLM Teaching Resources.

Wooldridge, J. M. 2016. Introductory econometrics: A modern approach (6th ed.). Cengage.

Zimmerman, B. J. (2008). Investigating self-regulation and motivation: Historical background, methodological developments, and future prospects. American Educational Research Journal, 45(1), 166-183. https://doi.org/10.3102/0002831207312909

Zimmerman, B. J. (2013). Theories of self-regulated learning and academic achievement: An overview and analysis. In B. J. Zimmerman & D. H. Schunk (Eds.), Self-regulated learning and academic achievement: Theory, research, and practice (pp. 10-45). Routledge.

Zimmerman, B.J., & Bandura, A. (1994). Impact of self-regulatory processes on writing course attainment. American Educational Research Journal, 31(4), 845 – 862. https://doi.org/10.3102/00028312031004845

Zimmerman, B., & Riesemberg, R. (1997). Becoming a self-regulated writer: A social cognitive perspective. Contemporary Educational Psychology, 22, 73–101. https://doi.org/10.1006/ceps.1997.0919

Zumbrunn, S. (2014, February). Perceived writing climate as a predictor of student writing self-efficacy and self-regulation. Paper presented at the Writing Research across Borders Conference, Paris, France.

Zumbrunn, S., Marrs, S., & Mewborn, C. (2016). Toward a better understanding of student perceptions of writing feedback: a mixed methods study. Reading and Writing, 29(2), 349-370. https://doi.org/10.1007/s11145-015-9599-3