Automated Feedback Improves Teachers’ Questioning Quality in Brick-and-Mortar Classrooms: Opportunities for Further Enhancement

Journal article

Dorottya Demszky, Jing Liu, Heather C. Hill, Shyamoli Sanghi, Ariel Chung
Computers & Education, 2024

DOI: 10.1016/j.compedu.2024.105183

Link<<

Cite

APA Click to copy
Demszky, D., Liu, J., Hill, H. C., Sanghi, S., & Chung, A. (2024). Automated Feedback Improves Teachers’ Questioning Quality in Brick-and-Mortar Classrooms: Opportunities for Further Enhancement. Computers &Amp; Education. https://doi.org/10.1016/j.compedu.2024.105183

Chicago/Turabian Click to copy
Demszky, Dorottya, Jing Liu, Heather C. Hill, Shyamoli Sanghi, and Ariel Chung. “Automated Feedback Improves Teachers’ Questioning Quality in Brick-and-Mortar Classrooms: Opportunities for Further Enhancement.” Computers & Education (2024).

MLA Click to copy
Demszky, Dorottya, et al. “Automated Feedback Improves Teachers’ Questioning Quality in Brick-and-Mortar Classrooms: Opportunities for Further Enhancement.” Computers &Amp; Education, 2024, doi:10.1016/j.compedu.2024.105183.

BibTeX Click to copy

@article{dorottya2024a,
  title = {Automated Feedback Improves Teachers’ Questioning Quality in Brick-and-Mortar Classrooms: Opportunities for Further Enhancement},
  year = {2024},
  journal = {Computers & Education},
  doi = {10.1016/j.compedu.2024.105183},
  author = {Demszky, Dorottya and Liu, Jing and Hill, Heather C. and Sanghi, Shyamoli and Chung, Ariel}
}

Abstract

AI-powered professional learning tools that provide teachers with individualized feedback on their instruction have proven effective at improving instruction and student engagement in virtual learning contexts. Despite the need for consistent, personalized professional learning in K-12 settings, the effectiveness of automated feedback tools in traditional classrooms remains unexplored. We present results from 224 Utah mathematics and science teachers who engaged in a pre-registered randomized controlled trial, conducted in partnership with TeachFX, to assess the impact of automated feedback in K-12 classrooms. This feedback targeted “focusing questions” — questions that probe students’ thinking by pressing for explanations and reflection. We find that teachers opened emails containing the automated feedback about 53-65% of the time, and the feedback increased their use of focusing questions by 20% (p < 0.01) compared to the control group. The feedback did not impact other teaching practices. Qualitative interviews with 13 teachers revealed mixed perceptions of the automated feedback. Some teachers appreciated the reflective insights, while others faced barriers such as skepticism about accuracy, data privacy concerns, and time constraints. Our findings highlight the promises and areas of improvement for implementing effective and teacher-friendly automated professional learning tools in brick-and-mortar classrooms.