Chat-Based Support Alone May Not Be Enough: Comparing Conversational and Embedded LLM Feedback for Mathematical Proof Learning

1. 1Implement a structured proof-review tool to provide embedded feedback on students' written proof attempts
2. 2Use a chatbot for math questions to provide conversational support
3. 3Conduct a staggered-access study to evaluate the effectiveness of the LLM-powered tutoring system
4. 4Analyze the results to identify the impact of earlier access to the system on homework performance

Educators and AI engineers on a team can benefit from understanding the limitations of chat-based support and the potential of embedded LLM feedback for improving student learning outcomes, particularly in subjects like mathematics

💡 Embedded LLM feedback can be more effective than conversational feedback alone for mathematical proof learning

🤖 LLM-powered tutoring system GPTutor shows that chat-based support alone may not be enough for math learning 📝