To which specific model does "It" refer? Khanmigo? MagicSchool? ChatGPT 4o? Other? Can you please cite some specific examples?
Fwiw, I've worked in K12 education for almost 20 years. I will absolutely, and cautiously, promote this use case (only as a supplement to human teaching) because I've seen it work. I refuse to make perfect the enemy of the good. An imperfect AI can still help a student make connections to what they learned in class when the teacher is unavailable at 10pm. And AI is only going to get better.
Generative AI is also a great way for teachers to tailor word problems to match the interests of each student, improving engagement. It does that very well. And with Google Gemini now being HIPAA compliant in Workspace for Education, teachers can now safely use tables of student first names and their interests without risking privacy. That helps teachers enhance their classwork without adding tedious labor.
I’m higher level (undergrad mathematics). We generally have to clean up the garbage taught before hand.
I’ve evaluated several models against several use cases including GPT-4.5.
A good one is a simple structured problem: “if I have to get up at 06:30 and need 7 hours and 30 minutes of sleep, then what time do I need to go to bed?”
This tends to produce a variety of hilariously awful approaches to solve the problem from breaking it down into minutes to do the calculation, being unable to understand the concept of a clock, totally and confidently miscalculating the answer and generally picking a suboptimal strategy for solving the problem. Attempts to formalise it even fail.
Handing that over to a student is pedagogically stupid.
As for the imperfection comment, hell no. Are you happy with 30% of what you teach being verifiably wrong? Because that’s what you just told me.
I’m sure I’ll get the defence now that “perhaps I’m asking the wrong question”. That’s part of the teaching. Making sure that what is being asked is understood. Which is no good if you throw a student who doesn’t know at it.
A good one a while ago was someone sent me a transcript for 4o’s proof of De Moivre’s theorem. It looked correct until you actually worked through it. I’d expect a student not to pick up why it was wrong. I’d similarly expect someone who doesn’t care about the inaccuracy to print it verbatim, hand it out as a worksheet and pretend you did a day of work.
Mathematics has rigour. Some other subjects less. That doesn’t mean it’s ok to get away with wrong.