This is a problem with AI, where it will rework a document from scratch just to fix an issue. I'm using Claude for coding, and I see others running into just this issue. I write code for astronomical instruments, and we have a scientist who is constantly creating new code using Claude Code, and it's clear that all he does is give a prompt and then blindly accept whatever comes out. That includes creating a whole new thing (which was then forced on the team for that instrument) that was 6000+ lines long, and every time he had Claude fix a bug it ended up revising the majority of that code...which meant the actual software engineers who were working on that instrument kept having 6000 line bombs dropped on them that they were told to make work. For those of you who aren't coders, just understand that's a huge workload, especially if you're told to find a minor bug somewhere in the mishmash of code (he didn't prompt it to write actual good, documented code either).Claude takes about 5x longer than almost any other AI. While it does well when working with very large documents, it does not do well at most other things. I'm just referring to the chat prompt, not Code or any kind of agents.
I also found that many times it takes it upon itself to do a ton of tasks that you never asked for...resulting in token usage. A couple days back I was trying to edit a 60-page bylaws document. Just by asking a question, it would redraft the entire document. After about 3 questions, it told me I was at my limit and had to wait 2 hours before I could continue.
Eventually, I helped my office mate to get past the insanity that was giving him a mental block, and he coded up a real solution that fit into the instrument architecture, was 300 lines long, and he used Claude to do it to make the point of how you're actually supposed to use Claude as a coding tool. That hasn't stopped everyone else from continuing to do that...the same scientist just dropped a whole new GUI to automate the instrument onto everyone, and it's apparently the same nightmare again.
For myself, I have been using Claude to debug and find issues, and every time I make sure to tell it to figure the bug out first, explain what to do, and limit its work to where the bug is and not make changes anywhere else. I have also let it make its own choices and decisions to test what it can come up with, but even when I let it go it respects the boundaries I have set up for it. The key really is to put a fence around what you want it to do, give it clear instructions, and if you're having it make changes then make it clear to only change what you're looking at and document what has changed in the document. Do things that way, and it's actually pretty useful and doesn't run wild. This is also generally good coding practice anyways, small changes at a time, so enforcing that on Claude is pretty important if you want to turn out good code.