People are looking at this like it's something that it's not.
There a couple of well-studied types of patterns that lead into vulnerabilities ("use after free", "out of bounds read/write" for example)
What these LLMs do is to focus on those patterns.