Every report is fully generated by the model. Anthropic says skipping human triage means faster and more frequent scans, but also that some reports could be incorrect or invalid, for example with the wrong severity rating.
How often does that happen? Anthropic had its own expert penetration testers go through 97 serious findings, rated high or critical, that an early build produced across 48 projects. They approved 85 for disclosure. Of the 12 they held back, 11 were genuine bugs that simply repeated a known issue or another finding. Encryption library maker wolfSSL found only two bad reports among the 74 it got while testing the scanner, and five turned into official CVEs (entries in the public list of known vulnerabilities).
The scanner also exists because of a backlog. Of the more than 29,000 candidate vulnerabilities Anthropic’s models found over six months, staff had manually reviewed about 6,000. Many maintainers who got early reports asked for the unreviewed batch too, and nearly 5,000 such reports have already gone out. Those efforts produced 584 security advisories as of October 2, 2026.