Lachesis blind CVE rediscovery benchmark
Lachesis found 12 of 14 known vulnerabilities without being told the bug class, vulnerable file, or source location.
The only public blind CVE rediscovery benchmark of its kind. Hits, misses, and closed coverage gaps remain on the same board.
Read the methodologyCurrent rate counts closed coverage gaps as hits. First-pass performance remains visible below.
Disclosed CVEs across C, Python, JavaScript, and TypeScript whose vulnerable revision is buildable and whose bug class falls within the reader's modeled sink taxonomy.
The tool is never told the bug, its family, or its location.
Enumeration runs over the entire candidate taxonomy, every family.
A HIT requires the enumerator to surface, unprompted, a candidate whose file:line falls in the CVE's fixed region.
The reader is open-source; per-case candidate output is publishable and re-runnable.
Breakdowns use the same certified cases as the headline rate.
0 coverage gaps have closed without erasing the original miss.
Patched-revision control arm not yet run.
For cases with a patched-revision arm: the sink should disappear or drop sharply once patched.Hits link to their evidence path. Misses remain visible with the recorded reason they were not found.
| CVE | Project | Language | Class | Verdict | Coverage | Witnessed sink | Details |
|---|---|---|---|---|---|---|---|
| CVE-2024-23334 | aiohttp | python | Path traversal (CWE-22) | HIT | Detected first pass | aiohttp/web_urldispatcher.py:659 | |
component scopeCWE-22 · Path traversalOriginal advisory Sink familyfilesystem.path.containment Locationaiohttp/web_urldispatcher.py:659 Score0.7375 Guardnone-observed | |||||||
| CVE-2025-59681 | django | python | SQL injection via column alias (# inline-comment on MySQL/MariaDB) | HIT | Detected first pass | django/db/models/query.py:1187 | |
component scopeCWE-89 · SQL injection via column aliasOriginal advisory Sink familyinjection.query.escaping Locationdjango/db/models/query.py:1187 Guardnone-observed | |||||||
| CVE-2025-59682 | django | python | Partial directory traversal in archive.extract() (startswith prefix check) | HIT | Detected first pass | django/utils/archive.py:231 | |
component scopeCWE-22 · Partial directory traversal in archive.extractOriginal advisory Sink familyfilesystem.path.containment Locationdjango/utils/archive.py:231 Score0.7375 Guardnone-observed | |||||||
| CVE-2025-64340 | fastmcp | python | OS command injection via server name in subprocess-backed install commands (CWE-78) | HIT | Detected first pass | src/fastmcp/cli/install/claude_code.py:141 | |
component scopeCWE-78 · OS command injection via server name in subprocess-backed inOriginal advisory Sink familyinjection.exec.escaping Locationsrc/fastmcp/cli/install/claude_code.py:141 Score0.8125 Guardnone-observed | |||||||
| CVE-2025-64718 | js-yaml | javascript | js-yaml: the merge key that reached the prototype | HIT | Detected first pass | lib/loader.js:301 | |
component scopeCWE-1321 · prototype pollutionOriginal advisory Sink familyobject-integrity.prototype Locationlib/loader.js:301 Guardnone-observed | |||||||
| CVE-2025-68664 | langchain-core | python | Unsafe deserialization: attacker-crafted JSON -> load()/loads() Reviver revives a {"lc":1,"type":"constructor"} node -> importlib.import_module on the deserialized namespace + reflective cls(**kwargs) instantiation, gated only by a namespace allowlist (CWE-502 -> CWE-94/95) | HIT | Detected first pass | libs/core/langchain_core/load/load.py:169 | |
component scopeCWE-502 → CWE-94 → CWE-95 · Unsafe deserializationOriginal advisory Sink familyinjection.exec.escaping Locationlibs/core/langchain_core/load/load.py:169 Score0.625 Guardnone-observed | |||||||
| CVE-2025-24928 | libxml2 | c | Stack buffer overflow via cumulative strcat with stale length check | HIT | Detected first pass | valid.c:5024 | |
component scopeCWE-787 → CWE-121 · Stack buffer overflow via cumulative strcat with stale lengtOriginal advisory Sink familymemory.copy.capacity Locationvalid.c:5024 Score0.92 Guardnone-observed | |||||||
| CVE-2025-6021 | libxml2 | c | xmlBuildQName: the length math that wrapped | HIT | Detected first pass | tree.c:195 | |
component scopeCWE-190 → CWE-787 → CWE-122 · integer overflow → heap/stack buffer overflowOriginal advisory Sink familymemory.copy.capacity Locationtree.c:195 Guardnone-observed | |||||||
Coverage gaps stay public when they open and after they close.
MISS (sink SHAPE not modeled -- the catalogued ReDoS sink is tainted-pattern-into-RegExp; this CVE is a STATIC catastrophic regex literal with an attacker-controlled SUBJECT string via String.match, which has no enumerable constructor)
MISS (sink SHAPE not modeled -- the CVE sink is a DOM property-write `element.innerHTML = html`; the XSS catalogue models only method-call sinks, so the property-assignment sink has no enumerable constructor)
No closed gaps are recorded in this artifact.