Leaderboard github.com
mrphrazer/binary-ninja-headless-mcp
Headless Binary Ninja MCP server — giving AI agents deep reverse-engineering capabilities via 180 tools.
AI provenance
0%
explicit
- Confidence
- 74%
- Coverage
- 100%
Estimated share of AI-generated code. Explicit attribution is a lower bound.
Code quality
66/100
adequate
- Confidence
- 90%
- Coverage
- 100%
Complexity, duplication, lint density, tests, CI, docs and review process.
Security
74/100
adequate
- Confidence
- 85%
- Coverage
- 100%
Secrets, static analysis, vulnerable dependencies, CI and supply-chain posture.
- Repository: https://github.com/mrphrazer/binary-ninja-headless-mcp
- Commit:
7fafd7523838fa2627a972869e34815fc461834f - Generated: 2026-11-13T23:56:49+00:00
- Scorer 0.1.0, scoring prov-4+qual-2+sec-2, report schema v2
Scores
| Pillar | Score | Signal | Confidence | Coverage |
|---|---|---|---|---|
| AI provenance (estimated AI-generated share) | 0 | explicit | 74% | 100% |
| Code quality | 66 | adequate | 90% | 100% |
| Security | 74 | adequate | 85% | 100% |
AI provenance
Explicit AI attribution on 0% of first-party code added; an estimated 0% including velocity signals.
- Explicitly attributed share (lower bound): 0.2%
- Unattributed share in AI-consistent velocity bursts: 47.5%
- Estimated AI-generated share: 0.2%
| AI tool | Attributed commits | Lines added |
|---|---|---|
| Claude Code | 3 | 72 |
Current source lines last changed by AI-attributed commits: 0 of 19,449.
Too few lines in one group to compare finding densities.
| Month | Lines added | Attributed to AI |
|---|---|---|
| 2026-03 | 15,370 | 0% |
| 2026-05 | 78 | 92% |
| 2026-08 | 334 | 0% |
| 2026-09 | 14,295 | 0% |
Evidence
- Claude Code: trailer 'Co-Authored-By: Claude' (7756894cdaf0)
- Claude Code: trailer 'Co-Authored-By: Claude' (ce0656d1ae4e)
- Claude Code: trailer 'Co-Authored-By: Claude' (bc0a49f93ec9)
- 10,636 lines of first-party code in ~4.0h (2,659 lines/hour, 1 commit session) (7fafd7523838)
- 3,654 lines of first-party code in ~4.0h (914 lines/hour, 1 commit session) (7494690ed6b6)
AI provenance describes how code was produced; it is not a quality judgment. Unless attribution is explicit, these are signals consistent with AI generation, not proof. Squash/rebase workflows, imported code, and rewritten history reduce accuracy.
Code quality
Code quality is adequate: test-to-source ratio 0.41, CI runs tests; 32% of function code in complex or long functions; 5% duplicated lines. Weakest area: type safety.
| Area | Score |
|---|---|
| Complexity (lizard) | 38 |
| Duplication | 74 |
| Code smells (Opengrep) | 67 |
| Tests and CI | 96 |
| Documentation | 65 |
| Type safety | 0 |
| Process (Scorecard review/maintenance) | n/a |
- Functions: 734; mean complexity 4.5, 90th percentile 9; 26 complex and 18 long functions
- Duplicated lines: 5.1% of 15,718 compared
- Tests: 8,010 test lines for 19,449 source lines (ratio 0.41); CI test commands: pytest; 73% of recent source commits also change tests
- Docs missing or thin: contributing, changelog
Most complex functions:
- _update_state in binary_ninja_headless_mcp/fuzzer.py: complexity 94, 159 lines
- _build_arguments in binary_ninja_headless_mcp/fuzzer.py: complexity 72, 188 lines
- run_reads in binary_ninja_headless_mcp/cli_verify_reads.py: complexity 69, 396 lines
- _value_for_field in binary_ninja_headless_mcp/fuzzer.py: complexity 67, 159 lines
- _workflow_machine_control in binary_ninja_headless_mcp/backend.py: complexity 33, 97 lines
Security
Security posture is adequate: 11 high-severity SAST findings; 2 high-severity workflow issues. Weakest area: posture.
| Area | Score |
|---|---|
| Secrets (gitleaks, tree + history) | 100 |
| Static analysis (Opengrep) | 85 |
| Vulnerable dependencies (OSV) | n/a |
| CI workflows (zizmor) | 63 |
| Posture (policy, updates, signing, lockfiles) | 0 |
| OpenSSF Scorecard | n/a |
- Posture checks passed: lockfiles; missing: security policy, dependency updates, signed commits
Top findings
| Severity | Finding | Location |
|---|---|---|
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit: Detected subprocess function 'run' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external resource. You may consider using 'shlex.escape()'. [confidence low] |
binary_ninja_headless_mcp/cli_verify.py:174 |
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit: Detected subprocess function 'run' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external resource. You may consider using 'shlex.escape()'. [confidence low] |
binary_ninja_headless_mcp/cli_verify.py:343 |
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit: Detected subprocess function 'run' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external resource. You may consider using 'shlex.escape()'. [confidence low] |
binary_ninja_headless_mcp/cli_verify.py:1118 |
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit: Detected subprocess function 'run' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external resource. You may consider using 'shlex.escape()'. [confidence low] |
binary_ninja_headless_mcp/cli_verify.py:1141 |
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit: Detected subprocess function 'run' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external resource. You may consider using 'shlex.escape()'. [confidence low] |
binary_ninja_headless_mcp/cli_verify.py:1430 |
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit: Detected subprocess function 'run' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external resource. You may consider using 'shlex.escape()'. [confidence low] |
binary_ninja_headless_mcp/cli_verify.py:1466 |
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit: Detected subprocess function 'run' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external resource. You may consider using 'shlex.escape()'. [confidence low] |
binary_ninja_headless_mcp/cli_verify_special.py:155 |
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit: Detected subprocess function 'run' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external resource. You may consider using 'shlex.escape()'. [confidence low] |
binary_ninja_headless_mcp/cli_verify_special.py:421 |
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit: Detected subprocess function 'Popen' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external resource. You may consider using 'shlex.escape()'. [confidence low] |
binary_ninja_headless_mcp/cli_verify_worker.py:90 |
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit: Detected subprocess function 'Popen' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external resource. You may consider using 'shlex.escape()'. [confidence low] |
binary_ninja_headless_mcp/lifecycle_fuzzer.py:48 |
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit: Detected subprocess function 'Popen' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external resource. You may consider using 'shlex.escape()'. [confidence low] |
binary_ninja_headless_mcp/managed_cli.py:232 |
| high | zizmor/unpinned-uses: unpinned action reference [confidence high] |
.github/workflows/ci.yml:14 |
| high | zizmor/unpinned-uses: unpinned action reference [confidence high] |
.github/workflows/ci.yml:17 |
| medium | opengrep/python.lang.security.audit.exec-detected: Detected the use of exec(). exec() can be dangerous if used to evaluate dynamic content. If this content can be input from outside the program, this may be a code injection vulnerability. Ensure evaluated content is not definable by external sources. [confidence low] |
binary_ninja_headless_mcp/backend.py:2507 |
| medium | opengrep/python.lang.security.audit.eval-detected: Detected the use of eval(). eval() can be dangerous if used to evaluate dynamic content. If this content can be input from outside the program, this may be a code injection vulnerability. Ensure evaluated content is not definable by external sources. [confidence low] |
binary_ninja_headless_mcp/backend.py:2510 |
| medium | zizmor/artipacked: credential persistence through GitHub Actions artifacts [confidence low] |
.github/workflows/ci.yml:13 |
| medium | zizmor/excessive-permissions: overly broad permissions [confidence medium] |
.github/workflows/ci.yml:8 |
Static signals only: the scorer never runs the project's code. Secret findings are pattern matches that were not verified, and secret values are never stored.
Repository profile
- Source lines: 19,449; test lines: 8,010
| Language | Lines |
|---|---|
| Python | 27,429 |
| C | 30 |