devtooligan/jevscan-evm
unreviewed-ai-risk
- Repository: https://github.com/devtooligan/jevscan-evm
- Commit:
2ecbe7cd93a92adb4464821d3ca7b0828c0c1b3c - Generated: 2026-11-13T23:58:47+00:00
- Scorer 0.1.0, scoring prov-4+qual-2+sec-2, report schema v2
Scores
Unreviewed AI code risk: a large share of this code is explicitly AI-attributed, and its tests or review process are weak while quality or security scores are low.
| Pillar | Score | Signal | Confidence | Coverage |
|---|---|---|---|---|
| AI provenance (estimated AI-generated share) | 100 | explicit | 73% | 100% |
| Code quality | 48 | poor | 90% | 100% |
| Security | 81 | adequate | 85% | 100% |
AI provenance
Explicit AI attribution on 100% of first-party code added; an estimated 100% including velocity signals.
- Explicitly attributed share (lower bound): 100.0%
- Unattributed share in AI-consistent velocity bursts: 0.0%
- Estimated AI-generated share: 100.0%
| AI tool | Attributed commits | Lines added |
|---|---|---|
| Claude Code | 14 | 2,333 |
Current source lines last changed by AI-attributed commits: 2,170 of 2,170.
Too few lines in one group to compare finding densities.
- Stylometry index: 1.38 per 1,000 lines (narrated steps 0, placeholders 0, assistant phrasing 0, emoji 6). Reported as a signal, not scored.
| Month | Lines added | Attributed to AI |
|---|---|---|
| 2026-09 | 2,333 | 100% |
Evidence
- Claude Code: trailer 'Co-Authored-By: Claude' (49da6ae7fadc)
- Claude Code: trailer 'Co-Authored-By: Claude' (2322693d312a)
- Claude Code: trailer 'Co-Authored-By: Claude' (af639c081993)
- Claude Code: trailer 'Co-Authored-By: Claude' (c391febbb808)
- Claude Code: trailer 'Co-Authored-By: Claude' (f848b50d73aa)
- Claude Code: trailer 'Co-Authored-By: Claude' (e00b1f706753)
- Claude Code: trailer 'Co-Authored-By: Claude' (0dce0c2192d8)
- Claude Code: trailer 'Co-Authored-By: Claude' (2fdc3029c263)
- Claude Code: trailer 'Co-Authored-By: Claude' (2a16606df7db)
- Claude Code: trailer 'Co-Authored-By: Claude' (0dadf29c9b74)
- Claude Code: trailer 'Co-Authored-By: Claude' (04785d1753a6)
- Claude Code: trailer 'Co-Authored-By: Claude' (f22e234f4bb8)
- Claude Code: trailer 'Co-Authored-By: Claude' (b98a73855c82)
- Claude Code: trailer 'Co-Authored-By: Claude' (ad0d26e0cd15)
AI provenance describes how code was produced; it is not a quality judgment. Unless attribution is explicit, these are signals consistent with AI generation, not proof. Squash/rebase workflows, imported code, and rewritten history reduce accuracy.
Code quality
Code quality is poor: test-to-source ratio 0.07, no CI test run detected; 27% of function code in complex or long functions; 0% duplicated lines. Weakest area: lint.
| Area | Score |
|---|---|
| Complexity (lizard) | 45 |
| Duplication | 100 |
| Code smells (Opengrep) | 14 |
| Tests and CI | 34 |
| Documentation | 65 |
| Type safety | 40 |
| Process (Scorecard review/maintenance) | n/a |
- Functions: 132; mean complexity 6.2, 90th percentile 14; 12 complex and 0 long functions
- Duplicated lines: 0.0% of 1,719 compared
- Tests: 150 test lines for 2,170 source lines (ratio 0.07); CI test commands: none detected; 100% of recent source commits also change tests
- Docs missing or thin: contributing, changelog
Most complex functions:
- render_report in report.py: complexity 31, 65 lines
- run in jevscan.py: complexity 27, 69 lines
- recall_table in bench/run_bench.py: complexity 23, 26 lines
- build_heatmap in report.py: complexity 21, 27 lines
- sync in sources/sync.py: complexity 21, 32 lines
Security
Security posture is adequate: 1 high-severity SAST findings. Weakest area: posture.
| Area | Score |
|---|---|
| Secrets (gitleaks, tree + history) | 100 |
| Static analysis (Opengrep) | 89 |
| Vulnerable dependencies (OSV) | n/a |
| CI workflows (zizmor) | n/a |
| Posture (policy, updates, signing, lockfiles) | 20 |
| OpenSSF Scorecard | n/a |
- Posture checks passed: signed commits, lockfiles; missing: security policy, dependency updates
Top findings
| Severity | Finding | Location |
|---|---|---|
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit: Detected subprocess function 'run' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external resource. You may consider using 'shlex.escape()'. [confidence low] |
bench/run_bench.py:71 |
Static signals only: the scorer never runs the project's code. Secret findings are pattern matches that were not verified, and secret values are never stored.
Repository profile
- Source lines: 2,170; test lines: 150
| Language | Lines |
|---|---|
| Python | 2,320 |