Leaderboard github.com
Vincentwei1021/video-talkcraft
Agent skill that turns Claude Code / Codex into a motion-design studio for voiceover-driven explainer videos — word-level voiceover sync, 109 motion recipe cards, an anti-slideshow camera system, Remotion rendering.
unreviewed-ai-risk
AI provenance
99%
explicit
- Confidence
- 86%
- Coverage
- 100%
Estimated share of AI-generated code. Explicit attribution is a lower bound.
Code quality
53/100
weak
- Confidence
- 90%
- Coverage
- 100%
Complexity, duplication, lint density, tests, CI, docs and review process.
Security
71/100
adequate
- Confidence
- 85%
- Coverage
- 100%
Secrets, static analysis, vulnerable dependencies, CI and supply-chain posture.
- Repository: https://github.com/Vincentwei1021/video-talkcraft
- Commit:
501708856fbfdf596e27dba3200e12cf95da57be - Generated: 2026-11-14T00:15:15+00:00
- Scorer 0.1.0, scoring prov-4+qual-2+sec-2, report schema v2
Scores
Unreviewed AI code risk: a large share of this code is explicitly AI-attributed, and its tests or review process are weak while quality or security scores are low.
| Pillar | Score | Signal | Confidence | Coverage |
|---|---|---|---|---|
| AI provenance (estimated AI-generated share) | 99 | explicit | 86% | 100% |
| Code quality | 53 | weak | 90% | 100% |
| Security | 71 | adequate | 85% | 100% |
AI provenance
Explicit AI attribution on 99% of first-party code added; an estimated 99% including velocity signals.
- Explicitly attributed share (lower bound): 98.6%
- Unattributed share in AI-consistent velocity bursts: 0.0%
- Estimated AI-generated share: 98.6%
| AI tool | Attributed commits | Lines added |
|---|---|---|
| Claude Code | 55 | 61,356 |
| OpenAI Codex | 4 | 1,457 |
Current source lines last changed by AI-attributed commits: 58,973 of 59,517.
| Findings per 1,000 lines | AI-attributed | Other | Ratio |
|---|---|---|---|
| Quality | 3.256 | 14.706 | 0.22x |
| Security | 0.254 | 0.0 | n/a |
- Stylometry index: 0.13 per 1,000 lines (narrated steps 0, placeholders 0, assistant phrasing 0, emoji 16). Reported as a signal, not scored.
| Month | Lines added | Attributed to AI |
|---|---|---|
| 2026-08 | 20,652 | 100% |
| 2026-09 | 43,036 | 98% |
Evidence
- Claude Code: trailer 'Co-Authored-By: Claude' (fd7cf593ea67)
- Claude Code: trailer 'Co-Authored-By: Claude' (8b6b7cdab0d8)
- Claude Code: trailer 'Co-Authored-By: Claude' (e18cecff9ef4)
- Claude Code: trailer 'Co-Authored-By: Claude' (b5a6cfdf0062)
- Claude Code: trailer 'Co-Authored-By: Claude' (61cfd09a7722)
- Claude Code: trailer 'Co-Authored-By: Claude' (64b2efd18e00)
- Claude Code: trailer 'Co-Authored-By: Claude' (06a018340911)
- Claude Code: trailer 'Co-Authored-By: Claude' (4192edbdcc07)
- Claude Code: trailer 'Co-Authored-By: Claude' (97bc55b9aaf0)
- Claude Code: trailer 'Co-Authored-By: Claude' (a22ac356deb6)
- Claude Code: trailer 'Co-Authored-By: Claude' (c22291f45358)
- Claude Code: trailer 'Co-Authored-By: Claude' (028f8250e12d)
- Claude Code: trailer 'Co-Authored-By: Claude' (47bb5bcb44ae)
- Claude Code: trailer 'Co-Authored-By: Claude' (91106d77c381)
- Claude Code: trailer 'Co-Authored-By: Claude' (c1012c4f59dc)
AI provenance describes how code was produced; it is not a quality judgment. Unless attribution is explicit, these are signals consistent with AI generation, not proof. Squash/rebase workflows, imported code, and rewritten history reduce accuracy.
Code quality
Code quality is weak: test-to-source ratio 0.02, no CI test run detected; 23% of function code in complex or long functions; 12% duplicated lines. Weakest area: testing.
| Area | Score |
|---|---|
| Complexity (lizard) | 50 |
| Duplication | 48 |
| Code smells (Opengrep) | 58 |
| Tests and CI | 43 |
| Documentation | 65 |
| Type safety | 95 |
| Process (Scorecard review/maintenance) | n/a |
- Functions: 3,303; mean complexity 2.9, 90th percentile 6; 80 complex and 24 long functions
- Duplicated lines: 12.2% of 48,184 compared
- Tests: 1,042 test lines for 59,517 source lines (ratio 0.02); CI test commands: none detected; 17% of recent source commits also change tests
- Docs missing or thin: contributing, changelog
Most complex functions:
- check_semantics in scripts/preflight.py: complexity 104, 182 lines
- main in scripts/workbench_contract_lint.py: complexity 95, 166 lines
- cmd_check in scripts/semantic_annotate.py: complexity 85, 133 lines
- main in scripts/card_match.py: complexity 76, 136 lines
- check_variety in scripts/preflight.py: complexity 65, 96 lines
Security
Security posture is adequate: 11 known vulnerabilities in 4 dependencies; 3 high-severity SAST findings; 4 high-severity workflow issues. Weakest area: posture.
| Area | Score |
|---|---|
| Secrets (gitleaks, tree + history) | 100 |
| Static analysis (Opengrep) | 97 |
| Vulnerable dependencies (OSV) | 64 |
| CI workflows (zizmor) | 44 |
| Posture (policy, updates, signing, lockfiles) | 0 |
| OpenSSF Scorecard | n/a |
-
Known vulnerabilities: 11 in 4 packages (critical 0, high 3, medium 5, low 3)
-
Posture checks passed: none; missing: security policy, dependency updates, signed commits, lockfiles
Top findings
| Severity | Finding | Location |
|---|---|---|
| high | opengrep/javascript.browser.security.insecure-document-method: User controlled data in methods like innerHTML, outerHTML or document.write is an anti-pattern that can lead to XSS vulnerabilities [confidence low] |
demos/_lib/demo-shell.js:155 |
| high | opengrep/javascript.browser.security.insecure-innerhtml: User controlled data in a btn.innerHTML is an anti-pattern that can lead to XSS vulnerabilities [confidence low] |
demos/_lib/demo-shell.js:155 |
| high | opengrep/python.lang.security.audit.dangerous-subprocess-use-audit: Detected subprocess function 'run' without a static string. If this data can be controlled by a malicious actor, it may be an instance of command injection. Audit the use of this call to ensure it is not controllable by an external resource. You may consider using 'shlex.escape()'. [confidence low] |
scripts/freeze_probe.py:48 |
| high | osv/GHSA-68fv-2mgg-jv7q: source-map-js@1.2.1 (npm) is affected by GHSA-68fv-2mgg-jv7q |
runtime/package-lock.json |
| high | osv/GHSA-587h-7wmj-h5pm: vite@6.4.3 (npm) is affected by GHSA-587h-7wmj-h5pm |
runtime/package-lock.json |
| high | osv/GHSA-mrhx-c7xc-m3w5: zod@4.4.3 (npm) is affected by GHSA-mrhx-c7xc-m3w5 |
runtime/package-lock.json |
| high | zizmor/unpinned-uses: unpinned action reference [confidence high] |
.github/workflows/deploy-pages.yml:35 |
| high | zizmor/unpinned-uses: unpinned action reference [confidence high] |
.github/workflows/deploy-pages.yml:37 |
| high | zizmor/unpinned-uses: unpinned action reference [confidence high] |
.github/workflows/deploy-pages.yml:74 |
| high | zizmor/unpinned-uses: unpinned action reference [confidence high] |
.github/workflows/deploy-pages.yml:79 |
| medium | opengrep/javascript.browser.security.wildcard-postmessage-configuration: The target origin of the window.postMessage() API is set to "*". This could allow for information disclosure due to the possibility of any origin allowed to receive the message. [confidence medium] |
demos/_lib/sfx.js:47 |
| medium | opengrep/javascript.lang.security.audit.unsafe-dynamic-method: Using non-static data to retrieve and run functions from the object is dangerous. If the data is user-controlled, it may allow executing arbitrary code. [confidence low] |
demos/_lib/sfx.js:346 |
| medium | opengrep/javascript.lang.security.html-in-template-string: This template literal looks like HTML and has interpolated variables. These variables are not HTML-encoded by default. If the variables contain HTML tags, these may be interpreted by the browser, resulting in cross-site scripting (XSS). [confidence low] |
gallery/build.mjs:70 |
| medium | opengrep/javascript.lang.security.html-in-template-string: This template literal looks like HTML and has interpolated variables. These variables are not HTML-encoded by default. If the variables contain HTML tags, these may be interpreted by the browser, resulting in cross-site scripting (XSS). [confidence low] |
gallery/build.mjs:85 |
| medium | opengrep/javascript.lang.security.html-in-template-string: This template literal looks like HTML and has interpolated variables. These variables are not HTML-encoded by default. If the variables contain HTML tags, these may be interpreted by the browser, resulting in cross-site scripting (XSS). [confidence low] |
gallery/build.mjs:92 |
| medium | opengrep/javascript.lang.security.html-in-template-string: This template literal looks like HTML and has interpolated variables. These variables are not HTML-encoded by default. If the variables contain HTML tags, these may be interpreted by the browser, resulting in cross-site scripting (XSS). [confidence low] |
gallery/build.mjs:176 |
| medium | opengrep/javascript.lang.security.html-in-template-string: This template literal looks like HTML and has interpolated variables. These variables are not HTML-encoded by default. If the variables contain HTML tags, these may be interpreted by the browser, resulting in cross-site scripting (XSS). [confidence low] |
gallery/build.mjs:757 |
| medium | opengrep/python.lang.security.audit.dynamic-urllib-use-detected: Detected a dynamic value being used with urllib. urllib supports 'file://' schemes, so a dynamic value controlled by a malicious actor may allow them to read arbitrary files. Audit uses of urllib calls to ensure user data cannot control the URLs, or consider using the 'requests' library instead. [confidence low] |
scripts/face_bbox.py:34 |
| medium | opengrep/javascript.lang.security.audit.detect-non-literal-regexp: RegExp() called with a id function argument, this might allow an attacker to cause a Regular Expression Denial-of-Service (ReDoS) within your application as RegExP blocks the main thread. For this reason, it is recommended to use hardcoded regexes instead. If your regex is run on user-controlled i [confidence low] |
scripts/pipeline_state.mjs:251 |
| medium | opengrep/javascript.lang.security.audit.detect-non-literal-regexp: RegExp() called with a k function argument, this might allow an attacker to cause a Regular Expression Denial-of-Service (ReDoS) within your application as RegExP blocks the main thread. For this reason, it is recommended to use hardcoded regexes instead. If your regex is run on user-controlled in [confidence low] |
workbench/scripts/gen-index.mjs:121 |
| medium | opengrep/javascript.lang.security.html-in-template-string: This template literal looks like HTML and has interpolated variables. These variables are not HTML-encoded by default. If the variables contain HTML tags, these may be interpreted by the browser, resulting in cross-site scripting (XSS). [confidence low] |
workbench/scripts/gen-index.mjs:182 |
| medium | opengrep/javascript.playwright.security.audit.playwright-goto-injection: If unverified user data can reach the goto method it can result in Server-Side Request Forgery vulnerabilities [confidence low] |
workbench/scripts/screenshots.mjs:40 |
| medium | osv/GHSA-w74x-v6f9-j3xg: fast-uri@3.1.8 (npm) is affected by GHSA-w74x-v6f9-j3xg |
runtime/package-lock.json |
| medium | osv/GHSA-wjr9-j795-jxcr: fast-uri@3.1.8 (npm) is affected by GHSA-wjr9-j795-jxcr |
runtime/package-lock.json |
| medium | osv/GHSA-698v-4r3x-3vcv: vite@6.4.3 (npm) is affected by GHSA-698v-4r3x-3vcv |
runtime/package-lock.json |
Static signals only: the scorer never runs the project's code. Secret findings are pattern matches that were not verified, and secret values are never stored.
Distribution signals
- star-burst: 2312 stars in 83 days (28/day)
Signals consistent with a repository that exists to distribute a download. They are heuristics, not a verdict; release files were not downloaded or inspected.
Repository profile
- Source lines: 59,517; test lines: 1,042
| Language | Lines |
|---|---|
| TypeScript | 50,722 |
| Python | 5,464 |
| JavaScript | 4,197 |
| Shell | 176 |