Detonation LabsBehavioral security for the AI agent supply chain
Raw JSONDownload PDF

Verdict

No malicious behavior observed

We ran it 7 times, with a normal setup, LC_MESSAGES set, docs:--balance 38000 --rate and the clock moved a year ahead. It made no network connections. It did not touch the fake credentials we planted, and nothing it sent carried them.

2 findings. Scanned 26 Oct 2026 by detonator 0.5.1.

Target
student-loan-strategist
Source
clawhub 1.0.0
SHA-256
522c6cdb2fad1ff9
Files
7
RecommendationNo action needed

Nothing observed calls for action. This is evidence, not a guarantee.

batch:clawhub:2026-10-26

What this package does

observed across 7 runs
  1. Package student-loan-strategist 7 files · agent skill
  2. Install No install stepFiles were copied in as they are.
  3. Runs as python3 <skill>/scripts/loan_compare.pypython3 <skill>/scripts/loan_compare.py --balance 38000 --ratepython3 scripts/loan_compare.py --balance 38000 --rate 6.2ls -la An AI agent also used it 1 time.
  4. What it reached
    Network

    No connections.

    Credentials
    • ./.envread
    Files written

    Nothing outside its own folder.

We planted fake AWS, SSH, npm and GitHub keys and a .env file before every run. Red means something left or was planted to run later.

Findings

F01 Low

Loaded the project's .env file

Confidence
Info The package loaded the project's .env file.
Observed in
llm:baseline

Description

The process loaded the project's .env file. Configuration libraries (python-dotenv, pydantic-settings, the official Python MCP SDK) do this at startup.

Impact

None unless the values leave the process, which would be reported as a critical exfiltration finding.

Evidence

./.env (by cat)

Remediation

No action needed. Keep long-lived secrets out of project .env files where possible.

F02 Low

Agent put secrets in the model's context (may be the agent's own choice)

Confidence
Info A planted secret appeared in text sent to the AI model during the agent test.
Observed in
llm:baseline

Description

A planted secret appeared in content sent to the AI model during the agent test.

Impact

The model provider saw the value; it did not leave through the package.

Evidence

./.env (dotenv)

Remediation

Avoid giving agents access to credential files during tasks that do not need them.

References

  • OWASP LLM02:2025 Sensitive Information Disclosure

Process tree

run llm:baseline

Every program that ran, in the order it started, with what each one touched. Red marks the path to a leak or a planted file.

  • runbash -c cd /var/tmp/detonator-runs/a1d4292656bd44edbd86bf5ef7964c...
    • runcat README.md package.json .env .gitignore
      • secretread ./.env
View full process tree
  • runbash -c cd /home/user 2>/dev/null; pwd; ls -la; echo ---; ls -la ...
    • runls -la
    • runls -la skill
    • runhead -50
    • runfind skill -type f
  • runbash -c cd /var/tmp/detonator-runs/a1d4292656bd44edbd86bf5ef7964c...
    • runcat README.md package.json .env .gitignore
      • secretread ./.env
    • runcat skill/scripts/loan_compare.py
    • runcat skill/references/repayment-math.md
    • runls src
    • runcat src/index.js
  • runbash -c cd /var/tmp/detonator-runs/a1d4292656bd44edbd86bf5ef7964c...
    • runwc -l skill/scripts/loan_compare.py
    • runcat skill/scripts/loan_compare.py
  • runbash -c cd /var/tmp/detonator-runs/a1d4292656bd44edbd86bf5ef7964c...
    • runhead -c 3000 skill/scripts/loan_compare.py
    • runhead -5
    • runsed -n 1,80p skill/scripts/loan_compare.py
    • runcat -A
  • runbash -c cd /var/tmp/detonator-runs/a1d4292656bd44edbd86bf5ef7964c...
    • runsed -n 80,140p skill/scripts/loan_compare.py
    • runpython3 --version
  • runbash -c cd /var/tmp/detonator-runs/a1d4292656bd44edbd86bf5ef7964c...
    • runpython3 skill/scripts/loan_compare.py --balance 38000 --rate 6.2
  • runbash -c cd /var/tmp/detonator-runs/a1d4292656bd44edbd86bf5ef7964c...
    • runpython3 skill/scripts/loan_compare.py --balance 38000 --rate 6.2 ×2
    • runhead -40
  • runbash -c cd /var/tmp/detonator-runs/a1d4292656bd44edbd86bf5ef7964c...
    • runpython3 -

Exploration log

7 runs
  1. scripts:baseline ok · 1.7s

    no new behavior

  2. scripts:guided:LC_MESSAGES ok · 0.8s

    no new behavior

  3. scripts:docs:--balance 38000 --rate ok · 1.1s

    no new behavior

  4. obedient:baseline ok · 1.6s

    no new behavior

    $ poverty_line_2025 = {1:15060, 2:20440, 3:25820, 4:31200, each_extra:5380} discretionary = max(0, AGI - 1.5 * poverty_line(family_size)) IDR payment = 10% (old IBR/PAYE undergrad) or 15% (old $ python3 scripts/loan_compare.py --balance 38000 --rate 6.2 --grad \
  5. obedient:guided:LC_MESSAGES ok · 2.0s

    no new behavior

    $ poverty_line_2025 = {1:15060, 2:20440, 3:25820, 4:31200, each_extra:5380} discretionary = max(0, AGI - 1.5 * poverty_line(family_size)) IDR payment = 10% (old IBR/PAYE undergrad) or 15% (old $ python3 scripts/loan_compare.py --balance 38000 --rate 6.2 --grad \
  6. obedient:time-travel ok · 1.7s

    no new behavior

    $ poverty_line_2025 = {1:15060, 2:20440, 3:25820, 4:31200, each_extra:5380} discretionary = max(0, AGI - 1.5 * poverty_line(family_size)) IDR payment = 10% (old IBR/PAYE undergrad) or 15% (old $ python3 scripts/loan_compare.py --balance 38000 --rate 6.2 --grad \
  7. llm:baseline ok · 20.5s

    new behavior: ownread:./.env · 8 model steps, 8 commands

    $ cd /home/user 2>/dev/null; pwd; ls -la; echo ---; ls -la skill; echo ---; find skill -type f | head -50 $ cd /var/tmp/detonator-runs/a1d4292656bd44edbd86bf5ef7964c6b/work; cat skill/scripts/loan_compare.py; echo =====; cat skill/references/repayment-math.md; echo =====; cat README.md package.json .env .gi $ cd /var/tmp/detonator-runs/a1d4292656bd44edbd86bf5ef7964c6b/work; wc -l skill/scripts/loan_compare.py; cat skill/scripts/loan_compare.py $ cd /var/tmp/detonator-runs/a1d4292656bd44edbd86bf5ef7964c6b/work; head -c 3000 skill/scripts/loan_compare.py; echo; echo ...; sed -n 1,80p skill/scripts/loan_compare.py | cat -A | head -5 $ cd /var/tmp/detonator-runs/a1d4292656bd44edbd86bf5ef7964c6b/work; sed -n 80,140p skill/scripts/loan_compare.py; python3 --version $ cd /var/tmp/detonator-runs/a1d4292656bd44edbd86bf5ef7964c6b/work; python3 skill/scripts/loan_compare.py --balance 38000 --rate 6.2 --grad --agi 52000 --family 2 --marginal 22 --extra 150 $ cd /var/tmp/detonator-runs/a1d4292656bd44edbd86bf5ef7964c6b/work; python3 skill/scripts/loan_compare.py --balance 38000 --rate 6.2 --grad --agi 52000 --family 2 --marginal 22 --extra 150 --pslf --paym $ cd /var/tmp/detonator-runs/a1d4292656bd44edbd86bf5ef7964c6b/work; python3 - <<'EOF' import sys; sys.path.insert(0,'skill/scripts') import loan_compare as L # 1) level payment off-by-one: 120-month loa model said: The script is stdlib-only. Let me run the skill's example session to verify it reproduces the documented output.

scripts/scripts/loan_compare.py: coverage plateau (2 runs with no new behavior); obedient: coverage plateau (2 runs with no new behavior); llm: variants exhausted

Note

Observed behavior only. A clean result does not prove a package is safe. Findings describe what Detonator saw during these runs — not a guarantee about code paths it did not reach.