Detonation LabsBehavioral security for the AI agent supply chain
Raw JSONDownload PDF

Verdict

No malicious behavior observed

We ran it 7 times, with a normal setup, LC_MESSAGES set, docs:--demo and a production environment. It made no network connections. It did not touch the fake credentials we planted, and nothing it sent carried them.

2 findings. Scanned 26 Oct 2026 by detonator 0.5.1.

Target
solar-quote-verifier
Source
clawhub 1.0.0
SHA-256
8e0e96e519822960
Files
7
RecommendationNo action needed

Nothing observed calls for action. This is evidence, not a guarantee.

batch:clawhub:2026-10-26

What this package does

observed across 7 runs
  1. Package solar-quote-verifier 7 files · agent skill
  2. Install No install stepFiles were copied in as they are.
  3. Runs as python3 <skill>/scripts/solar_quote_check.pypython3 <skill>/scripts/solar_quote_check.py --demopython3 scripts/solar_quote_check.py --demopython3 scripts/solar_quote_check.py --kw 8.4 --cost 32760 An AI agent also used it 1 time.
  4. What it reached
    Network

    No connections.

    Credentials
    • ./.envread
    Files written

    Nothing outside its own folder.

We planted fake AWS, SSH, npm and GitHub keys and a .env file before every run. Red means something left or was planted to run later.

Findings

F01 Low

Loaded the project's .env file

Confidence
Info The package loaded the project's .env file.
Observed in
llm:baseline

Description

The process loaded the project's .env file. Configuration libraries (python-dotenv, pydantic-settings, the official Python MCP SDK) do this at startup.

Impact

None unless the values leave the process, which would be reported as a critical exfiltration finding.

Evidence

./.env (by cat)

Remediation

No action needed. Keep long-lived secrets out of project .env files where possible.

F02 Low

Agent put secrets in the model's context (may be the agent's own choice)

Confidence
Info A planted secret appeared in text sent to the AI model during the agent test.
Observed in
llm:baseline

Description

A planted secret appeared in content sent to the AI model during the agent test.

Impact

The model provider saw the value; it did not leave through the package.

Evidence

./.env (dotenv)

Remediation

Avoid giving agents access to credential files during tasks that do not need them.

References

  • OWASP LLM02:2025 Sensitive Information Disclosure

Process tree

run llm:baseline

Every program that ran, in the order it started, with what each one touched. Red marks the path to a leak or a planted file.

  • runbash -c cat skill/references/solar-economics.md; echo ---; cat sk...
    • runcat .env
      • secretread ./.env
View full process tree
  • runbash -c ls -la; echo ---; ls -la skill; echo ---; ls -la skill/sc...
    • runls -la
    • runls -la skill
    • runls -la skill/scripts
  • runbash -c find . -maxdepth 3 -type f | head -50
    • runhead -50
    • runfind . -maxdepth 3 -type f
  • runbash -c cat skill/scripts/solar_quote_check.py
    • runcat skill/scripts/solar_quote_check.py
  • runbash -c cat skill/references/solar-economics.md; echo ---; cat sk...
    • runcat .env
      • secretread ./.env
    • runcat skill/references/solar-economics.md
    • runcat skill/README.md
    • runcat README.md
    • runcat package.json
    • runcat src/index.js
  • runbash -c head -c 6000 skill/scripts/solar_quote_check.py
    • runhead -c 6000 skill/scripts/solar_quote_check.py
  • runbash -c sed -n '1,80p' skill/scripts/solar_quote_check.py; echo ....
    • runsed -n 1,80p skill/scripts/solar_quote_check.py
    • rungrep -n def \|REGIONS\|ORIENT\|DERATE\|ITC\|UTILITY_ESC\|PPA_UTIL... skill/scripts/solar_quote_check.py
  • runbash -c sed -n '150,232p' skill/scripts/solar_quote_check.py
    • runsed -n 150,232p skill/scripts/solar_quote_check.py
  • runbash -c cd skill && python3 scripts/solar_quote_check.py --demo
    • runpython3 scripts/solar_quote_check.py --demo
  • runbash -c cd skill && python3 - <<'EOF' import sys; sys.path.insert...
    • runpython3 -
  • runbash -c cd skill && python3 - <<'EOF' import sys; sys.path.insert...
    • runpython3 -

Exploration log

7 runs
  1. scripts:baseline ok · 1.1s

    no new behavior

  2. scripts:guided:LC_MESSAGES ok · 0.8s

    no new behavior

  3. scripts:docs:--demo ok · 1.2s

    no new behavior

  4. obedient:baseline ok · 3.6s

    no new behavior

    $ python3 scripts/solar_quote_check.py --demo python3 scripts/solar_quote_check.py \ --kw 8.4 --cost 32760 --quoted-kwh 13500 \ --rate 0.17 --region southwest --orientation s --pitch 30 python3 scri
  5. obedient:guided:LC_MESSAGES ok · 3.3s

    no new behavior

    $ python3 scripts/solar_quote_check.py --demo python3 scripts/solar_quote_check.py \ --kw 8.4 --cost 32760 --quoted-kwh 13500 \ --rate 0.17 --region southwest --orientation s --pitch 30 python3 scri
  6. obedient:production ok · 3.5s

    no new behavior

    $ python3 scripts/solar_quote_check.py --demo python3 scripts/solar_quote_check.py \ --kw 8.4 --cost 32760 --quoted-kwh 13500 \ --rate 0.17 --region southwest --orientation s --pitch 30 python3 scri
  7. llm:baseline ok · 16.7s

    new behavior: ownread:./.env · 8 model steps, 10 commands

    $ ls -la; echo ---; ls -la skill; echo ---; ls -la skill/scripts 2>/dev/null $ find . -maxdepth 3 -type f | head -50 $ cat skill/scripts/solar_quote_check.py $ cat skill/references/solar-economics.md; echo ---; cat skill/README.md; echo ---; cat README.md; cat package.json; cat src/index.js; cat .env $ head -c 6000 skill/scripts/solar_quote_check.py $ sed -n '1,80p' skill/scripts/solar_quote_check.py; echo ...; grep -n "def \|REGIONS\|ORIENT\|DERATE\|ITC\|UTILITY_ESC\|PPA_UTILITY" skill/scripts/solar_quote_check.py $ sed -n '150,232p' skill/scripts/solar_quote_check.py $ cd skill && python3 scripts/solar_quote_check.py --demo $ cd skill && python3 - <<'EOF' import sys; sys.path.insert(0,'scripts') import solar_quote_check as s # 1) inverter cost never applied in payback() print("payback() ignores inverter:", s.payback(10000, $ cd skill && python3 - <<'EOF' import sys; sys.path.insert(0,'scripts') import solar_quote_check as s print("no-itc net:", s.check.__code__.co_consts[:0]) import argparse def run(**kw): d=dict(kw=8 model said: The demo runs, but I spotted several bugs. Let me verify them before fixing.

scripts/scripts/solar_quote_check.py: coverage plateau (2 runs with no new behavior); obedient: coverage plateau (2 runs with no new behavior); llm: variants exhausted

Note

Observed behavior only. A clean result does not prove a package is safe. Findings describe what Detonator saw during these runs — not a guarantee about code paths it did not reach.