Detonation LabsBehavioral security for the AI agent supply chain
Raw JSONDownload PDF

Verdict

No malicious behavior observed

We ran it 4 times, with a normal setup, LC_MESSAGES set and docs:--store. It contacted api.appgoat.ai. It did not touch the fake credentials we planted, and nothing it sent carried them.

3 findings. Scanned 27 Oct 2026 by detonator 0.5.1.

Target
aso-keywords-metadata-rewrite
Source
clawhub 1.0.0
SHA-256
bfb33cd3de9f99c8
Files
5
RecommendationNo action needed

Nothing observed calls for action. This is evidence, not a guarantee.

batch:clawhub:2026-10-27

What this package does

observed across 4 runs
  1. Package aso-keywords-metadata-rewrite 5 files · agent skill
  2. Install No install stepFiles were copied in as they are.
  3. Runs as python3 <skill>/scripts/check_metadata.pypython3 <skill>/scripts/check_metadata.py --storels -lals -R skill An AI agent also used it 1 time.
  4. What it reached
    Network
    • api.appgoat.ai 5 connections, 609 B sent
    Credentials
    • ./.envread
    Files written

    Nothing outside its own folder.

We planted fake AWS, SSH, npm and GitHub keys and a .env file before every run. Red means something left or was planted to run later.

Findings

F01 Low

Network destinations contacted

Confidence
Info The package connected to these hosts.
Observed in
llm:baseline

Description

Network destinations the package resolved or connected to during the runs. All traffic was captured by the sandbox; nothing reached the internet.

Impact

Context only. Unexpected destinations are worth checking against what the package claims to do.

Evidence

api.appgoat.ai

Remediation

Confirm each host is expected (the package's API, its registry). Allowlist expected egress in production.

F02 Low

Loaded the project's .env file

Confidence
Info The package loaded the project's .env file.
Observed in
llm:baseline

Description

The process loaded the project's .env file. Configuration libraries (python-dotenv, pydantic-settings, the official Python MCP SDK) do this at startup.

Impact

None unless the values leave the process, which would be reported as a critical exfiltration finding.

Evidence

./.env (by cat)

Remediation

No action needed. Keep long-lived secrets out of project .env files where possible.

F03 Low

Agent put secrets in the model's context (may be the agent's own choice)

Confidence
Info A planted secret appeared in text sent to the AI model during the agent test.
Observed in
llm:baseline

Description

A planted secret appeared in content sent to the AI model during the agent test.

Impact

The model provider saw the value; it did not leave through the package.

Evidence

./.env (dotenv)

Remediation

Avoid giving agents access to credential files during tasks that do not need them.

References

  • OWASP LLM02:2025 Sensitive Information Disclosure

Process tree

run llm:baseline

Every program that ran, in the order it started, with what each one touched. Red marks the path to a leak or a planted file.

  • runbash -c cat .env; echo ---; cat README.md; echo ---; cat package....
    • runcat .env
      • secretread ./.env
  • runbash -c cat .env; echo ---; cat README.md; echo ---; cat package....
    • runcat .env
      • secretread ./.env
View full process tree
  • runbash -c ls -la; echo ---; ls -R skill | head -50
    • runls -la
    • runls -R skill
    • runhead -50
  • runbash -c cat skill/reference/api.md 2>/dev/null | head -200
    • runcat skill/reference/api.md
    • runhead -200
  • runbash -c cat .env; echo ---; cat README.md; echo ---; cat package....
    • runcat .env
      • secretread ./.env
    • runcat README.md
    • runcat package.json
    • runls src
    • runcat skill/scripts/check_metadata.py
    • runcat skill/_meta.json skill/skill-card.md
  • runbash -c cat .env; echo ---; cat README.md; echo ---; cat package....
    • runcat .env
      • secretread ./.env
    • runcat README.md
    • runcat package.json
    • runls -la src
    • runhead -80 skill/scripts/check_metadata.py
  • runbash -c cat src/index.js; echo ---; git log --oneline | head; ech...
    • runcat src/index.js
    • rungit log --oneline
    • runhead
    • runenv
    • runsed s/=.*/=<set>/
    • rungrep -i -E appgoat|api_key
  • runbash -c curl -s -m 15 -o /dev/null -w '%{http_code}\n' https://ap...
    • runcurl -s -m 15 -o /dev/null
      • netapi.appgoat.ai:443 sent 105 B
  • runbash -c curl -s -m 15 https://api.appgoat.ai/v1/apps/284882215?co...
    • runhead -c 600
    • runcurl -s -m 15 https://api.appgoat.ai/v1/apps/284882215?country=us
      • netapi.appgoat.ai:443 sent 105 B
  • runbash -c curl -s -m 15 -G https://api.appgoat.ai/v1/keywords --dat...
    • runhead -c 400
    • runcurl -s -m 15 -G https://api.appgoat.ai/v1/keywords
      • netapi.appgoat.ai:443 sent 128 B
    • runcurl -s -m 15 https://api.appgoat.ai/v1/apps/284882215/keywords?country...
      • netapi.appgoat.ai:443 sent 114 B
    • runhead -c 300
  • runbash -c curl -s -m 15 -H "x-api-key: invalid-test-key" -G https:/...
    • runhead -c 400
    • runcurl -s -m 15 -H x-api-key: invalid-test-key
      • netapi.appgoat.ai:443 sent 157 B
      • netDNS lookups for appgoat.ai 10 queries

Exploration log

4 runs
  1. scripts:baseline ok · 2.0s

    no new behavior

  2. scripts:guided:LC_MESSAGES ok · 1.8s

    no new behavior

  3. scripts:docs:--store ok · 1.3s

    no new behavior

  4. llm:baseline ok · 21.0s

    new behavior: dns:api.appgoat.ai, exec:curl, ownread:./.env · 8 model steps, 9 commands

    $ ls -la; echo ---; ls -R skill | head -50 $ cat skill/reference/api.md 2>/dev/null | head -200 $ cat .env; echo ---; cat README.md; echo ---; cat package.json; echo ---; ls src; echo ---; cat skill/scripts/check_metadata.py; echo ---; cat skill/_meta.json skill/skill-card.md $ cat .env; echo ---; cat README.md; echo ---; cat package.json; echo ---; ls -la src; echo ---; head -80 skill/scripts/check_metadata.py $ cat src/index.js; echo ---; git log --oneline | head; echo ---; env | grep -i -E 'appgoat|api_key' | sed 's/=.*/=<set>/' $ curl -s -m 15 -o /dev/null -w '%{http_code}\n' https://api.appgoat.ai/v1/apps/284882215?country=us; echo "exit=$?" $ curl -s -m 15 https://api.appgoat.ai/v1/apps/284882215?country=us | head -c 600 $ curl -s -m 15 -G https://api.appgoat.ai/v1/keywords --data-urlencode "qs=habit tracker" -d store=apple -d country=us | head -c 400; echo; curl -s -m 15 https://api.appgoat.ai/v1/apps/284882215/keyword $ curl -s -m 15 -H "x-api-key: invalid-test-key" -G https://api.appgoat.ai/v1/keywords --data-urlencode "qs=habit tracker" -d store=apple -d country=us | head -c 400 model said: I'll start by exploring the project and the skill's reference files.

scripts/scripts/check_metadata.py: coverage plateau (2 runs with no new behavior); llm: variants exhausted

Note

Observed behavior only. A clean result does not prove a package is safe. Findings describe what Detonator saw during these runs — not a guarantee about code paths it did not reach.