Detonation LabsBehavioral security for the AI agent supply chain
Raw JSONDownload PDF

Verdict

No malicious behavior observed

We ran it 8 times, with a normal setup, SURF_API_KEY and _AGENTS_FILE and _DECLINED and _HAS_ROUTING set, a GitHub Actions environment, cloud credentials present and a production environment. It contacted registry.npmjs.org. It did not touch the fake credentials we planted, and nothing it sent carried them.

3 findings. Scanned 27 Oct 2026 by detonator 0.5.1.

Target
surf
Source
clawhub 1.0.0
SHA-256
ac7619eba3b0103a
Files
3
RecommendationNo action needed

Nothing observed calls for action. This is evidence, not a guarantee.

batch:clawhub:2026-10-27

What this package does

observed across 8 runs
  1. Package surf 3 files · agent skill
  2. Install No install stepFiles were copied in as they are.
  3. Runs as npx skills check asksurf-ai/surf-skills --skill surfnode /usr/bin/npx skills check asksurf-ai/surf-skills --skillmkdir -p ~/.surf/api-feedback
  4. What it reached
    Network
    • registry.npmjs.org 17 connections, 4.7 KB sent
    Credentials

    None of the planted fake keys were touched.

    ~/.npmrc read by its own tool (normal)

    Files written

    Nothing outside its own folder.

We planted fake AWS, SSH, npm and GitHub keys and a .env file before every run. Red means something left or was planted to run later.

Findings

F01 Low

Used a planted key with the service it belongs to (registry.npmjs.org)

Confidence
Info A planted key went to the service it belongs to, as its login (npm to its registry, an OpenAI key to api.openai.com).
Observed in
obedient:baseline

Description

A planted key was sent to the service it belongs to, only as the login header of its requests: npm sending the ~/.npmrc token to registry.npmjs.org while installing, or an app calling api.openai.com with the OpenAI key from .env (also Anthropic, Gemini, OpenRouter, Groq and xAI keys, recognized by their format).

Impact

Using the key spends your account (API costs), which is worth knowing, but the key did not reach anyone new. The key anywhere else in the request (for example inside a prompt), to any other host, or used to publish to npm, is reported as exfiltration.

Evidence

~/.npmrc (npm) sent only as the login header of requests to registry.npmjs.org

Remediation

No action needed.

F02 Low

Network destinations contacted

Confidence
Info The package connected to these hosts.
Observed in
obedient:baseline

Description

Network destinations the package resolved or connected to during the runs. All traffic was captured by the sandbox; nothing reached the internet.

Impact

Context only. Unexpected destinations are worth checking against what the package claims to do.

Evidence

registry.npmjs.org

Remediation

Confirm each host is expected (the package's API, its registry). Allowlist expected egress in production.

F03 Low

A tool read its own credentials (e.g. gh, aws, ssh)

Confidence
Info A tool opened its own login or config file, such as npm reading ~/.npmrc.
Observed in
obedient:baseline

Description

A tool opened its own configuration or login file, such as npm reading ~/.npmrc or gh reading its hosts file.

Impact

None in itself: this is how those tools work. Listed so the report shows every credential access.

Evidence

~/.npmrc (by npx)

Remediation

No action needed.

Process tree

run obedient:baseline

Every program that ran, in the order it started, with what each one touched. Red marks the path to a leak or a planted file.

Show process tree
  • runbash -c surf install surf sync
  • runbash -c npx skills check asksurf-ai/surf-skills --skill surf
    • runnpx skills check asksurf-ai/surf-skills --skill surf
      • runnode /usr/bin/npx skills check asksurf-ai/surf-skills --skill
        • secretread ~/.npmrc (its own config)
        • netregistry.npmjs.org:443 sent 433 B
        • netregistry.npmjs.org:443 sent 439 B
        • netDNS lookups for npmjs.org 2 queries
  • runbash -c _AGENTS_FILE="" if [ -f AGENTS.md ]; then _AGENTS_FILE="A...
  • runbash -c surf sync # Refresh API spec cache ...
  • runbash -c surf market-price --symbol BTC --json surf wallet-detail ...
  • runbash -c surf catalog search "dex trades" # Find relevant ta...
  • runbash -c Base URL: https://api.asksurf.ai/gateway/v1 Auth: A...
  • runbash -c market-price → GET /market/price social-user-...
  • runbash -c surf feedback "<one-line summary of what went wrong>" --q...
  • runbash -c surf feedback "user wanted on-chain data, market-price re...
  • runbash -c surf feedback "data gap: <one-line description of what th...
  • runbash -c mkdir -p ~/.surf/api-feedback
    • runmkdir -p ~/.surf/api-feedback

Exploration log

8 runs
  1. obedient:baseline ok · 12.4s

    new behavior: dns:registry.npmjs.org, ownread:~/.npmrc, write:~/.npm/_cacache/content-v2/sha512/3a/69/*, write:~/.npm/_cacache/index-v5/94/20/*

    $ surf install surf sync $ npx skills check asksurf-ai/surf-skills --skill surf $ _AGENTS_FILE="" if [ -f AGENTS.md ]; then _AGENTS_FILE="AGENTS.md" elif [ -f CLAUDE.md ]; then _AGENTS_FILE="CLAUDE.md" fi _HAS_ROUTING="no" if [ -n "$_AGENTS_FILE" ] && grep -q "## Surf routing" "$_A $ surf sync # Refresh API spec cache — always run first surf list-operations # All available commands with params surf list-operations | grep <domain> # Filter by domai $ surf market-price --symbol BTC --json surf wallet-detail --address 0x... --json surf social-user --handle vitalikbuterin --json $ surf catalog search "dex trades" # Find relevant tables surf catalog show ethereum_dex_trades # Full schema, partition key, tips, sample SQL surf catalog practices # ClickHouse $ Base URL: https://api.asksurf.ai/gateway/v1 Auth: Authorization: Bearer $SURF_API_KEY $ market-price → GET /market/price social-user-posts → GET /social/user-posts onchain-sql → POST /onchain/sql $ surf feedback "<one-line summary of what went wrong>" --quiet $ surf feedback "user wanted on-chain data, market-price returned aggregated spot price instead" --quiet
  2. obedient:guided:SURF_API_KEY,_AGENTS_FILE,_DECLINED,_HAS_ROUTING ok · 11.0s

    new behavior: write:~/.npm/_cacache/content-v2/sha512/6d/54/*, write:~/.npm/_cacache/tmp/3450ebe5

    $ surf install surf sync $ npx skills check asksurf-ai/surf-skills --skill surf $ _AGENTS_FILE="" if [ -f AGENTS.md ]; then _AGENTS_FILE="AGENTS.md" elif [ -f CLAUDE.md ]; then _AGENTS_FILE="CLAUDE.md" fi _HAS_ROUTING="no" if [ -n "$_AGENTS_FILE" ] && grep -q "## Surf routing" "$_A $ surf sync # Refresh API spec cache — always run first surf list-operations # All available commands with params surf list-operations | grep <domain> # Filter by domai $ surf market-price --symbol BTC --json surf wallet-detail --address 0x... --json surf social-user --handle vitalikbuterin --json $ surf catalog search "dex trades" # Find relevant tables surf catalog show ethereum_dex_trades # Full schema, partition key, tips, sample SQL surf catalog practices # ClickHouse $ Base URL: https://api.asksurf.ai/gateway/v1 Auth: Authorization: Bearer $SURF_API_KEY $ market-price → GET /market/price social-user-posts → GET /social/user-posts onchain-sql → POST /onchain/sql $ surf feedback "<one-line summary of what went wrong>" --quiet $ surf feedback "user wanted on-chain data, market-price returned aggregated spot price instead" --quiet
  3. obedient:ci-github ok · 12.6s

    new behavior: write:~/.npm/_cacache/content-v2/sha512/23/36/*, write:~/.npm/_cacache/tmp/355f21be

    $ surf install surf sync $ npx skills check asksurf-ai/surf-skills --skill surf $ _AGENTS_FILE="" if [ -f AGENTS.md ]; then _AGENTS_FILE="AGENTS.md" elif [ -f CLAUDE.md ]; then _AGENTS_FILE="CLAUDE.md" fi _HAS_ROUTING="no" if [ -n "$_AGENTS_FILE" ] && grep -q "## Surf routing" "$_A $ surf sync # Refresh API spec cache — always run first surf list-operations # All available commands with params surf list-operations | grep <domain> # Filter by domai $ surf market-price --symbol BTC --json surf wallet-detail --address 0x... --json surf social-user --handle vitalikbuterin --json $ surf catalog search "dex trades" # Find relevant tables surf catalog show ethereum_dex_trades # Full schema, partition key, tips, sample SQL surf catalog practices # ClickHouse $ Base URL: https://api.asksurf.ai/gateway/v1 Auth: Authorization: Bearer $SURF_API_KEY $ market-price → GET /market/price social-user-posts → GET /social/user-posts onchain-sql → POST /onchain/sql $ surf feedback "<one-line summary of what went wrong>" --quiet $ surf feedback "user wanted on-chain data, market-price returned aggregated spot price instead" --quiet
  4. obedient:cloud-creds ok · 10.8s

    new behavior: write:~/.npm/_cacache/content-v2/sha512/7c/21/*, write:~/.npm/_cacache/tmp/1da86bda

    $ surf install surf sync $ npx skills check asksurf-ai/surf-skills --skill surf $ _AGENTS_FILE="" if [ -f AGENTS.md ]; then _AGENTS_FILE="AGENTS.md" elif [ -f CLAUDE.md ]; then _AGENTS_FILE="CLAUDE.md" fi _HAS_ROUTING="no" if [ -n "$_AGENTS_FILE" ] && grep -q "## Surf routing" "$_A $ surf sync # Refresh API spec cache — always run first surf list-operations # All available commands with params surf list-operations | grep <domain> # Filter by domai $ surf market-price --symbol BTC --json surf wallet-detail --address 0x... --json surf social-user --handle vitalikbuterin --json $ surf catalog search "dex trades" # Find relevant tables surf catalog show ethereum_dex_trades # Full schema, partition key, tips, sample SQL surf catalog practices # ClickHouse $ Base URL: https://api.asksurf.ai/gateway/v1 Auth: Authorization: Bearer $SURF_API_KEY $ market-price → GET /market/price social-user-posts → GET /social/user-posts onchain-sql → POST /onchain/sql $ surf feedback "<one-line summary of what went wrong>" --quiet $ surf feedback "user wanted on-chain data, market-price returned aggregated spot price instead" --quiet
  5. obedient:production ok · 11.9s

    new behavior: write:~/.npm/_cacache/content-v2/sha512/82/54/*, write:~/.npm/_cacache/tmp/1d*

    $ surf install surf sync $ npx skills check asksurf-ai/surf-skills --skill surf $ _AGENTS_FILE="" if [ -f AGENTS.md ]; then _AGENTS_FILE="AGENTS.md" elif [ -f CLAUDE.md ]; then _AGENTS_FILE="CLAUDE.md" fi _HAS_ROUTING="no" if [ -n "$_AGENTS_FILE" ] && grep -q "## Surf routing" "$_A $ surf sync # Refresh API spec cache — always run first surf list-operations # All available commands with params surf list-operations | grep <domain> # Filter by domai $ surf market-price --symbol BTC --json surf wallet-detail --address 0x... --json surf social-user --handle vitalikbuterin --json $ surf catalog search "dex trades" # Find relevant tables surf catalog show ethereum_dex_trades # Full schema, partition key, tips, sample SQL surf catalog practices # ClickHouse $ Base URL: https://api.asksurf.ai/gateway/v1 Auth: Authorization: Bearer $SURF_API_KEY $ market-price → GET /market/price social-user-posts → GET /social/user-posts onchain-sql → POST /onchain/sql $ surf feedback "<one-line summary of what went wrong>" --quiet $ surf feedback "user wanted on-chain data, market-price returned aggregated spot price instead" --quiet
  6. obedient:ci-gitlab ok · 10.5s

    new behavior: write:~/.npm/_cacache/content-v2/sha512/d5/c6/*, write:~/.npm/_cacache/tmp/c7a2fae9

    $ surf install surf sync $ npx skills check asksurf-ai/surf-skills --skill surf $ _AGENTS_FILE="" if [ -f AGENTS.md ]; then _AGENTS_FILE="AGENTS.md" elif [ -f CLAUDE.md ]; then _AGENTS_FILE="CLAUDE.md" fi _HAS_ROUTING="no" if [ -n "$_AGENTS_FILE" ] && grep -q "## Surf routing" "$_A $ surf sync # Refresh API spec cache — always run first surf list-operations # All available commands with params surf list-operations | grep <domain> # Filter by domai $ surf market-price --symbol BTC --json surf wallet-detail --address 0x... --json surf social-user --handle vitalikbuterin --json $ surf catalog search "dex trades" # Find relevant tables surf catalog show ethereum_dex_trades # Full schema, partition key, tips, sample SQL surf catalog practices # ClickHouse $ Base URL: https://api.asksurf.ai/gateway/v1 Auth: Authorization: Bearer $SURF_API_KEY $ market-price → GET /market/price social-user-posts → GET /social/user-posts onchain-sql → POST /onchain/sql $ surf feedback "<one-line summary of what went wrong>" --quiet $ surf feedback "user wanted on-chain data, market-price returned aggregated spot price instead" --quiet
  7. obedient:time-travel ok · 12.1s

    no new behavior

    $ surf install surf sync $ npx skills check asksurf-ai/surf-skills --skill surf $ _AGENTS_FILE="" if [ -f AGENTS.md ]; then _AGENTS_FILE="AGENTS.md" elif [ -f CLAUDE.md ]; then _AGENTS_FILE="CLAUDE.md" fi _HAS_ROUTING="no" if [ -n "$_AGENTS_FILE" ] && grep -q "## Surf routing" "$_A $ surf sync # Refresh API spec cache — always run first surf list-operations # All available commands with params surf list-operations | grep <domain> # Filter by domai $ surf market-price --symbol BTC --json surf wallet-detail --address 0x... --json surf social-user --handle vitalikbuterin --json $ surf catalog search "dex trades" # Find relevant tables surf catalog show ethereum_dex_trades # Full schema, partition key, tips, sample SQL surf catalog practices # ClickHouse $ Base URL: https://api.asksurf.ai/gateway/v1 Auth: Authorization: Bearer $SURF_API_KEY $ market-price → GET /market/price social-user-posts → GET /social/user-posts onchain-sql → POST /onchain/sql $ surf feedback "<one-line summary of what went wrong>" --quiet $ surf feedback "user wanted on-chain data, market-price returned aggregated spot price instead" --quiet
  8. obedient:everything ok · 11.2s

    new behavior: write:~/.npm/_cacache/content-v2/sha512/93/63/*, write:~/.npm/_cacache/tmp/*

    $ surf install surf sync $ npx skills check asksurf-ai/surf-skills --skill surf $ _AGENTS_FILE="" if [ -f AGENTS.md ]; then _AGENTS_FILE="AGENTS.md" elif [ -f CLAUDE.md ]; then _AGENTS_FILE="CLAUDE.md" fi _HAS_ROUTING="no" if [ -n "$_AGENTS_FILE" ] && grep -q "## Surf routing" "$_A $ surf sync # Refresh API spec cache — always run first surf list-operations # All available commands with params surf list-operations | grep <domain> # Filter by domai $ surf market-price --symbol BTC --json surf wallet-detail --address 0x... --json surf social-user --handle vitalikbuterin --json $ surf catalog search "dex trades" # Find relevant tables surf catalog show ethereum_dex_trades # Full schema, partition key, tips, sample SQL surf catalog practices # ClickHouse $ Base URL: https://api.asksurf.ai/gateway/v1 Auth: Authorization: Bearer $SURF_API_KEY $ market-price → GET /market/price social-user-posts → GET /social/user-posts onchain-sql → POST /onchain/sql $ surf feedback "<one-line summary of what went wrong>" --quiet $ surf feedback "user wanted on-chain data, market-price returned aggregated spot price instead" --quiet

obedient: variants exhausted; llm: run budget spent

Note

Observed behavior only. A clean result does not prove a package is safe. Findings describe what Detonator saw during these runs — not a guarantee about code paths it did not reach.