Image Vision Skill

Adds the ability for NanoClaw agents to see and understand images sent via WhatsApp. Images are downloaded, resized with sharp, saved to the group workspace, and passed to the agent as base64-encoded multimodal content blocks.

Phase 1: Pre-flight

1. Check

   .nanoclaw/state.yaml

   for

   add-image-vision

   — skip if already applied
2. Confirm

   sharp

   is installable (native bindings require build tools)

Phase 2: Apply Code Changes

1. Initialize the skills system if not already done:

   npx tsx -e "import { initNanoclawDir } from './skills-engine/init.ts'; initNanoclawDir();"
   

2. Apply the skill:

   npx tsx skills-engine/apply-skill.ts add-image-vision
   

3. Install new dependency:

   npm install sharp
   

4. Validate:

   npm run typecheck
   npm test
   

Phase 3: Configure

1. Rebuild the container (agent-runner changes need a rebuild):

   ./container/build.sh
   

2. Sync agent-runner source to group caches:

   for dir in data/sessions/*/agent-runner-src/; do
     cp container/agent-runner/src/*.ts "$dir"
   done
   

3. Restart the service:

   launchctl kickstart -k gui/$(id -u)/com.nanoclaw
   

Phase 4: Verify

1. Send an image in a registered WhatsApp group
2. Check the agent responds with understanding of the image content
3. Check logs for "Processed image attachment":

   tail -50 groups/*/logs/container-*.log
   

Troubleshooting

• "Image - download failed": Check WhatsApp connection stability. The download may timeout on slow connections.
• "Image - processing failed": Sharp may not be installed correctly. Run

  npm ls sharp

  to verify.
• Agent doesn't mention image content: Check container logs for "Loaded image" messages. If missing, ensure agent-runner source was synced to group caches.