Audit Icon Pipeline

Detect missing glyphs, missing icons, and stale manifests by comparing registries against glyph mapping files, icon directories, and manifests. Produces a structured gap report covering skills, agents, and teams.

When to Use

• After adding new skills, agents, or teams to check if icons are needed
• Before a full pipeline render to identify what's missing
• After registry updates to ensure manifests are in sync
• Periodic health check of the icon pipeline

Inputs

• Optional: Entity type filter —

  skill

  ,

  agent

  ,

  team

  , or

  all

  (default:

  all

  )
• Optional: Palette to check (default:

  cyberpunk

  — the reference palette)

Procedure

Step 1: Read Registries

Collect all entity IDs from the source-of-truth registries.

1. Read

   skills/_registry.yml

   — extract all skill IDs across all domains
2. Read

   agents/_registry.yml

   — extract all agent IDs
3. Read

   teams/_registry.yml

   — extract all team IDs
4. Record counts: total skills, agents, teams

Expected: Three lists of entity IDs with counts matching

total_skills

,

total_agents

,

total_teams

.

On failure: If a registry file is missing, report the path and skip that entity type.

Step 2: Read Glyph Mappings

Collect all mapped entity IDs from the glyph mapping files.

1. Read

   viz/R/glyphs.R

   — extract all keys from

   SKILL_GLYPHS

   list
2. Read

   viz/R/agent_glyphs.R

   — extract all keys from

   AGENT_GLYPHS

   list
3. Read

   viz/R/team_glyphs.R

   — extract all keys from

   TEAM_GLYPHS

   list

Expected: Three lists of mapped IDs.

On failure: If a glyph file is missing, report it and mark all entities of that type as unmapped.

Step 3: Compute Missing Glyphs

Diff registry IDs against mapped IDs.

1. Missing skill glyphs:

   registry_skill_ids - mapped_skill_ids

2. Missing agent glyphs:

   registry_agent_ids - mapped_agent_ids

3. Missing team glyphs:

   registry_team_ids - mapped_team_ids

Expected: Lists of entity IDs that exist in registries but have no glyph function mapped.

On failure: If diff computation fails, verify ID formats match between registry and glyph files (e.g., underscores vs hyphens).

Step 4: Check Rendered Icons

Verify that mapped glyphs have corresponding rendered icon files.

1. For each mapped skill ID, check

   viz/public/icons/<palette>/<domain>/<skillId>.webp

2. For each mapped agent ID, check

   viz/public/icons/<palette>/agents/<agentId>.webp

3. For each mapped team ID, check

   viz/public/icons/<palette>/teams/<teamId>.webp

4. Check HD variants in

   viz/public/icons-hd/

   with the same structure

Expected: Lists of entities with glyphs but missing rendered icons (standard and/or HD).

On failure: If the icon directory doesn't exist, the pipeline hasn't been run yet — report all as missing.

Step 5: Check Manifest Freshness

Compare manifest counts against registry counts.

1. Read

   viz/public/data/icon-manifest.json

   — count entries
2. Read

   viz/public/data/agent-icon-manifest.json

   — count entries
3. Read

   viz/public/data/team-icon-manifest.json

   — count entries
4. Compare against registry totals

Expected: Manifest counts match registry counts. Discrepancies indicate stale manifests.

On failure: If manifest files don't exist, the data pipeline needs to run first (

node build-data.js && node build-icon-manifest.js

).

Step 6: Detect Orphan Icons

Walk

viz/public/icons*/

and flag WebP files whose

<palette>/<domain>/<skillId>

triple does not appear in

icon-manifest.json

.

1. Enumerate all WebP files:

   find viz/public/icons* -name "*.webp"

2. For each file, extract

   <domain>/<id>

   from its path
3. Check if

   <domain>/<id>

   has an entry in

   icon-manifest.json

4. Collect non-matching files as orphans — they exist on disk but are no longer referenced

# Quick orphan count per palette
node -e "
const fs = require('fs');
const manifest = JSON.parse(fs.readFileSync('viz/public/data/icon-manifest.json'));
const ids = new Set(manifest.map(e => e.domain + '/' + e.id));
const orphans = require('child_process')
  .execSync('find viz/public/icons -name \"*.webp\"').toString().trim().split('\n')
  .filter(p => { const parts = p.split('/'); const id = parts.slice(-2).join('/').replace('.webp',''); return !ids.has(id); });
console.log('Orphans:', orphans.length);
orphans.forEach(p => console.log(' ', p));
"

Expected: Zero orphans. Any orphans indicate skills re-homed to a different domain without cleanup (18 orphans per re-homing = 9 palettes × 2 sizes).

On failure: Delete orphans manually — they have no corresponding manifest entry and will not be served. Re-home events are rare, so manual cleanup is acceptable.

Step 7: Generate Gap Report

Produce a structured summary.

1. Format output as a clear table or list:

   === Icon Pipeline Audit ===
   
   MISSING GLYPHS (no glyph function):
     Skills: 5 missing — [list]
     Agents: 2 missing — [list]
     Teams: 0 missing
   
   MISSING ICONS (glyph exists, no rendered WebP):
     Standard (512px): 3 skills, 1 agent
     HD (1024px): 8 skills, 3 agents, 1 team
   
   STALE MANIFESTS:
     icon-manifest.json: 320 entries vs 326 registry (stale)
     agent-icon-manifest.json: 66 entries vs 66 registry (OK)
     team-icon-manifest.json: 15 entries vs 15 registry (OK)
   

2. Suggest next actions based on findings

Expected: A complete gap report with actionable next steps.

On failure: If all checks pass with zero gaps, report "Pipeline fully in sync" as a positive outcome.

Validation Checklist

• All three registries read successfully
• All three glyph mapping files checked
• Icon directories scanned for both standard and HD
• Manifest freshness verified
• Orphan icons checked (disk paths vs manifest)
• Gap report produced with counts and entity lists
• Actionable next steps provided

Common Pitfalls

• ID format mismatch: Registry uses kebab-case (

  create-skill

  ), glyph maps may use snake_case keys — ensure comparison normalizes
• Palette assumption: Only checking cyberpunk palette misses palette-specific rendering gaps
• Empty directories: A domain directory existing but empty counts as "icons present" when globbing — check file existence, not directory existence
• HD not rendered: HD icons are in a separate directory tree (

  icons-hd/

  ) — don't confuse with standard icons
• Orphans after re-homing: When a skill's domain changes,

  build.sh

  creates icons at the new path but does NOT delete the old path — always run Step 6 orphan check after any domain migration

Related Skills

• create-glyph — create a missing glyph identified by this audit
• enhance-glyph — improve quality of existing glyphs
• render-icon-pipeline — run the full pipeline to generate missing icons