Aiwg diversity-tuning
Interactive tuning of Verbalized Sampling diversity parameters with preset management and A/B comparison
install
source · Clone the upstream repo
git clone https://github.com/jmagly/aiwg
Claude Code · Install into ~/.claude/skills/
T=$(mktemp -d) && git clone --depth=1 https://github.com/jmagly/aiwg "$T" && mkdir -p ~/.claude/skills && cp -r "$T/.agents/skills/diversity-tuning" ~/.claude/skills/jmagly-aiwg-diversity-tuning && rm -rf "$T"
manifest:
.agents/skills/diversity-tuning/SKILL.mdsource content
Diversity Tuning Skill
Triggers
Alternate expressions and non-obvious activations (primary phrases are matched automatically from the skill description):
- "mode collapse" → RLHF pattern mitigation via diversity tuning
- "RLHF collapse" → same
- "VS parameters" → Verbalized Sampling parameter adjustment shorthand
Purpose
Interactively tune Verbalized Sampling parameters to find the right diversity level for a given task.
Parameters
| Parameter | Default | Range | Description |
|---|---|---|---|
| k | 5 | 3-20 | Number of responses to generate |
| threshold | 0.1 | 0.01-1.0 | Probability filter threshold |
| variant | standard | standard/cot/multi | VS prompt variant |
Presets
| Preset | k | threshold | variant | Use Case |
|---|---|---|---|---|
| conservative | 3 | 1.0 | standard | Minimal diversity, high confidence |
| moderate | 5 | 0.1 | standard | Balanced (default) |
| creative | 8 | 0.05 | cot | High diversity for ideation |
| maximum | 12 | 0.01 | multi | Maximum exploration |
Usage
# Apply a preset "tune diversity to creative" # Custom parameters "set diversity k=8 threshold=0.05" # A/B comparison "compare diversity: moderate vs creative for tagline generation"
A/B Comparison Mode
When comparing presets:
- Generate outputs using preset A
- Generate outputs using preset B
- Show side-by-side comparison
- Measure diversity metrics:
- Unique n-gram ratio
- Average pairwise edit distance
- Semantic cluster count
- Recommend the better preset for the task
References
- @$AIWG_ROOT/agentic/code/addons/aiwg-utils/rules/vague-discretion.md — Measurable diversity thresholds and tuning criteria
- @$AIWG_ROOT/agentic/code/addons/aiwg-utils/rules/instruction-comprehension.md — Parsing tuning parameters accurately
- @$AIWG_ROOT/docs/extensions/overview.md — Extension system architecture
- @$AIWG_ROOT/agentic/code/addons/voice-framework/README.md — Voice framework for style diversity context