Learn-skills.dev whisper-voice

Native macOS menu bar app for live voice-to-text with auto-type using WhisperKit on Apple Silicon

install

source · Clone the upstream repo

git clone https://github.com/NeverSight/learn-skills.dev

Claude Code · Install into ~/.claude/skills/

T=$(mktemp -d) && git clone --depth=1 https://github.com/NeverSight/learn-skills.dev "$T" && mkdir -p ~/.claude/skills && cp -r "$T/data/skills-md/aiagentwithdhruv/skills/whisper-voice" ~/.claude/skills/neversight-learn-skills-dev-whisper-voice && rm -rf "$T"

manifest: data/skills-md/aiagentwithdhruv/skills/whisper-voice/SKILL.md

source content

Whisper Voice — Live Speech-to-Text Mac App

Goal

Build and run a native macOS menu bar app that captures live microphone audio, transcribes it offline using WhisperKit (on Apple Silicon), and auto-types the text wherever the cursor is.

Inputs

Name	Type	Required	Description
model_size	string	No	Whisper model: tiny, base (default), small
language	string	No	"en" (default) or "hi" for Hindi mode
chunk_duration	float	No	Seconds per audio chunk (default: 3.0)

Process

1. Build the app

cd AiwithDhruv_Voice/WhisperAiwithDhruv
swift build

2. Run the app

swift run WhisperAiwithDhruv
# Or open in Xcode: open Package.swift → Cmd+R

3. First launch setup

Grant microphone permission when prompted
Grant Accessibility in System Settings → Privacy → Accessibility
Wait for model download (~140MB for base model)

4. Usage

Cmd+Shift+Space — Toggle recording on/off
Click mic icon in menu bar for controls
Speak — text auto-types at cursor position
Toggle Hindi mode for Hindi/Hinglish input

Outputs

Name	Type	Description
transcribed_text	string	Live transcribed text typed at cursor
history	array	Last 50 transcription entries in menu bar

Edge Cases

No mic: Shows error in menu bar dropdown
Accessibility denied: Auto-type disabled, manual copy from history
Silence: VAD skips silent chunks (energy-based threshold)
Hallucinations: Filters common Whisper artifacts ("Thank you.", "...")
Model not downloaded: Shows download progress bar

Environment

macOS 14+ (Sonoma)
Apple Silicon (M1/M2/M3/M4)
Xcode 15+ (for building)
No API keys needed (fully offline)

Schema

Inputs

Name	Type	Required	Description
model_size	string	No	tiny / base / small
language	string	No	en / hi
chunk_duration	float	No	2.0 - 8.0 seconds
silence_threshold	float	No	0.002 - 0.05

Outputs

Name	Type	Description
transcription	string	Live text output
auto_typed	boolean	Whether text was injected at cursor

Credentials

Name	Source
None	Fully offline, no API keys

Composable With

video-edit

(add transcription captions),

send-telegram

(send transcriptions to phone)

Cost

Free — runs entirely on-device. Model download is one-time (~140MB for base).