A voice and text assistant that runs entirely on-device, built as a terminal UI for macOS with Apple Silicon.
Uses MLX for inference and Textual for the interface.
- macOS with Apple Silicon (M1+)
- Python 3.12+
uvx voxingModels are loaded per-request and unloaded after to keep memory usage low.
| Task | Default Model |
|---|---|
| Speech-to-Text | parakeet-tdt-0.6b-v3 |
| LLM | LFM2.5-1.2B-Instruct-MLX-8bit |
Both models are configurable via /settings.
| Command | Description |
|---|---|
/transcribe |
Record voice input with real-time visualizer, stops on silence |
/settings |
Configure models, audio, and LLM parameters |
/clear |
Clear chat history |
/help |
Show available commands |
/exit |
Quit the application |