debpalash/OmniVoice-Studio

VoiceStudio

_{Previously OmniVoice-Studio}

Local voice cloning, dubbing, dictation, and long-form audio.

16 TTS engines · 11 ASR engines · 646-language catalogue · macOS, Windows, and Linux

Local-first. No account, API key, subscription, or usage meter for the core workflow.

Install · Features · Compare · Requirements · Engines · Architecture · API · Docs · 简体中文

[!WARNING] Active beta. Use the latest release for stable work or main for current fixes. Report problems through GitHub Issues.

At a glance

Install

Download packages from the latest release. First launch creates a managed Python environment and downloads the default model. Later launches reuse both.

[!NOTE] On macOS, first launch needs a one-time right-click → Open approval. Intel Macs cannot run the local Python backend; use a remote backend instead.

First voice

1. Launch VoiceStudio and open Voice Cloning.
2. Add a clean voice sample. Three seconds works; 5–15 seconds usually gives a better prompt.
3. Enter text, choose a language, then select Generate.

Run from source

Install the development prerequisites, then:

git clone https://github.com/debpalash/VoiceStudio.git
cd VoiceStudio
bun install
bun run desktop

Use bun run dev for the browser UI. See Contributing for services, tests, and platform packages.

If setup fails

• Run Settings → About → Run self-check or uv run python backend/main.py --diagnose --deep.
• Check install troubleshooting.
• Save a scrubbed diagnostic bundle from the app when opening an issue.
• For slow generation, compare measured benchmarks and performance settings.

Features

Model Catalogue: engine, device, and install state	Gallery: save a shared voice as a local profile

Comparison

VoiceStudio trades managed cloud compute for local control. This is the practical difference:

Requirements

Requirements vary by engine. These values cover the default local workflow.

ROCm is Linux-only and opt-in. Windows AMD/Ryzen AI uses CPU. Systems with limited VRAM offload work to CPU when required. See performance, benchmarks, and engine disk usage.

Engines

Engine support is capability-specific. Check cloning, language, platform, memory, and license before choosing one. Full setup guides: docs/engines.

Text to speech

⚡ Installed or registered on demand.

¹ IndexTTS 2.5 requires a separate written Bilibili license above 100 million monthly active users or RMB 1 billion annual revenue. Review the model license.

² PocketTTS shows its gated-access and CC-BY-4.0 terms before first use.

Clone-less engines cannot preserve a reference speaker in dubbing or pinned-voice batch jobs. VoiceStudio rejects those jobs instead of silently changing engines. Heavy engines have separate memory and platform limits; check their engine guide first.

Speech to text

WhisperX and Faster-Whisper retry with int8 when efficient float16 is unavailable. Pin ASR_COMPUTE_TYPE=int8 or float32 only if automatic selection still fails.

Architecture

Tauri v2 desktop shell (Rust)
        │ IPC
React + Vite UI
        │ HTTP · SSE · WebSocket on localhost:3900
FastAPI backend
        ├── TTS / ASR engine registries
        ├── dubbing / audio / long-form pipelines
        ├── OpenAI-compatible API and MCP server
        └── SQLite + Alembic → omnivoice_data/

Network boundary

• The desktop talks to a loopback-only backend on localhost:3900.
• Loopback API calls need no server key. Remote access requires a share PIN or API key.
• Remote workers and OpenAI-compatible ASR are opt-in. The UI identifies when audio leaves the machine.
• Analytics is off until consent. If enabled, it sends allowlisted, content-free usage metadata—not text, audio, file names, or projects.

OpenAI-compatible API

Point an OpenAI-compatible audio client at the local backend:

- base_url="https://api.openai.com/v1"
+ base_url="http://localhost:3900/v1"

from openai import OpenAI

client = OpenAI(base_url="http://localhost:3900/v1", api_key="local")

with client.audio.speech.with_streaming_response.create(
    model="tts-1",
    voice="<profile-id>",
    input="Made on my own hardware.",
    response_format="wav",
) as response:
    response.stream_to_file("speech.wav")

The full API reference is in Settings → OpenAPI Reference. For LAN, Tailscale, or proxy access, read API authentication before exposing the backend.

Agent skills

Install the VoiceStudio skills for Claude Code, Codex, Cursor, and other skills.sh-compatible agents:

npx skills add debpalash/omnivoice-studio

• omnivoice: synthesize speech and transcribe audio through local VoiceStudio.
• oss-maintainer: the repository's open-source maintenance workflow.

Google Colab

The notebook runs the app and web UI on a Colab GPU. Colab is remote compute, so uploaded audio and project data do not remain local to your machine.

Documentation

FAQ

Community and contributing

• GitHub Issues for reproducible bugs and feature requests.
• Discord for setup help and project discussion.
• Good first issues for a scoped starting point.
• Contributing guide for setup, tests, and pull requests.

Support development

VoiceStudio is free and has no paid tier. Donations fund development and infrastructure.

Ko-fi · PayPal · Sponsorship details

License

VoiceStudio is licensed under AGPL-3.0. You may run it, modify it, use it internally, and sell generated audio. If you modify VoiceStudio and provide that modified version as a network service, AGPL requires you to offer the corresponding source under the same license. A commercial license is available for proprietary embedding; contact [email protected]. See LICENSE-NOTICE.md for the plain-language scope.

Optional engines and downloaded models retain their own licenses. The bundled omnivoice/ model remains Apache-2.0 upstream.

Acknowledgments

VoiceStudio builds on OmniVoice, WhisperX, Demucs, Pyannote, CTranslate2, AudioSeal, Tauri, Supertonic, Sherpa-ONNX, GPT-SoVITS, and PocketTTS.