The appliance is part of an enterprise agreement. Your team needs the Self
Host feature and a grant for the All-in-One artifact before the commands
below will work. If Developer → Self Host does not appear in your dashboard,
contact your account manager.
What you get
1. Prerequisites
- Docker with the NVIDIA Container Toolkit installed and the
nvidiaruntime registered. Verify withdocker run --rm --gpus all <cuda-image> nvidia-smi. - Enough disk for the image: roughly 28 GB compressed, 60 GB unpacked.
- A deploy token, created in Developer → Self Host. That page also shows the version to run.
2. Sign in and pull
Your username is your Fish Audio account email; the password is a deploy token.3. Run
Generate a JWT secret once, store it, and reuse the same value on every run.--gpus all pins the worker to GPU 0 and the vocoder to GPU 1. On a host with more than two
GPUs it takes the first two; to choose specific cards use --gpus '"device=0,1"'.
-v fish-tts-shared:/mnt/shared is one persistent volume for everything that must survive a
restart: the compile and CUDA-graph caches, the vocoder engine, reference voices, and the usage
ledger. It is what makes restarts fast.
The first start compiles for around 10 minutes once the image is on the
host. A completely cold host that also has to transfer the ~28 GB image can
take 45–75 minutes end to end, depending on the network. Later starts on the
same volume take minutes. Keep the volume.
4. Check it is serving
Upgrading
Developer → Self Host shows the version your team recorded and tells you when a newer one is available, with a link to what changed. Upgrading is: pull the new tag, stop the old container, start a new one with the same volume and the sameJWT_SECRET.

