Paddock
Rust inference server for open models on NVIDIA and Apple Silicon with APIs and Studio.
Tested on LinuxKnown vulnerabilities
Use it
Before you install: known vulnerabilities
pickfit found 14 known high or critical vulnerabilities in the packages a fresh install brings (OSV.dev, 3 Nov 2026). Weigh this before you install it.
crates:zip 8.6.0zip: Critical Parser Differential & Security Control Bypass via Dual-Header Inconsistencies (Zip Cloaking) Leading to Arbitrary File Overwrite & RCE (GHSA-m665-v7pm-7grj, critical, fixed in 9.0.5)npm:dompurify 3.4.14DOMPurify SAFE_FOR_TEMPLATES bypass: split template expressions survive in attached shadow root content on DOM output modes (GHSA-cg2g-xh64-v4q7, critical, fixed in 3.4.17)
See 8 more
crates:zip 8.6.0— RUSTSEC-2026-0369 (critical), fixed in 9.0.0crates:calamine 0.36.1— RUSTSEC-2026-0436 (high), fixed in 0.38.0crates:quinn-proto 0.11.17— RUSTSEC-2026-0340 (high), fixed in 0.11.18crates:quinn-proto 0.11.17— RUSTSEC-2026-0343 (high), fixed in 0.11.18crates:zip 8.6.0— GHSA-9hj8-73fh-9963 (high), fixed in 9.0.0crates:zip 8.6.0— GHSA-hjqx-j4rw-g7xv (high), fixed in 9.0.0crates:zip 8.6.0— GHSA-q7v9-x93c-xqv3 (high), fixed in 9.0.0crates:zip 8.6.0— RUSTSEC-2026-0367 (high), fixed in 9.0.0
4 more findings not listed here.
Linux x86_64
You need first
- Runtimes:
Rust, current stable,Node and npm - System packages:
cmake and a C/C++ compiler
Download Linux x86_64 binary release
mkdir -p ~/paddock-bin /tmp/paddock-dl && curl -fL -o /tmp/paddock-dl/paddock.tar.gz https://github.com/truespar/paddock/releases/download/v0.1.19/paddock-0.1.19-x86_64-linux.tar.gzExtract portable binaries
tar -xzf /tmp/paddock-dl/paddock.tar.gz -C ~/paddock-binInstall paddock and paddock-runner to PATH
ln -sf ~/paddock-bin/paddock-0.1.19-x86_64-linux/paddock ~/.local/bin/paddock && ln -sf ~/paddock-bin/paddock-0.1.19-x86_64-linux/paddock-runner ~/.local/bin/paddock-runner && paddock --version
Check that it works
ln -sf ~/paddock-bin/paddock-0.1.19-x86_64-linux/paddock ~/.local/bin/paddock && ln -sf ~/paddock-bin/paddock-0.1.19-x86_64-linux/paddock-runner ~/.local/bin/paddock-runner && ls -l ~/.local/bin/paddock* && paddock --versionThe output should contain “paddock 0.1.19”.
First thing to try
paddock --port 11500curl -sk https://127.0.0.1:11500/Start the server, then open https://127.0.0.1:11500/ in a browser or with curl -sk https://127.0.0.1:11500/ to reach it.
What it does
These come from the README; pickfit didn’t check them one by one.
- Run a local inference server for open modelsNot tested
- Use OpenAI- and Anthropic-compatible APIsNot tested
- Generate images and edit picturesNot tested
How far pickfit got
Linux x86_64
- Installs
- Starts
- Answers requests
- Works offline
macOS and Windows: the project says it runs there; pickfit hasn’t tried it.
Good for
- downloading and managing models
- comparing models side by side
- read a page as text with boxes
- generate pictures from a text prompt
- transcribe live audio in 40 locales
An alternative to llama.cpp, vLLM and SGLang.
How pickfit tested it
Each run starts from a clean machine and follows the steps above. How pickfit verifies
Linux x86_64
Its service answers requests
- Replayed from scratch
- Works offline
- Checked on 30 Oct 2026
- Version 0.1.19 (g9aa69660)
Differences the test machine hit
- README: cargo build --release -p paddock-manager -p paddock-runner
In the test: Used prebuilt paddock-0.1.19-x86_64-linux.tar.gz from GitHub releases and symlinked paddock and paddock-runner into ~/.local/bin; box has node/npm only, no rustc/cargo/cmake/gcc and installing a Rust toolchain is forbidden - README: AI inference server for NVIDIA GPUs and Apple Silicon
In the test: Manager runs without GPU and serves Studio at https://127.0.0.1:11500 over TLS with self-signed cert (curl -k needed); log warns 'no usable graphics card ... models cannot run' so no runner inference was attempted - README: OpenAI/Anthropic API on the manager port
In the test: Manager has no /v1/models or /api/health (both return not_found_error) and no /openapi.json; health is Studio HTML at / and status via `paddock ps` because clients talk to runners directly, manager is never a proxy