Xolotl
Runs frontier MoE models like DeepSeek-V4.1-Flash 552B locally on one gaming PC with tiered VRAM/RAM/NVMe offloading.
Not verified yetKnown vulnerabilities
How far pickfit got
pickfit hasn’t verified Xolotl yet, so there are no tested install steps.
What follows comes from its README only.
Use it
Before you install: known vulnerabilities
pickfit found 32 known high or critical vulnerabilities in the packages a fresh install brings (OSV.dev, 3 Nov 2026). Weigh this before you install it.
crates:zip 4.6.1zip: Critical Parser Differential & Security Control Bypass via Dual-Header Inconsistencies (Zip Cloaking) Leading to Arbitrary File Overwrite & RCE (GHSA-m665-v7pm-7grj, critical, fixed in 9.0.5)pypi:pillow 12.3.0Pillow: Heap buffer overflow in _tiffWriteProc when saving TIFF to BytesIO (GHSA-332p-7hrc-92wf, critical, fixed in 13.0.0)
See 8 more
crates:zip 4.6.1— RUSTSEC-2026-0369 (critical), fixed in 9.0.0pypi:pillow 12.3.0— GHSA-5x8w-8jj5-q52h (critical), fixed in 13.0.0pypi:pillow 12.3.0— GHSA-8g5g-8vmr-9782 (critical), fixed in 13.0.0pypi:pillow 12.3.0— GHSA-v9pv-5gc8-w2m6 (critical), fixed in 13.0.0pypi:pillow 12.3.0— GHSA-w889-685w-c8fh (critical), fixed in 13.0.0crates:zip 4.6.1— GHSA-q7v9-x93c-xqv3 (high), fixed in 9.0.0crates:zip 4.6.1— RUSTSEC-2026-0367 (high), fixed in 9.0.0pypi:pillow 12.3.0— GHSA-22hg-r758-rrw9 (high), fixed in 13.0.0
22 more findings not listed here.
You need first
- Runtimes:
cuda 12.x/13.x - System packages:
cmake,ninja - Apple silicon only
What it does
pickfit hasn’t run it yet, so these come from the README only.
- 512K context with 4-bit KV cache and speculative decodingNot tested
- OpenAI and Anthropic compatible server for coding agentsNot tested
- Support for DeepSeek-V4.1, GLM-5.3-Flash and Qwen3.8 models in one engineNot tested
Good for
- run DeepSeek-V4.1-Flash 552B as local coding agent on gaming PC
- serve frontier MoE models via OpenAI/Anthropic-compatible API
An alternative to Strata.