vMLX
Self-hosted inference server for running LLMs, VLMs and image generation on Apple Silicon.
Not verified yetKnown vulnerabilities
How far pickfit got
pickfit hasn’t verified vMLX yet, so there are no tested install steps.
What follows comes from its README only.
Use it
Before you install: known vulnerabilities
pickfit found 45 known high or critical vulnerabilities in the packages a fresh install brings (OSV.dev, 3 Nov 2026). Weigh this before you install it.
npm:dompurify 3.4.14DOMPurify SAFE_FOR_TEMPLATES bypass: split template expressions survive in attached shadow root content on DOM output modes (GHSA-cg2g-xh64-v4q7, critical, fixed in 3.4.17)pypi:certifi 2026.2.25certifi bundles emSign root CAs with compromised intermediate CA keys (GHSA-6q48-6c7w-9gw2, critical, fixed in 2026.10.18)
See 8 more
pypi:pillow 12.3.0— GHSA-332p-7hrc-92wf (critical), fixed in 13.0.0pypi:pillow 12.3.0— GHSA-5x8w-8jj5-q52h (critical), fixed in 13.0.0pypi:pillow 12.3.0— GHSA-8g5g-8vmr-9782 (critical), fixed in 13.0.0pypi:pillow 12.3.0— GHSA-v9pv-5gc8-w2m6 (critical), fixed in 13.0.0pypi:pillow 12.3.0— GHSA-w889-685w-c8fh (critical), fixed in 13.0.0pypi:pyjwt 2.12.1— GHSA-ffc3-869f-jxw9 (critical), fixed in 2.14.0npm:dompurify 3.4.14— GHSA-mrv2-3pqr-j5jr (high), fixed in 3.4.17npm:electron 44.3.0— GHSA-jr5w-w6x2-84p9 (high), fixed in 44.9.1
35 more findings not listed here.
What it does
pickfit hasn’t run it yet, so these come from the README only.
- Serve LLMs via OpenAI-compatible APINot tested
- Generate and edit images locallyNot tested
- Reuse KV states for repeated promptsNot tested
- Handle concurrent requests with batchingNot tested
Good for
- chat with MLX models with streaming
- generate images locally with Flux
- transcribe speech with Whisper
An alternative to Ollama.