LlamaToaster
Sweeps llama.cpp parameters with llama-bench to find best config for your hardware.
Not verified yetKnown vulnerabilities
How far pickfit got
pickfit hasn’t verified LlamaToaster yet, so there are no tested install steps.
What follows comes from its README only.
Use it
Before you install: known vulnerabilities
pickfit found 3 known high or critical vulnerabilities (4 findings, one per affected package version) in the packages a fresh install brings (OSV.dev, 3 Nov 2026). Weigh this before you install it.
npm:brace-expansion 5.0.9brace-expansion: DoS via uncontrolled recursion in parseCommaParts causing stack exhaustion (GHSA-6j4f-fj2g-mc7p, high, fixed in 5.0.10)npm:systeminformation 5.33.10systeminformation vulnerable to Windows command injection in services() through Unicode quotation marks (GHSA-3f7j-7jwc-fxfj, high, fixed in 5.33.16)
See 2 more
npm:brace-expansion 5.0.9— GHSA-qhr7-859c-m2p7 (high), fixed in 5.0.11npm:systeminformation 5.33.15— GHSA-3f7j-7jwc-fxfj (high), fixed in 5.33.16
You need first
- Runtimes:
Node.js 22.22.2+ - Needs the network
What it does
Good for
- sweep llama.cpp parameter space with llama-bench
- find optimal config to paste into llama-server run
- compare benchmark tests side-by-side
- search Hugging Face repos and download GGUF files
- ask AI assistant what limits performance