Llama GUI
Local launcher and control panel for configuring and running llama.cpp servers.
Tested on Linux
Use it
Linux x86_64
You need first
- Runtimes:
Python 3.9+
Download online installer script for reading
curl -fsSL https://raw.githubusercontent.com/thomas9120/LLama-GUI/main/online_installers/install-online.sh -o /tmp/install-online.shDownload installer sub-scripts for reading
curl -fsSL https://raw.githubusercontent.com/thomas9120/LLama-GUI/main/install.sh -o /tmp/gui_install.sh && curl -fsSL https://raw.githubusercontent.com/thomas9120/LLama-GUI/main/mac_linux_start.sh -o /tmp/gui_start.shClone repo and install venv dependencies via installer
LLAMA_GUI_NO_START=1 sh /tmp/install-online.sh
Where the README and reality differ
- README: LLAMA_GUI_HOST=0.0.0.0 LLAMA_GUI_PORT=5240 python server.py
What worked: use ~/LLama-GUI/.venv/bin/python server.py after ./install.sh creates the venv
Check that it works
curl -fsSL http://127.0.0.1:5240/api/statusThe output should contain “available_backends”.
First thing to try
cd ~/LLama-GUI && LLAMA_GUI_HOST=0.0.0.0 LLAMA_GUI_PORT=5240 .venv/bin/python server.pycurl -fsSL http://127.0.0.1:5240/api/statusStart the server, then open http://127.0.0.1:5240 in your browser to reach the control panel.
What it does
- Install prebuilt llama.cpp releases for your backendNot shown working
- Launch llama-server or llama-cliNot tested
- Chat with streaming Markdown replies and web searchNot tested
- Benchmark models with llama-bench and llama-perplexityNot tested
How far pickfit got
Linux x86_64
- Installs
- Starts
- 0 of 4 features work
- Works offline
macOS and Windows: the project says it runs there; pickfit hasn’t tried it.
Good for
- install prebuilt llama.cpp releases by backend
- launch llama-server or llama-cli from Quick Launch or Configure
- chat with streaming Markdown and optional web search
- benchmark with llama-bench and llama-perplexity
- manage launch presets and switch server presets
How pickfit tested it
Each run starts from a clean machine and follows the steps above. How pickfit verifies
Linux x86_64
Its service answers requests
- Replayed from scratch
- Works offline
- Checked on 30 Oct 2026
Differences the test machine hit
- README: no --version/--help documented; tool is a browser UI server
In the test: server ignores --help and starts normally (had to be killed after 30s); no --version flag exists