Cluaiz
Local Rust engine that runs GGUF and ONNX models for chat, vision, speech and embeddings.
Tested on macOS and Linux
Use it
macOS arm64
You need first
- A GPU is optional
Download install script without piping to shell
curl -fsSL https://cluaiz.com/install.sh -o /tmp/cluaiz-install.sh && ls -l /tmp/cluaiz-install.sh && wc -c /tmp/cluaiz-install.shInstall mac-arm64 core with install script
sh /tmp/cluaiz-install.sh
Check that it works
export PATH="$HOME/.cluaiz/bin:$PATH" && cluaiz --versionThe output should contain “cluaiz 0.1.0”.
First thing to try
mkdir -p ~/models && curl -fL -o ~/models/stories260K.gguf https://huggingface.co/ggml-org/test-model-stories260K/resolve/main/stories260K-f32.gguf && ls -l ~/models/stories260K.ggufexport PATH="$HOME/.cluaiz/bin:$PATH" && cluaiz show ~/models/stories260K.ggufAdd ~/.cluaiz/bin to your PATH, then run cluaiz show <model.gguf> to inspect a local GGUF model.
Linux x86_64
You need first
- A GPU is optional
Download installer to /tmp/install.sh for inspection
curl -fsSL https://cluaiz.com/install.sh -o /tmp/install.sh && wc -c /tmp/install.sh && head -c 4000 /tmp/install.shInstall Cluaiz release into ~/.cluaiz/bin
sh /tmp/install.sh
Where the README and reality differ
- README: curl -fsSL https://cluaiz.com/install.sh | sh
What worked: download the script first (curl -fsSL https://cluaiz.com/install.sh -o /tmp/install.sh), read it, then run sh /tmp/install.sh - README: run cluaiz directly after install
What worked: binary installs to ~/.cluaiz/bin, which is not on PATH; each use needs export PATH="$HOME/.cluaiz/bin:$PATH" before cluaiz
Check that it works
export PATH="$HOME/.cluaiz/bin:$PATH" && cluaiz --versionThe output should contain “cluaiz 0.1.0”.
First thing to try
export PATH="$HOME/.cluaiz/bin:$PATH" && cluaiz statusAdd ~/.cluaiz/bin to your PATH, then run cluaiz show <model.gguf> to inspect a local GGUF model.
What it does
These come from the README; pickfit didn’t check them one by one.
- Chat with GGUF modelsNot tested
- Automatically place models on GPU, RAM or CPUNot tested
- Turn text into speechNot tested
- Transcribe speech to textNot tested
How far pickfit got
macOS arm64
- Installs
- Starts
- Answers requests
- Works offline
Linux x86_64
- Installs
- Starts
- Answers requests
- Works offline
Other systems
Windows: the project says it runs there; pickfit hasn’t tried it.
Good for
- chat with a local GGUF model in the terminal
- serve models over an OpenAI-compatible local API
- transcribe speech to text with local Whisper models
- generate text and image embeddings locally
- ingest documents and images into text or vectors
An alternative to llama.cpp.
How pickfit tested it
Each run starts from a clean machine and follows the steps above. How pickfit verifies
macOS arm64
Its service answers requests
- Replayed from scratch
- Works offline
- Checked on 29 Oct 2026
- Version 0.1.0
Differences the test machine hit
- README: curl -fsSL https://cluaiz.com/install.sh | sh then use cluaiz
In the test: export PATH="$HOME/.cluaiz/bin:$PATH" before using cluaiz; installer only appends to shell rc files - README: cluaiz show unsloth/Qwen3-4B-GGUF
In the test: cluaiz show accepts a local path (cluaiz show ~/models/stories260K.gguf); registry id would require a large download - README: cluaiz serve
In the test: cluaiz serve takes no model argument; select local file first with cluaiz model set-chat ~/models/stories260K.gguf
Linux x86_64
Its service answers requests
- Replayed from scratch
- Works offline
- Checked on 28 Oct 2026
- Version 0.1.0