pickfit

BrowseLocal AI tools

llmash

Ollama-compatible LLM server and CLI that runs models locally on Windows and Linux.

Tested on Linux

Use it

Linux x86_64

You need first

  • A GPU is optional
  1. download installer script

    curl -fsSL https://raw.githubusercontent.com/omgitsbase/llmash/main/install.sh -o /tmp/llmash-install.sh && wc -c /tmp/llmash-install.sh && echo OK
  2. install llmash via script

    sh /tmp/llmash-install.sh
  3. download tiny GGUF model

    mkdir -p ~/models && curl -fL -o ~/models/stories260K.gguf https://huggingface.co/ggml-org/test-model-stories260K/resolve/main/stories260K-f32.gguf && ls -l ~/models/

Check that it works

llmash --version

The output should contain “llmash version is 0.5.9”.

First thing to try

OLLAMA_MODELS=$HOME/models llmash serve --port 11434
curl -fsSL http://127.0.0.1:11434/api/tags && echo && curl -fsSL http://127.0.0.1:11434/v1/models

Run OLLAMA_MODELS=<models folder> llmash serve --port 11434 to start the server, then send requests to http://127.0.0.1:11434.

What it does

  • Run an Ollama-compatible LLM server
    How to use it
    1. Start the server with OLLAMA_MODELS=<models folder> llmash serve --port 11434.
    2. List models with curl -fsSL http://127.0.0.1:11434/api/tags or curl -fsSL http://127.0.0.1:11434/v1/models.
    3. Chat by posting to http://127.0.0.1:11434/v1/chat/completions with a JSON body giving "model" and "messages".
    Tested
  • Classify text without generating a reply
    How to use it
    1. Start the server with OLLAMA_MODELS=<models folder> llmash serve --port 11434.
    2. Post to http://127.0.0.1:11434/api/classify with JSON giving "model", "state" (your text) and "questions", each with a "type" and "instructions".
    3. Read the probabilities for each question under "answers" in the reply.
    Tested
  • Assemble custom model builds
    Not tested
  • Remove model refusals
    Not tested

How far pickfit got

Linux x86_64

  1. Installs
  2. Starts
  3. 2 of 4 features work
  4. Works offline

Windows: the project says it runs there; pickfit hasn’t tried it.

Good for

  • remove model refusals without changing weights
  • run the LLM server in console
  • find and install a draft model for a model
  • pull model builds from Ollama or Hugging Face
  • check and set model context length up to 4x

An alternative to Ollama and vLLM.

How pickfit tested it

Each run starts from a clean machine and follows the steps above. How pickfit verifies

Linux x86_64

It produces model output

  • Replayed from scratch
  • Works offline
  • Checked on 30 Oct 2026
  • Version 0.5.9

Differences the test machine hit

  • README: curl -fsSL https://raw.githubusercontent.com/omgitsbase/llmash/main/install.sh | sh
    In the test: installer fetches prebuilt llmash tarball and llama.cpp runtime tarball as binaries during the run; they cannot be pre-read

How to read a tool card

Stitching
pickfit installed this tool itself. Everything under the stitches comes from that run. A tool pickfit has not run never gets stitches.
Verified on your OS
The install steps ran on the system you chose. “Ran on Linux only” means it has not been run on yours yet.
macOS, Linux and WindowsWhere it ran
Green OS marks: pickfit ran the install steps there. Grey ones: the README says it runs there, and pickfit has not tried.
How far the run got
Installs and starts, its main function works, its service answers, it produces model output. A window means a desktop app opened; a plug, an MCP client used it. The mark sits beside the run’s result, under “Why it fits and how we know” and in “How pickfit tested it”.
Visual check
pickfit looked at screenshots of the app. Green: it looks right. Amber with a number: things that look wrong; open it to see them. Grey and dashed: not checked yet.
Known vulnerabilities
Known high or critical vulnerabilities (OSV.dev) in what it installs. Green: none known. Red with a number: how many; open it for the list, and read it before you install. Grey and dashed: not checked, which does not mean safe.
About the run
The day it ran, and the version that ran.
Source of a reason
Every reason a pick fits rests on one profile field. Open the reason to see the field and the value it relies on.
Hidden gem
High quality, little known.
Quality and popularity
Two scores out of 100. Quality: how well it installed and worked when pickfit tried it, and how good its install docs and upkeep are. Popularity: from stars, downloads and Hacker News.
Features checked
Of the main features the README advertises, how many the run actually exercised (green), and how many failed (red). Grey ones were not checked, and the card says why.
Not verified
A well-known tool Fitz mentions from general knowledge. No run record, no steps, no score.