pickfit

BrowseLocal AI tools

quantpicker

Measures GGUF quants on your GPU for speed and quality loss to pick the fastest acceptable one.

Tested on macOS and Linux

Use it

macOS arm64

You need first

  • A GPU is optional
  • Needs the network
  • Keys or accounts: HF_TOKEN
  1. install quantpicker via uv tool install

    uv tool install quantpicker

Check that it works

quantpicker search qwen3 8b 2>&1

The output should contain “Qwen/Qwen3-8B-GGUF”.

First thing to try

quantpicker search qwen3 8b 2>&1

Run quantpicker search <model name> to find GGUF repos on Hugging Face.

Linux x86_64

You need first

  • A GPU is optional
  • Needs the network
  • Keys or accounts: HF_TOKEN
  1. install quantpicker via uv tool

    uv tool install quantpicker

Check that it works

quantpicker --help 2>&1

The output should contain “Measures which GGUF quant”.

First thing to try

quantpicker search qwen3 8b 2>&1

Run quantpicker search <model name> to find GGUF repos on Hugging Face.

What it does

  • Measure GGUF quants and pick the fastest one
    How to use it
    1. Run quantpicker <repo> --quants Q4_K_M,Q5_K_M --chunks 5 --reps 1 with a Hugging Face GGUF repo.
    2. Compare the tok/s speed and mean KLD shown for each quant.
    Tested
  • Search Hugging Face for GGUF repos
    How to use it
    1. Run quantpicker search <your search words>.
    2. Read the table of repos with their downloads and likes.
    Tested
  • List quants and see which fit your GPU
    How to use it
    1. Run quantpicker list <repo>.
    2. Check the size and fits columns, and which quants are measured by default.
    Tested

How far pickfit got

macOS arm64

  1. Installs
  2. Starts
  3. 2 of 3 features work
  4. Needs the network

Linux x86_64

  1. Installs
  2. Starts
  3. 3 of 3 features work
  4. Needs the network

Windows: the project says it runs there; pickfit hasn’t tried it.

Good for

  • measure GGUF quants and pick fastest within quality limit
  • find GGUF repos on Hugging Face
  • list quants and check what fits GPU memory without downloading

How pickfit tested it

Each run starts from a clean machine and follows the steps above. How pickfit verifies

macOS arm64

Its main function works

  • Replayed from scratch
  • Needed the network
  • Checked on 1 Nov 2026
  • Version 0.1.0

Linux x86_64

Its main function works

  • Replayed from scratch
  • GPU: Tesla T4
  • Needed the network
  • Checked on 1 Nov 2026
  • Version 0.1.0

Differences the test machine hit

  • README: pip install quantpicker
    In the test: uv tool install quantpicker (isolated install avoids PEP 668 read-only system)
  • README: quantpicker unsloth/Qwen3-8B-GGUF
    In the test: ran measure on bartowski/SmolLM2-135M-Instruct-GGUF with --quants Q4_K_M,Q5_K_M --chunks 5 --reps 1 to fit box time/disk; README example uses unsloth/Qwen3-8B-GGUF (~3-8 GiB per quant)

How to read a tool card

Stitching
pickfit installed this tool itself. Everything under the stitches comes from that run. A tool pickfit has not run never gets stitches.
Verified on your OS
The install steps ran on the system you chose. “Ran on Linux only” means it has not been run on yours yet.
macOS, Linux and WindowsWhere it ran
Green OS marks: pickfit ran the install steps there. Grey ones: the README says it runs there, and pickfit has not tried.
How far the run got
Installs and starts, its main function works, its service answers, it produces model output. A window means a desktop app opened; a plug, an MCP client used it. The mark sits beside the run’s result, under “Why it fits and how we know” and in “How pickfit tested it”.
Visual check
pickfit looked at screenshots of the app. Green: it looks right. Amber with a number: things that look wrong; open it to see them. Grey and dashed: not checked yet.
Known vulnerabilities
Known high or critical vulnerabilities (OSV.dev) in what it installs. Green: none known. Red with a number: how many; open it for the list, and read it before you install. Grey and dashed: not checked, which does not mean safe.
About the run
The day it ran, and the version that ran.
Source of a reason
Every reason a pick fits rests on one profile field. Open the reason to see the field and the value it relies on.
Hidden gem
High quality, little known.
Quality and popularity
Two scores out of 100. Quality: how well it installed and worked when pickfit tried it, and how good its install docs and upkeep are. Popularity: from stars, downloads and Hacker News.
Features checked
Of the main features the README advertises, how many the run actually exercised (green), and how many failed (red). Grey ones were not checked, and the card says why.
Not verified
A well-known tool Fitz mentions from general knowledge. No run record, no steps, no score.