kern
Model-agnostic GPU runtime that ships models as verified manifest packages.
Tested on LinuxKnown vulnerabilities
Use it
Before you install: known vulnerabilities
pickfit found 2 known high or critical vulnerabilities in the packages a fresh install brings (OSV.dev, 3 Nov 2026). Weigh this before you install it.
crates:pulldown-cmark 0.13.4Exponential event growth with `ENABLE_WIKILINKS` (RUSTSEC-2026-0414, high, fixed in 0.13.5)
See 1 more
crates:pulldown-cmark 0.13.4— RUSTSEC-2026-0433 (high), fixed in 0.13.6
Linux x86_64
You need first
- Runtimes:
python>=3.10 - System packages:
cuBLAS 13 - A GPU is required
pip install python runtime
pip install kern-llm==0.3.1download install script
curl -fsSL https://kern-baa.pages.dev/install.sh -o /tmp/kern-install.shrun install script for kern binaries
sh /tmp/kern-install.sh
Where the README and reality differ
- README: pip install kern-llm==0.3.1 provides kern usage
What worked: uv tool install fails with 'No executables are provided by package kern-llm'; use pip install for Python runtime and install.sh for binaries - README: pip install kern-llm gives kern command
What worked: pip install kern-llm==0.3.1 installs only Python import and no kern binary; run sh /tmp/kern-install.sh to get kern 0.3.1 and kern-serve
Check that it works
kern --versionThe output should contain “kern 0.3.1 (48e0709, cuda 13.0)”.
First thing to try
git clone --depth 1 https://github.com/pegainfer-project/kern /tmp/kern-src && ls /tmp/kern-src/examples/ && ls /tmp/kern-src/*.tomlpython3 -c "import json; d=json.load(open('/tmp/kern-src/examples/minimal.json')); d.pop('chat',None); json.dump(d, open('/tmp/minimal-nochek.json','w'), indent=2)" && kern verify /tmp/minimal-nochek.jsonRun kern verify <manifest.json> to check a model manifest package.
What it does
These come from the README; pickfit didn’t check them one by one.
- Package models as verified programsNot tested
- Serve models through an OpenAI-compatible serverNot tested
- Test candidate manifests against referencesNot tested
- Benchmark programs on real workloadsNot tested
How far pickfit got
Linux x86_64
- Installs
- Starts
- Main function works
- Works offline
Good for
- generate text with a local model
- serve a model via OpenAI-compatible server
- test a manifest change for regressions
An alternative to vLLM and SGLang.
How pickfit tested it
Each run starts from a clean machine and follows the steps above. How pickfit verifies
Linux x86_64
Its main function works
- Replayed from scratch
- Works offline
- Checked on 30 Oct 2026
- Version 0.3.1
Differences the test machine hit
- README: needs cuBLAS 13 on the loader path
In the test: script warns no cuBLAS 13 on loader path; verify and cut work without it - README: examples manifests verify with released binary
In the test: examples from main branch fail verify on 0.3.1 binary with unknown field chat and unknown variant temperature