mdma
LLM inference engine for owned hardware with custom kernels, exact memory admission and private federation.
Tested on LinuxKnown vulnerabilities
Use it
Before you install: known vulnerabilities
pickfit found 6 known high or critical vulnerabilities in the packages a fresh install brings (OSV.dev, 3 Nov 2026). Weigh this before you install it.
crates:zip 8.6.0zip: Critical Parser Differential & Security Control Bypass via Dual-Header Inconsistencies (Zip Cloaking) Leading to Arbitrary File Overwrite & RCE (GHSA-m665-v7pm-7grj, critical, fixed in 9.0.5)
See 5 more
crates:zip 8.6.0— RUSTSEC-2026-0369 (critical), fixed in 9.0.0crates:zip 8.6.0— GHSA-9hj8-73fh-9963 (high), fixed in 9.0.0crates:zip 8.6.0— GHSA-hjqx-j4rw-g7xv (high), fixed in 9.0.0crates:zip 8.6.0— GHSA-q7v9-x93c-xqv3 (high), fixed in 9.0.0crates:zip 8.6.0— RUSTSEC-2026-0367 (high), fixed in 9.0.0
Linux x86_64
You need first
- Runtimes:
Rust 1.99+ - A GPU is optional
These steps ran from a folder named work in the home folder, which already existed. Make it and run them from there:
mkdir -p "$HOME/work" && cd "$HOME/work"git clone the mdma source (depth 1) into work/src and cargo build --release --features cli,service (about 9 minutes)
cd "$HOME"/work && git clone --depth 1 https://github.com/seuros/mdma src && cd src && cargo build --release --features cli,service
Verified in pickfit: the commands exactly as its sandbox ran them
For the record only: they name the sandbox's home, /home/sbx.
cd /home/sbx/work && git clone --depth 1 https://github.com/seuros/mdma src && cd src && cargo build --release --features cli,servicecd /home/sbx/work/src && target/release/mdma --versioncd /home/sbx/work/src && target/release/mdma infoCheck that it works
cd "$HOME"/work/src && target/release/mdma --versionThe output should contain “mdma 0.6.0”.
First thing to try
cd "$HOME"/work/src && target/release/mdma infoWhat it does
- Run LLMs on CPU, ROCm, Vulkan, CUDA, MetalTested
- Exact memory admission before model loadingTested
- Serve models over mTLS gRPCTested
- Federate inference across trusted peersNot tested
How far pickfit got
Linux x86_64
- Installs
- Starts
- 3 of 4 features work
- Works offline
macOS: the project says it runs there; pickfit hasn’t tried it.
Good for
- inventory hardware of a machine
- smoke-test compiled backends on a machine
- estimate whether a model fits before loading
- run local greedy text generation from a GGUF
- serve models over mTLS gRPC server
How pickfit tested it
Each run starts from a clean machine and follows the steps above. How pickfit verifies
Linux x86_64
Its service answers requests
- Replayed from scratch
- Works offline
- Checked on 16 Nov 2026
- Version mdma 0.6.0
Differences the test machine hit
- README: cargo build --release --features cli,service (run in the repository root)
In the test: The work dir had only README.md, so the source had to be cloned first: git clone https://github.com/seuros/mdma, then build inside it. The build took about 9 minutes on this box. - README: Rust 1.99+ (mise.toml pins it)
In the test: The build succeeded with the box's Rust 1.100.0 for the cli,service feature set; the 1.99 requirement was not tested separately. - README: mdma doctor smoke-tests compiled backends
In the test: Only cpu was built and ready. Doctor also printed warnings that dmidecode and lspci are missing (no root, no pciutils); these are warnings, not failures. - README: target/release/mdma-run /path/to/model.gguf "The capital of France is" 16
In the test: Worked as written with the stories260K GGUF on CPU; output is greedy text.