Cascadia
Distributes LLM inference across Intel machines with OpenAI-compatible API
Not verified yetKnown vulnerabilities
How far pickfit got
pickfit hasn’t verified Cascadia yet, so there are no tested install steps.
What follows comes from its README only.
Use it
Before you install: known vulnerabilities
pickfit found 3 known high or critical vulnerabilities in the packages a fresh install brings (OSV.dev, 3 Nov 2026). Weigh this before you install it.
crates:openssl 0.10.78rust-openssl has undefined behavior in X509Ref::ocsp_responders for certificates with non-UTF-8 OCSP URLs (GHSA-xp3w-r5p5-63rr, high, fixed in 0.10.79)npm:react-router 7.15.1React Router: Unauthenticated Denial of Service via Inefficient Route Matching (GHSA-chx6-hx7r-mcp5, high, fixed in 7.18.0)
See 1 more
npm:react-router 7.15.1— GHSA-qwww-vcr4-c8h2 (high), fixed in 7.18.2
You need first
- Runtimes:
Rust 1.89+ - System packages:
g++ ≥12 on Linux
What it does
Good for
- serve a model through an OpenAI-compatible API
- shard a model into stages across machines
- discover LAN peers over mDNS
- diagnose OpenVINO GPU visibility issues
- export a HuggingFace model to INT4 shards