OTHERAI infra
OpenJev SGLang API
Eric Zhang@ekzhang1
0:09A Jev-compatible public API that runs an open model (Qwen3.6-35B-A3B) and uses SGLang radix cache for efficient parallel generation.
Inspired by @typesafeai , here is a Jev-compatible public API to play with
It runs a comparable open model (Qwen3.6-35B-A3B), and just uses SGLang radix cache to preserve the prefill reuse / really fast parallel systemone generation - 64 tasks in <1s.
github.com/ekzhang/openjev-sglang x.com/ekzhang1/status/2100651678110515383/