CHOOSEBrowser & web
Fast LLM Browser Plugin
This project builds a browser extension that categorizes feeds quickly using Jev from Home - TypeSafe AI, with a fallback to local Ollama for low-confidence predictions.
TakeLow confidence scores instantly trigger a local Ollama fallback.
Okay so generative LLMs are too slow for browser plugins. I built an extension using Jev from Home - TypeSafe AI typesafe.ai It categorizes feeds in 70 to 500 milliseconds. Low confidence scores instantly trigger a local Ollama fallback. This is how you build fast plugins without burning cash.
