Jev Reranker
Dmitry Ishkov ๐ค๐๐ค@swe_dima
This project utilizes Jev as a reranker, offering a faster and cheaper alternative to Gemini Flash Lite with comparable performance in evaluations.
Patternโฆ zero-shot reranking for search
My recent use case for @typesafeai Jev is a reranker.
In my evals it's only slightly dumber than Gemini flash lite, but much faster and cheaper.
Of course had to put it behind a circuit breaker. Who knows how reliable the API is... ๐คทโโ๏ธ
Related builds
Vectorless RAG with Jev
This project introduces a novel approach to Retrieval Augmented Generation (RAG) that replaces traditional embedding methods with a structured, table-of-contents-based navigation system, significantly improving speed and reducing costs by offloading non-generative tasks to Jev.
