Jev AI Assistant Reranker
Redocly@Redocly
Jev is an AI Assistant reranker that has been deployed to production, showing significant improvements in speed and cost efficiency.
We just shipped @typesafeai's Jev to prod as our AI Assistant's reranker.
(it's under feature flag only for selected customers still)
The early numbers are promising:
⚡ 3.3× faster (390 ms vs 1.29 s p50)
📉 slowest call 0.5 s vs 3.1 s
💸 55% cheaper
✅ 0 errors
If numbers hold over the weekend we'll turn it on for everyone next week!