ROUTEAI infra
Experimental Model Router with Jev
Engo@EngoDev
An experimental model router for PidotDev that uses Jev as a decision-maker to isolate work into logical threads and price various operational costs.
I made an experimental model router for @pidotdev using Jev as the decision maker.
It's not a generic "pick a cheaper model" router. It isolates work into logical threads and prices cache reads/writes, cold context, expected output + the cost of switching back.
@CompleteSkeptic @typesafeai This wouldn't of been possible without Jev, it's an amazing primitive to make software with 💪🏻