ROUTEAI infra
JEV-Backed Model Routing
This project experiments with JEV-backed model routing, where an initial prompt is mapped to an evaluation, and then the model with the best cost and completion time for that evaluation is chosen.
experimenting with jev-backed model routing, opening prompt gets mapped to an eval, then choose which model has best cost / completion time for eval, can auto decide or can expose to user the cost latency tradeoff
github.com/gakonst/nanocodex/pull/436




