ROUTEAI infra
JEV vs. GPT-5 on Banking77 Dataset
This project compares the performance and cost of JEV against GPT-5 on the Banking77 dataset, finding GPT-5 to be more performant but significantly more expensive.
Does JEV really save the cost or does it come with a trade-off? I ran the experiment on the Banking77 dataset on Hugging Face.
The results? GPT -5 beat JEV by 3.2%, but at what cost? 32X. Yes, 32X
I also ran a cascade analysis(JEV + GPT5), check it out!! x.com/i/article/2101702899076411392




