CONTROLAgents & automation
Jev vs. GPT-6 Astra Robot Task Comparison
This project compares the performance and cost of Jev and GPT-6 Astra on a robot task, where Jev significantly undercuts Astra in cost and waiting time while performing a similar task.
A cheap model looked like it beat GPT-6 on a robot clip. Read the test first.
@openroboto ran one MuJoCo trial: move an apple onto a plate. Not the SN80 contest.
@typesafeai Jev and GPT-6 Astra both finished.
Jev cost $0.019. Astra cost $5.93. That is about 1/315 of the API bill.
Jev also used about 26% of the wall time, including API waits. Robot-motion time was close: 36s vs 34s. Astra used fewer steps (106 vs 113).
GPT-4.1 mini ran out of steps.
The catch: the models were not driving a robot in the usual sense.
They only chose a goal, a tiny X/Y/Z nudge, and gripper open or close. Shared code did the motion.
No camera. One try.
So Jev looks like a bargain for repeated small choices.
It did not beat Astra at the task. It beat Astra on cost and waiting time.
This clip does not settle which model is a better robot brain.