DETECTAI infra
Jev vs. GPT-5.6 Luna On-Call Log Page Decision
jalil@reachjalil
This project compares the performance and cost of Jev against GPT-5.6 Luna for deciding whether to page on-call for a log, with Jev achieving 100% recall and precision at a significantly lower cost.
Asked @typesafeai Jev vs GPT-5.6 Luna: should this log page on-call?
1 Jev boolean, fire if p≥0.50.
Jev: 100% rec / 100% prec / $0.06
Luna: 96.2% / 100% / $0.32 (~5× the bill)
Dataset + details in the thread ↓