SCOREAgents & automation
Jev Decision Accuracy Analysis
Giuseppe Cannizzaro@cannizdolphin
This project analyzes the accuracy of Jev, an AI tool, across 11,700 decisions, evaluating its confidence levels against actual outcomes.
I tested Jev (@typesafeai) on 11,700 decisions. Cost: $0.59.
When it says "90% sure" it's right 81.6% to 99.8% of the time, depending on what you ask.
Code, every prediction and the charts are open source. Link inside. x.com/i/article/2101632070950764545