CHOOSEAI infra

JevArena

Richard Tang@richardt830

61 views · 3 likes · 2 replies · 1 reposts on X · does not affect score

JevArena is an open-source platform for evaluating Jev's performance against other AI judges by allowing users to ask questions, provide answers, select models, and vote blindly on the results.

Related builds

Jev Model Asymmetry Analysis

This project analyzes the Jev model's behavior, revealing that natural language wording induces a significant conviction asymmetry between buy and sell sides, while the model itself is symmetric when presented with symmetric prompts.

Dan Holzrichter@dholzric

83 views on XJev score 79

TypeSafe Computer Use

This project enables a Mac to achieve plain-English goals by combining OCR and the Accessibility tree to drive actions, avoiding large model loops for screenshots.

Yash Chaudhary@YashChaudhary

4 views on XJev score 78

Jev Decision Model Evaluation

Jev, a decision model from TypeSafe, was tested on standard AI problems, answering structured questions with probabilities and performing comparably to or better than other models on single-step tasks, but struggled with sequential reasoning without state information.

Nikhil Deshpande@nikhdesh

94 views on XJev score 76

Play video

Jev: Independent Index for API Pricing

Jev is an independent index that determines the value of an API answer by calculating expected value across a distribution of probabilities, rather than rounding to a fixed tier, enabling fairer and simpler pricing.

Tollstile Lab@tollstile

38 views on XJev score 76