VERIFYBrowser & web

Jev vs. OSS Model Evaluation

Karina Q@karinadoteth

3.6K views · 16 likes · 5 replies · 3 reposts on X · does not affect score

This project evaluates Jev and its OSS variants (Nimble, Bonsai) for design and data verification use cases, finding Jev and its variants to be less proficient in arithmetic operations compared to OSS models.

Related builds

Jev Decision Model

Jev is a typed decision model that returns a probability for a given state (question, answer, evidence) instead of generating prose or structured data, making it faster and cheaper than traditional AI judges.

Jose Luis Latorre | #MVP | #K6 | @DotNetZurich@joslat

40 views on XJev score 79

Automated Codebase Conformance Checking

This project uses Jev to automatically check code changes against predefined implementation plans and Architecture Decision Records (ADRs), identifying discrepancies and ensuring adherence to specifications.

Skolte@jskolte

111 views on XJev score 74

Invalidate: Agent Memory Management

Invalidate is a system that manages agent memories by checking the validity of stored memories against new events, marking stale memories without rewriting them.

Tejas Chopra@chopra_tejas

290 views on XJev score 73

Jev: A Judgment Layer for Development

Jev acts as a judgment layer in the development loop, sitting between the developer's assessment of completion and handover to a maintainer, identifying potential issues and inconsistencies.

StudioXRadio@StudioXRadio

165 views on XJev score 72