CHOOSEAI infra
Jev Evaluation Test
Stuart Sim@StuSim
0:14This project tests the Jev system by sending an evaluation request for character type validation.
First quick test of Jev from @typesafeai
Install via @vercel gateway
Sending evaluation (input validation passed):
{
"model": "typesafe-ai/jev",
"state": {
"character": "2"
},
"questions": {
"kind": {
"type": "choice",
"instructions": "Is the character a number or a letter?",
"criteria": {
"number": "The character is a single numeric digit from 0 through 9.",
"letter": "The character is an uppercase or lowercase English letter from A through Z."
}
}
},
"maxRetries": 0
}
[Jev 60e7bb68] Evaluation received:
{
"choice": "number",
"probabilities": {
"number": 1,
"letter": 0
},
"durationMs": 1437,
"tokens": {
"input": 342,
"output": 31,
"total": 373
}
}