CHOOSEConsumer & creative
Jev Text Generation Test
This project tests the text generation capabilities of Jev by attempting to reconstruct Shakespeare's "All the world's a stage" using greedy decoding and beam search.
TakeNaturally, I tried to make it reconstruct Shakespeare’s “All the world’s a stage.” I gave Jev every word from the poem and let it choose the next one, word by word.
Pattern✦ Autoregressive text generation loop
Okay, @typesafeai released Jev and said it can’t write.
Naturally, I tried to make it reconstruct Shakespeare’s “All the world’s a stage.”
I gave Jev every word from the poem and let it choose the next one, word by word.
How far did it get?
- Greedy decoding: 10% of poem reconstructed
- Beam search: made things worse -- 5.7%
So, yes: Jev really doesn’t generate text.
