CONTROLAgents & automation
Marionette and Jev for Flutter Game Interaction
Mateusz Wojtczak 💙@matiwojt
0:12Marionette interacts with a Flutter game by reading its widget tree and tapping elements, while Jev makes decisions on how to interact.
I ran @LeanCodePl Marionette with @typesafeai Jev.
One sentence: "win the game."
A Flutter game it had never seen. 5 puzzles, rules only on screen. It read the code, flipped the right switches, tapped blue, red, green. 🤯
9.7 s. $0.0012. ⚡
No LLM involved.
Marionette reads the widget tree and taps, Jev decides 🧵