LeMario: Training a JEPA World Model on Super Mario Bros
A developer details their attempt to train a Joint-Embedding Predictive Architecture (JEPA) model on Super Mario Bros to learn world dynamics. While the model successfully predicted short-term game frames, it failed to learn long-term planning or goal-oriented navigation, serving as a postmortem on AI world modeling.
I wanted to reproduce LeWorldModel , a small Joint-Embedding Predictive Architecture (JEPA) that learns world dynamics from pixels and actions. The original paper used it for reward-free planning in Push-T. But, since I loved video games, and at the same time wanted to learn more deeply about LeCun's JEPA architecture, I decided to write the whole architecture from scratch and train it on Super Mario Bros.
Get the full story
Sign up for Headlinne to unlock AI insights, political bias analysis, and your personalized news feed.
Create free accountAlready have an account? Sign in