Progression

AlayaWorld is a full-stack, open-source video world model that supports 720p, 24 FPS streaming video generation with camera control and text-driven event generation.

AlayaWorld is built around four core properties — interaction, consistency, stability, and runtime. 🎮 Interaction Two control channels: a rendered 3D cache with lightweight AdaLN camera modulation for grounded, trajectory-aware navigation, and chunk-level prompt switching to introduce new events mid-generation. 🧠 Consistency Two forms of complementary memory: an explicit 3D cache reprojected to the queried view for spatial recall, plus a compressed frame-history embedding for temporal continuity, so revisited places stay recognizable. 🛡️ Stability Long-horizon stability from training on drifted histories and an error bank that re-injects accumulated artifacts into both memory and target, preventing errors from compounding over minute-long rollouts. ⚡ Runtime Real-time interaction via few-step DMD distillation and short temporal chunks, with prompt switching at chunk boundaries to minimize both visual and semantic latency. 

https://github.com/AlayaLab/AlayaWorld/tree/main

https://huggingface.co/AlayaLab/AlayaWorld

Report: https://github.com/AlayaLab/AlayaWorld/blob/main/assets/alayaworld_tech_report_full.pdf