Microsoft announces Muse AI, a first-of-its-kind generative AI model that can generate a game environment based on visuals, players' controller actions, or both
Maybe Microsoft should spend more time figuring out how to quit screwing over their successful studios … X: @xboxwire : Introducing Muse, a new kind of generative AI model that lets you play and create. From developer ideation to one day supporting game preservation, Muse holds potential to unlock new possibilities: https://news.xbox.com/... Mustafa Suleyman / @mustafasuleyman : Gaming is coming to Copilot! Get your keyboards/controllers ready, I can't wait for you to try it out. Shu Ishida, Ph.D. / @alacremeox : Super excited to share that the paper “World and Human Action Models towards gameplay ideation” is now published in Nature!🌐🎮 Weights released on @huggingface (200M and 1.6B) Paper: https://nature.com/... Model: https://huggingface.co/... A massive thank you to the team!🙏🥰 @protosphinx : Satya Nadella proud product poasting vindicates my stands that every CEO should post about their product all the time. Like all the time. And if they don't or can't then they shouldn't be product CEOs. @coreybrickley : ah yeah you know how like the main complaint about videogames today is that they don't feel generic and directionless enough Kache / @yacinemtb : Wait they actually dropped the literal AI model, research and code? What?? Holy shit! @reach_vb : Microsoft just dropped Muse - a first of its kind generative AI model trained on Ninja Theory's multiplayer battle arena game, Bleeding Edge 🔥 Model weights and code out too! Make your own gaming experience is coming sooner than you'd think! 💥 [video] @natureportfolio : A paper in @Nature presents a generative AI tool that could help video game designers to craft gameplay iteratively. The AI model generated robust 3D worlds that obeyed the mechanics of the video game they were designed for. https://go.nature.com/4b88vCk [video] Lukas Schäfer / @lukasschaefer96 : Awesome to see this released and out in the world now. Huge congrats to the entire team! It was super cool to see the vision come to life as an intern with everything coming together 👏 Katja Hofmann / @katjahofmann : Today in Nature: our research on world and human action models (WHAM) - generative ai models of video games, aimed towards supporting game creatives in gameplay ideation : https://www.nature.com/... - huge congrats to everyone who made this happen, I couldn't be more proud 🥳 @teknium1 : They dropped it but the repo isnt called muse its called WHAM..? Satya Nadella / @satyanadella : If you thought AI-generated text, images, and video were cool, just imagine entire interactive environments like games! [video] Tom Warren / @tomwarren : Microsoft's Xbox AI era starts today with a model that can generate gameplay. The Muse model was trained on Ninja Theory's Bleeding Edge, and Xbox chief Phil Spencer says it could improve classic games and bring them to modern hardware. Full details 👇https://www.theverge.com/ ... Tom Warren / @tomwarren : the most interesting part of Microsoft's gaming AI model is how it could impact Xbox game preservation 👀 https://www.theverge.com/... [image] Peter Lee / @peteratmsr : That's right — AI not only can learn the languages of humans, but also the mechanics of virtual worlds! Rowan Cheung / @rowancheung : NEW: Microsoft just unveiled Muse! It's an AI model that can generate minutes of cohesive gameplay from a single second of frames and controller actions. The implications for gaming are absolutely massive: [image] TuringPost / @theturingpost : .@MSFTResearch Game Intelligence joins forces with game developers to expand the horizons of creativity and ideation. They introduced Muse, World and Human Action Model (WHAM), which is the first GenAI model that can generate game visuals and controller actions. This marks [video] @msftresearch : Nature published Microsoft research detailing our WHAM, an AI model that generates video game visuals & controller actions. We're releasing the model weights, sample data & WHAM Demonstrator on Azure AI Foundry to enable researchers to build on this work. https://www.microsoft.com/... [image] @wario64 : Xbox: Introducing Muse: Our first generative AI model designed for gameplay ideation https://www.youtube.com/... https://www.microsoft.com/... [image] Rowan Cheung / @rowancheung : Microsoft's research is published in @Nature today. They will also be releasing Muse's model weights, training data samples, and sharing the testing interface. Another win for open-source 🙌 Amira Zairi / @azed_ai : This is wild! Imagine a world where AI can conjure entire game levels from a single spark of inspiration! Microsoft's new Muse model is turning that dream into reality, potentially revolutionizing game development as we know it. [video] Peter Lee / @peteratmsr : GenAI can develop a practical understanding of real and virtual worlds, just like it does for language. This has applications in videogame development and more. The AI model, called Muse, is described in detail in @Nature and is coming to Copilot Labs. https://blogs.microsoft.com/ ... @howfxr : Microsoft unveils Muse, a new AI model that generates gameplay visuals and understands game physics. Trained on 7 years of gameplay data, it aims to assist developers and potentially optimize classic games. https://www.theverge.com/... Knoebel / @knoebelbroet : Microsoft announced Muse, a generative Ai model for gameplay. Muse was trained on Ninja Theory's ‘Bleeding Edge’. “including the opportunity to make older games accessible to future generations of players across new devices and in new ways.” https://news.xbox.com/... [image] Rowan Cheung / @rowancheung : From a single second of gameplay + controller inputs, Muse can create multiple unique, playable sequences that follow actual game physics, mechanics, and rules. The version shown in research was trained on just a single game (Bleeding Edge): [image] Rowan Cheung / @rowancheung : Muse is the first World and Human Action Model (WHAM), and the scale of training is mind-blowing: — Trained on 1B+ gameplay images — Used 7+ YEARS of continuous gameplay data — Learned from real Xbox multiplayer matches [image] Forums: Hacker News : Xbox pushes ahead with new generative AI r/gamingnews : Xbox Pushes Ahead With New Generative AI. Developers Say ‘Nobody Will Want This’ r/technews : Xbox Pushes Ahead With New Generative AI. Developers Say ‘Nobody Will Want This’ r/singularity : Advancing game ideation with Muse: the first World and Human Action Model (WHAM) r/gaming : Microsoft's Xbox AI era starts with a model that can generate gameplay r/xbox : Introducing Muse: Our First Generative AI Model Designed for Gameplay Ideation r/Games : Empowering Creators and Players With Muse, a Generative AI Model for Gameplay - Xbox Wire r/xbox : Empowering Creators and Players With Muse, a Generative AI Model for Gameplay
Introducing Muse, a new kind of generative AI model that lets you play and create. From developer ideation to one day supporting game preservation, Muse holds potential to unlock new possibilities: https://news.xbox.com/...
Super excited to share that the paper “World and Human Action Models towards gameplay ideation” is now published in Nature!🌐🎮 Weights released on @huggingface (200M and 1.6B) Paper: https://nature.com/... Model: https://huggingface.co/... A massive thank you to the team!🙏🥰
Satya Nadella proud product poasting vindicates my stands that every CEO should post about their product all the time. Like all the time. And if they don't or can't then they shouldn't be product CEOs.
Microsoft just dropped Muse - a first of its kind generative AI model trained on Ninja Theory's multiplayer battle arena game, Bleeding Edge 🔥 Model weights and code out too! Make your own gaming experience is coming sooner than you'd think! 💥 [video]
A paper in @Nature presents a generative AI tool that could help video game designers to craft gameplay iteratively. The AI model generated robust 3D worlds that obeyed the mechanics of the video game they were designed for. https://go.nature.com/4b88vCk [video]
Awesome to see this released and out in the world now. Huge congrats to the entire team! It was super cool to see the vision come to life as an intern with everything coming together 👏
Today in Nature: our research on world and human action models (WHAM) - generative ai models of video games, aimed towards supporting game creatives in gameplay ideation : https://www.nature.com/... - huge congrats to everyone who made this happen, I couldn't be more proud 🥳
Microsoft's Xbox AI era starts today with a model that can generate gameplay. The Muse model was trained on Ninja Theory's Bleeding Edge, and Xbox chief Phil Spencer says it could improve classic games and bring them to modern hardware. Full details 👇https://www.theverge.com/ ...
NEW: Microsoft just unveiled Muse! It's an AI model that can generate minutes of cohesive gameplay from a single second of frames and controller actions. The implications for gaming are absolutely massive: [image]
.@MSFTResearch Game Intelligence joins forces with game developers to expand the horizons of creativity and ideation. They introduced Muse, World and Human Action Model (WHAM), which is the first GenAI model that can generate game visuals and controller actions. This marks [video…
Nature published Microsoft research detailing our WHAM, an AI model that generates video game visuals & controller actions. We're releasing the model weights, sample data & WHAM Demonstrator on Azure AI Foundry to enable researchers to build on this work. https://www.microsoft.co…
Microsoft's research is published in @Nature today. They will also be releasing Muse's model weights, training data samples, and sharing the testing interface. Another win for open-source 🙌
This is wild! Imagine a world where AI can conjure entire game levels from a single spark of inspiration! Microsoft's new Muse model is turning that dream into reality, potentially revolutionizing game development as we know it. [video]
GenAI can develop a practical understanding of real and virtual worlds, just like it does for language. This has applications in videogame development and more. The AI model, called Muse, is described in detail in @Nature and is coming to Copilot Labs. https://blogs.microsoft.com…
Microsoft unveils Muse, a new AI model that generates gameplay visuals and understands game physics. Trained on 7 years of gameplay data, it aims to assist developers and potentially optimize classic games. https://www.theverge.com/...
Microsoft announced Muse, a generative Ai model for gameplay. Muse was trained on Ninja Theory's ‘Bleeding Edge’. “including the opportunity to make older games accessible to future generations of players across new devices and in new ways.” https://news.xbox.com/... [image]
From a single second of gameplay + controller inputs, Muse can create multiple unique, playable sequences that follow actual game physics, mechanics, and rules. The version shown in research was trained on just a single game (Bleeding Edge): [image]
Muse is the first World and Human Action Model (WHAM), and the scale of training is mind-blowing: — Trained on 1B+ gameplay images — Used 7+ YEARS of continuous gameplay data — Learned from real Xbox multiplayer matches [image]