Author(s): Jesus Rodriguez
Originally published on Towards AI.
Microsoft Muse Can Design Video Games Based on Your Playing Style
I recently started an AI-focused educational newsletter, that already has over 175,000 subscribers. TheSequence is a no-BS (meaning no hype, no news, etc) ML-oriented newsletter that takes 5 minutes to read. The goal is to keep you up to date with machine learning projects, research papers, and concepts. Please give it a try by subscribing below:
TheSequence | Jesus Rodriguez | Substack
The best source to stay up-to-date with the developments in the machine learning, artificial intelligence, and data…
thesequence.substack.com
Architectural Overview
Muse employs a transformer-based generative model trained on extensive human gameplay data. The model utilizes visuals and controller actions from the Xbox game Bleeding Edge, training current instances at a resolution of 300×180 pixels. The WHAM-1.6B instance of Muse has been trained using over 1 billion images and controller actions, which corresponds to more than 7 years of continuous human gameplay. The foundation of Muse relies on ethically sourced and responsibly used data, ensuring compliance with user agreements and privacy standards.
Capabilities of Muse
- Gameplay Generation: Muse generates complex gameplay sequences.
- Diversity: Assessed quantitatively using the Wasserstein distance, comparing model-generated sequences to human gameplay recordings.
- Persistency: Demonstrated through modified gameplay sequences and observation of the model’s integration of newly introduced elements.
Impact and Future Directions
Muse signifies a significant advancement in utilizing AI for gameplay ideation. By open-sourcing weights and sample data and offering the WHAM Demonstrator executable, Microsoft promotes further exploration and development in this domain.
Conclusion
Muse, the first WHAM, showcases generative AI models’ potential in supporting gameplay ideation. Muse’s architecture, grounded in transformer networks and trained on extensive human gameplay data, enables the generation of consistent, diverse, and persistent gameplay sequences. The project’s multidisciplinary approach and rigorous evaluation protocols underscore its importance. By making Muse accessible to the community, Microsoft fosters innovation and enhances the understanding of generative AI in creating novel, AI-driven game experiences.
Published via Towards AI
FAQs
- Q: What is Muse?
A: Muse is a generative AI model that can design video games based on your playing style. - Q: How does Muse work?
A: Muse uses a transformer-based generative model trained on extensive human gameplay data to generate complex gameplay sequences. - Q: What are the benefits of Muse?
A: Muse enables the generation of consistent, diverse, and persistent gameplay sequences, making it a significant advancement in utilizing AI for gameplay ideation.
