This mixed reality game is a testament to the capabilities of generative AI in game development. Every aspect of this project, including music, scripting, textures, and materials, was generated using AI. The main goal was to evaluate how AI could be leveraged to rapidly build a simple proof of concept. Utilizing advanced technologies like Meta's depth API, the game offers real-time occlusion for both hands and the scene, allowing cubes to seamlessly transition through walls.
- Generative AI Creation: Every component of the game, from the auditory experience to the visual assets, was crafted using generative AI.
- Real-time Occlusion with Meta's Depth API: Integrates Meta's depth API for enhanced interaction between the player's hands, the cubes, and the environment, enabling objects to move convincingly through and around obstacles in the scene.
- Unity 2022.3.4.f1
- Meta Quest 3 Headset
- Required Packages:
- Meta XR Core SDK (v60.0.0)
- Meta XR Interaction SDK (v60.0.0)
- Meta XR Interaction SDK OVR Integration (v60.0.0)
- Meta Depth API
- Ensure Unity 2022.3.4.f1 is installed on your system.
- Clone the repository to your local machine:
- Open the project in Unity Hub by pointing it to the cloned repo directory.
- Navigate to
Edit -> Project Settings -> XR Plugin Managementand configure the settings for the Meta Quest 3 headset. - Ensure all the required Meta packages are installed and up to date in the Unity Package Manager.
Upon launching the game on your Meta Quest 3 headset, you'll be greeted with a start button. Interact with this button using hand tracking to begin the game. Cubes will start to appear and move towards you, challenging you to punch them as they come. Gold cubes offer bonus points, so keep an eye out for them. This application relies solely on hand tracking for interaction, providing an intuitive and immersive experience.
