AI Studio: Real-time AI Integration for Unity
AI Studio is an open-source framework for integrating Unity games and applications with AI systems, enabling real-time, speech-driven character dialogue and actions.
AI Studio is an open-source framework for integrating Unity games and applications with AI systems, enabling real-time, speech-driven character dialogue and actions.* This page contains affiliate links, meaning we may earn a small commission if you purchase something through them, at no extra cost. FREE
- Category:
- Tools › Ai-ml-integration
- Developer:
- Dracarys Interactive
- Price:
- FREE
- Favorites:
- 64
- Supported Unity Versions:
- 2021.3.28 or higher
- Current Version:
- 1.0.2
- Download Size:
- 5.63 MB
- Last Update:
- Sep 1, 2023
- Description:
- AI Studio is a flexible framework for integrating Unity games and applications with AI systems. It allows for real-time, speech-driven character dialogue and actions, leveraging OpenAI's GPT-3.5 model's natural language processing capabilities. The framework includes a core action-driven architecture, a basic Scriptable Object framework, and abstracted interfaces for key implementation boundaries. It also features extensions such as streaming and non-streaming audio, continuous and discrete player voice recognition, and conditional dialogue triggering.
To run the sample scenes, several third-party licenses and packages must be acquired and installed. These include an OpenAI API key, integration for the OpenAI API in Unity, a subscription key for the Microsoft Azure Speech Service, and the Microsoft Cognitive Services Speech SDK for Unity package. Additional packages are required for the 'City' sample scenes.
The framework includes example scenes demonstrating integration with various AI models and Unity packages, as well as YouTube videos documenting installation and example scenes. - Technical Details:
- Key features of AI Studio include:
* Core action-driven architecture
* Basic Scriptable Object framework
* Abstracted interfaces for speech recognition and synthesis, natural language dialogue generation, and dialogue character animation and movement
* Feature extensions including streaming and non-streaming audio, continuous and discrete player voice recognition, conditional dialogue triggering, player synthetic voice option, programmatic chat injection, and basic non-player character movement
* Example scenes demonstrating integration with Microsoft Cognitive Services Speech SDK, OpenAI's chat completion models, Unity Multipurpose Avatars, SALSA LipSync Suite, and Ready Player Me avatars
* YouTube videos documenting installation and example scenes - Continue »