unreal-gpt

所属分类:自然语言处理
开发工具:Others
文件大小:294134KB
下载次数:1
上传日期:2023-05-08 15:56:12
上 传 者sh-1993
说明:  虚幻引擎5+VR+MetaHuman+OpenAI+Azure TTS
(Unreal Engine 5 + VR + MetaHuman + OpenAI + Azure TTS)

文件列表:
Config (0, 2023-05-08)
Config\DefaultEditor.ini (98, 2023-05-08)
Config\DefaultEngine.ini (23460, 2023-05-08)
Config\DefaultGame.ini (108, 2023-05-08)
Config\DefaultInput.ini (12689, 2023-05-08)
Content (0, 2023-05-08)
Content\2D_Testing (0, 2023-05-08)
Content\2D_Testing\2D_TestLevel.umap (53437, 2023-05-08)
Content\2D_Testing\BP_2DGameMode.uasset (19066, 2023-05-08)
Content\Characters (0, 2023-05-08)
Content\Characters\MannequinsXR (0, 2023-05-08)
Content\Characters\MannequinsXR\Animations (0, 2023-05-08)
Content\Characters\MannequinsXR\Animations\A_MannequinsXR_Grasp_Right.uasset (29772, 2023-05-08)
Content\Characters\MannequinsXR\Animations\A_MannequinsXR_Idle_Right.uasset (46981, 2023-05-08)
Content\Characters\MannequinsXR\Animations\A_MannequinsXR_IndexCurl_Right.uasset (30012, 2023-05-08)
Content\Characters\MannequinsXR\Animations\A_MannequinsXR_Point_Right.uasset (30003, 2023-05-08)
Content\Characters\MannequinsXR\Animations\A_MannequinsXR_ThumbUp_Right.uasset (30064, 2023-05-08)
Content\Characters\MannequinsXR\Animations\MDT_MannequinsXR.uasset (12589, 2023-05-08)
Content\Characters\MannequinsXR\B_MannequinsXR.uasset (14168, 2023-05-08)
Content\Characters\MannequinsXR\Materials (0, 2023-05-08)
Content\Characters\MannequinsXR\Materials\Functions (0, 2023-05-08)
Content\Characters\MannequinsXR\Materials\Functions\CA_Mannequin.uasset (4884, 2023-05-08)
Content\Characters\MannequinsXR\Materials\Functions\ChromaticCurve.uasset (6355, 2023-05-08)
Content\Characters\MannequinsXR\Materials\Functions\MF_Diffraction.uasset (31967, 2023-05-08)
Content\Characters\MannequinsXR\Materials\Functions\MF_logo3layers.uasset (54752, 2023-05-08)
Content\Characters\MannequinsXR\Materials\Functions\ML_BaseColorFallOff.uasset (13654, 2023-05-08)
Content\Characters\MannequinsXR\Materials\Instances (0, 2023-05-08)
Content\Characters\MannequinsXR\Materials\Instances\Manny (0, 2023-05-08)
Content\Characters\MannequinsXR\Materials\Instances\Manny\MI_Manny_01.uasset (15394, 2023-05-08)
Content\Characters\MannequinsXR\Materials\Instances\Manny\MI_Manny_02.uasset (20307, 2023-05-08)
Content\Characters\MannequinsXR\Materials\Instances\Quinn (0, 2023-05-08)
Content\Characters\MannequinsXR\Materials\Instances\Quinn\MI_Quinn_01.uasset (17775, 2023-05-08)
Content\Characters\MannequinsXR\Materials\Instances\Quinn\MI_Quinn_02.uasset (19962, 2023-05-08)
Content\Characters\MannequinsXR\Materials\M_Mannequin.uasset (78969, 2023-05-08)
Content\Characters\MannequinsXR\Meshes (0, 2023-05-08)
Content\Characters\MannequinsXR\Meshes\ABP_MannequinsXR.uasset (226784, 2023-05-08)
Content\Characters\MannequinsXR\Meshes\SKM_MannyXR_left.uasset (2341961, 2023-05-08)
Content\Characters\MannequinsXR\Meshes\SKM_MannyXR_right.uasset (2340949, 2023-05-08)
... ...

# UnrealGPT UnrealGPT was part of my undergraduate thesis project aimed at combining Unreal Engine 5, Virtual Reality (VR), MetaHuman, OpenAI, and Azure TTS to create realistically interactable non-player characters (NPCs) through large language models (LLMs) and speech synthesis. Please note that a portion of the code is currently under academic proprietorship until October 2024. https://user-images.githubusercontent.com/48035650/236871354-46ca219a-2ba9-46a2-9e55-85dbd88a3da3.mp4 ## Project Overview The goal of UnrealGPT is to leverage the power of cutting-edge technologies to enhance the immersion and interactivity of NPCs in virtual environments. By integrating Unreal Engine 5, which provides stunning visuals and realistic physics, with VR capabilities, MetaHuman for realistic character models, OpenAI's language models for natural language understanding and generation, and Azure TTS for high-quality speech synthesis, we aim to create NPCs that can understand and respond contextually to their surroundings. ## Features - **Unreal Engine 5:** We utilize Unreal Engine 5 as the core framework for building immersive virtual environments. It offers state-of-the-art graphics, physics, and rendering capabilities that enhance the realism of the NPCs. - **Virtual Reality (VR):** UnrealGPT supports VR integration, allowing users to interact with the NPCs in a more intuitive and immersive manner. VR headsets provide a first-person perspective and enable natural hand and body movements within the virtual environment. - **MetaHuman:** By leveraging the power of MetaHuman, we create highly realistic character models for our NPCs. These models possess lifelike features and animations, enhancing the overall visual fidelity and believability of the virtual characters. - **OpenAI Language Models:** We integrate OpenAI's language models to enable natural language understanding and generation for the NPCs. This allows them to comprehend and respond contextually to user inputs and dialogue, creating more engaging and interactive conversations. - **Azure TTS:** Azure TTS is used for speech synthesis, enabling the NPCs to speak with high-quality and human-like voices. This enhances the realism of the interactions and provides a more immersive experience for the users. ## Code Availability Please note that a portion of the code for UnrealGPT is currently under academic proprietorship through October 2024. During this period, the code is not available for public distribution or modification without explicit permission. ## Installation and Usage As the code is not publicly available at the moment, the installation and usage instructions cannot be provided in this README. However, if you have any questions or inquiries regarding the project or its implementation, please feel free to contact me directly. ## Contribution and Support As UnrealGPT is a part of my undergraduate thesis project, external contributions are currently not accepted. However, your feedback and suggestions are highly appreciated and can help shape the future development of the project. If you have any questions or require support related to UnrealGPT, please don't hesitate to reach out to me via the provided contact information. ## Contact Information For any inquiries or further information about UnrealGPT, please contact: - Oscar - zusagen.abhilfe07@icloud.com Thank you for your interest in UnrealGPT!

近期下载者

相关文件


收藏者