Artificial Intelligence
Imagine a Game Wired Into ChatGPT with NPCs You Can Talk to.
You can now roleplay in Skyrim VR thanks to a modder who wired ChatGPT into the game.
In various previous stories, I have spoken about ChatGPT, as well as role-playing games. These will be linked at the end of this post. In this post, I will speak about this modders creation as well as how I believe and hope this technology will improve games in the future.
What are Skyrim and ChatGPT?
Before I get into this modders creation, I will first explain what Skyrim and ChatGPT are for those who are unaware.
Skyrim
Skyrim is a popular open-world action role-playing video game developed by Bethesda Game Studios and published by Bethesda Softworks. It was released in 2011 and is the fifth main installment in The Elder Scrolls series, set in the fictional continent of Tamriel.
The game takes place in the province of Skyrim, located in the northern part of Tamriel. The player assumes the role of a character known as the Dragonborn, who is prophesied to be able to defeat the game’s main antagonist, Alduin, a dragon who is said to be responsible for the end of the world.
The gameplay of Skyrim involves a mix of exploration, combat, and character development. The player is free to explore the vast open world of Skyrim, which is filled with cities, towns, villages, and various natural environments such as forests, mountains, and rivers.
The world is richly detailed and features a range of diverse creatures and NPCs (non-playable characters) with their own unique personalities and backstories.
Combat in Skyrim is real-time and features a variety of weapons, spells, and abilities that the player can use to defeat enemies. The player’s character can be customized with various skills and perks that can be earned through experience points earned by completing quests and defeating enemies.
One of the unique aspects of Skyrim is the game’s extensive crafting system. The player can create various items such as weapons, armor, and potions by collecting raw materials and using crafting stations located worldwide. This allows players to create highly customized characters and equipment.
In addition to the main questline, Skyrim features a vast array of side quests, guilds, and factions the player can join and complete. These offer additional gameplay and story content and provide opportunities for players to customize their characters furtherand explore the world of Skyrim.
Skyrim VR
Skyrim VR is a virtual reality version of the popular action role-playing game, Skyrim. It was released in 2018 for various virtual reality platforms, including PlayStation VR and PC-based headsets.
In Skyrim VR, players can fully immerse themselves in Skyrim, using motion controllers to engage in combat, casting spells, and interacting with the environment. The VR version also includes all of the original game’s DLC (downloadable content).
The game’s vast open world and numerous quests and storylines translate well into the VR format, providing an even more immersive experience. The VR version of the game also includes several unique features, such as the ability to dual-wield spells and weapons and a new VR-specific menu system.
ChatGPT
ChatGPT is a significant language model developed by OpenAI based on the GPT-3 architecture. It is an artificial intelligence (AI) system trained to understand and generate natural language.
The model is designed to respond to user inputs in a conversational style, allowing it to interact with users in a way that simulates human-like conversation.
The GPT-3 architecture used in ChatGPT is a type of deep-learning neural network capable of processing vast amounts of data.
It has been trained on massive text data, including papers, books, articles, stories, and web pages, allowing it to learn how to generate natural language that is both coherent and contextually appropriate.
ChatGPT can be used for various applications, including customer service, language translation, and personal assistants. The model can also generate creative writing, such as poetry and short stories, based on user inputs and prompts.
One of the key advantages of ChatGPT is its ability to learn and adapt based on user interactions. As users interact with the model, it can learn from their responses and adjust its output accordingly, allowing for more natural and effective communication.
Despite its many potential applications, ChatGPT is not without its limitations. Like all AI systems, it is not infallible and may generate inaccurate, inappropriate, or even offensive responses.
Users must approach AI systems cautiously and be mindful of the potential risks and limitations involved. As an editorial team, we guided writers using AI tools for content creation.
Publishing and Conduct Guidelines for the Lampshade of ILLUMINATION
Here is a story ChatGPT helped me to write as an example of AI-generative text.
What did this modder achieve on Skyrim VR?
Art From The Machine, a modder, is attempting to answer the question of what would happen if RPG characters had a never-ending supply of dynamically generated anecdotes, could remember experiences they had with the player in the game, and could even calculate when stores would close.
Using OpenAI’s ChatGPT, xVASynth for text-to-speech, and Whisper for speech-to-text, the mod generates responses from NPCs in Skyrim VR.
The results are stilted, but the potential for NPCs wired up with AI to create dynamic conversations is evident. In a conversation with Ulfberth War-Bear, a star employee of Warmaiden’s in Whiterun, Ulfberth can answer a question about when the store closes and describe a sword that the modder picks up.
Ulfberth’s speech is awkward, but it is being generated on the fly and is a step forward in the future of gaming.
The modder is also working on enabling NPCs to remember past events and conversations when you talk to them later, something that is not currently present in the game.
“I have a basic memory system set up where I ask ChatGPT to summarize the conversation on exit to help condense it down for future prompts […] There are much more sophisticated tools out there to handle memory though such as Langchain which I am hoping to implement in the future.”
While the mod is impressive, the question remains whether NPCs can endlessly conjure up new pieces of dialogue that would be interesting enough to listen to.
Researchers recently populated a virtual town with AI agents, and even though they threw parties and talked with each other, the conversations themselves were…pretty dull. It’s unclear if the tech to make NPCs talk endlessly will matter if they ultimately don’t have anything interesting to say.
Nonetheless, the mod is a step towards the future of gaming, and exciting to consider the possibilities that could arise if NPCs react dynamically to something the player does or says, without having that specific dialogue pre-written and recorded.
Skyrim VR is not the only game being modded with AI tools. Mount & Blade: Bannerlord also has a mod that enables NPCs to use AI to answer questions typed by the player. It’s impressive that these mods are being created, but the technical challenge of wiring AI into NPCs isn’t the only challenge to be overcome.
The dialogue must be interesting enough to keep players engaged. Nonetheless, the future is exciting as AI technology continues to evolve and AI-enabled NPCs could become a staple of future games.
How I hope AI can be used in video games in the future
This mod from Art From The Machine gave me a glimpse into the future of RPGs or even MMORPGs with a similar refined system incorporated into the game to create a true sense of emersion.
One of the major benefits of using ChatGPT in RPGs and MMORPGs is the creation of a more immersive and engaging gameplay experience. Players can interact with NPCs in a way that feels more natural and conversational, rather than being limited to selecting from a list of pre-set dialogue options.
The ability of ChatGPT to remember previous conversations and interactions with players can also enhance the sense of continuity and realism within the game world.
Another advantage of using ChatGPT in RPGs and MMORPGs is the potential for greater player agency and choice. By enabling NPCs to respond dynamically to player queries, ChatGPT can provide players with a wider range of options and outcomes in quests and missions.
This can create a more personalized and unique gameplay experience, where the choices that players make have a direct impact on the outcome of the game.
In addition, ChatGPT can also help developers to reduce the time and resources required to create dialogue and interactions for NPCs. By generating responses dynamically, ChatGPT eliminates the need for developers to manually script and record thousands of lines of dialogue for every NPC in the game.
This can save developers significant time and resources, allowing them to focus on other aspects of game development, such as level design and gameplay mechanics.
However, there are also some potential drawbacks and challenges associated with using ChatGPT in RPGs and MMORPGs. One of the biggest challenges is ensuring that the generated responses are not only accurate but also appropriate and engaging.
The responses generated by ChatGPT may be limited by the quality and diversity of the data used to train the model, which could potentially result in bland or uninteresting dialogue.
Another challenge is ensuring that the generated responses are consistent with the overall tone and style of the game. ChatGPT may be capable of generating a wide range of responses, but it is important to ensure that these responses fit within the context and narrative of the game.
Developers may need to carefully curate and filter the responses generated by ChatGPT to ensure that they align with the desired gameplay experience.
ChatGPT has the potential to significantly enhance NPC interactions in RPGs and MMORPGs by providing dynamic and personalized responses to player queries. By enabling greater player agency and choice, ChatGPT can create a more immersive and engaging gameplay experience.
However, developers will need to carefully manage the generated responses to ensure that they are appropriate and consistent with the overall tone and style of the game.
Final Words and Takeaways
A modder named Art From The Machine has used OpenAI’s ChatGPT, xVASynth, and Whisper to create an AI-generated conversation system for Skyrim VR.
The system generates responses from non-playable characters (NPCs) that can calculate the closing times of stores and even remember experiences with the player.
Although the conversations appear stilted and awkward, the technology shows the potential for NPCs wired up with AI to create dynamic conversations.
The modder also works on a memory system where NPCs can remember past events and conversations when the player talks to them later, something not currently present in the game.
While there are limitations to AI systems, the ChatGPT model’s ability to learn and adapt from user interactions offers a glimpse into the future of gaming.
If you enjoy my posts and would like to stay updated on the latest gaming-related news, technology advancements, design trends, and social media insights, I invite you to follow my profile.
I will continue to share my thoughts and insights on a wide range of topics in the world of entertainment and technology.
With that being said, thank you for reading my post, and have a good one.
Here are a few of my previous stories relating to ChatGPT and RPGs:
I Joined a Guild in an MMORPG and Immediately Started to Enjoy Myself a Lot More
About Me
I write articles in my field covering gaming, film-making, social media, and design. I am also a YouTuber. Thank you for subscribing to my account to get notifications when I post on Medium. I also created a new website to share my content for free and promote stories of writers contributing to my publications on Medium. Let’s connect on Twitter and LinkedIn.
I own two publications on Medium. One for video gamers and another for YouTubers and Podcasters. I also support Illumination Integrated Publications as a volunteer editor and participate in collaborative activities in the Slack Workspace. Writer applications for my publications can be sent via this weblink. Please add your Medium ID.
If you are new to Medium, you may join via my referral link. You may also consider being a Vocal+ member to monetize your content. I write for both platforms and repurpose my content to reach a larger audience. Here is more information about Vocal Media.
This post includes my Medium and Vocal Media referral links.
