Game Voice Evolution: RTC SDK, In-Game Voice, and Immersive Audio

Game Voice Evolution: RTC SDK, In-Game Voice, and Immersive Audio.png

<img src="https://trtc.io/media/e82e606b-db16-4cdb-8fd9-149237b3694e.png" alt="Game Voice Evolution: RTC SDK, In-Game Voice, and Immersive Audio.png"><h2 style="margin-left:0pt;">1. Unveiling the Evolution of Game Voice</h2>Social networking now is an essential aspect of gaming experiences. On one hand, gaming is inherently a social activity that offers a range of topics and scenarios for social interaction. On the other hand, social networking fulfills our human nature and improves the gaming experiences, which can significantly increase player retention.As an important feature of social networking, game voice has drawn growing attention from game developers and gained considerable popularity among players. There are myriads of game voice applications and solutions in the market, which provide a wide variety of features. Below is an overview of the evolution of game voice.Game voice tools have evolved with the development of the internet. The last 20+ years have witnessed huge leaps in game voice technology：<ul><li>from support for a single platform to cross-platform interoperability.</li><li>from one-to-one chat to interactive voice chat in a room with tens of thousands of online users.</li><li>from third-party voice communication SaaS tools to PaaS SDKs.</li><li>from monotonous voice chat to immersive voice experiences.</li></ul>Instead of following a chronological order or revisiting the evolution of their features, this article looks at the development of game voice tools from the perspective of game voice experiences.<img src="https://trtc.io/media/8f950a8f-8638-439f-9bc8-b64613712e74.webp" alt="game voice experiences in the game scene.webp">The most basic experience brought by game voice is that players communicate with each other through voice chat. Gaming creates a virtual world where the dialog between players is actually that between game characters. In tandem with the improvements in gameplay design and image quality, players have higher expectations of voice chat, and the voice experience similar to a conference call can no longer meet their demand. In response, a disruptive technical solution has emerged, which is called "Immersive Voice Solution".<img src="https://trtc.io/media/444811c1-a9ac-4200-8176-5f26bea5a66b.webp" alt="Immersive Voice Solution.webp">Game voice technology has gone through several stages, starting from the most basic voice chat to immersive voice experiences and beyond. As breakthroughs in sensors, computing power, audio algorithms, IoT, and other technologies are on the horizon, all-real voice will eventually become a reality, delivering the ultimate voice experience the metaverse demands.<h2 style="margin-left:0pt;">2. Version Iterations</h2><h3 style="margin-left:0pt;">/ 2.1 Game voice v1.0: Third-party voice chat tools</h3>At this stage, players use third-party voice chat tools to communicate with each other in the process of gaming. Whether the game itself offers a voice communication feature or not, using third-party tools allows players to quickly create chat channels and communicate with each other through voice chat.<img src="https://trtc.io/media/df1dd867-f833-496b-bf12-b66097b07e06.png" alt="Third-party voice chat tools: skype, discord, Wechat, yy, zoom and so on.png"><h3 style="margin-left:0pt;">/ 2.2 Game voice v2.0: In-game voice</h3>In-game voice solutions mainly take the form of game developers connecting SDKs developed by voice communication PaaS providers. The basic APIs that come with the SDKs are used to implement various in-game voice scenarios:<ul><li>channel voice between teammates: teammates can have a voice chat at any position coordinates in the game.</li><li>range voice between different teams: players of different teams can hear each other only when their position coordinates in the game are within a specified range.</li><li>blocklist/allowlist.</li></ul><img src="https://trtc.io/media/fb014d31-9fd5-490a-afed-8dd7af43c3cf.png" alt="In-game voice chat with Tencent RTC's gaming voice solution.png">Unlike third-party voice chat tools, third-party voice solutions require game developers to integrate and design specific voice scenarios. For players, the establishment of voice channels, audio attributes, and the features will be automatically and adaptively adjusted based on the game progress and specific scenarios, thus taking the game voice experience to the next level. Some voice SDKs. Tencent RTC's gaming voice solution (GME, Game Multimedia Engine) provides a broad suite of APIs to meet other game voice needs than voice chat:<ul><li>voice messaging</li><li>speech recognition</li><li>accompaniment playback</li></ul>Based on these APIs, game developers can design more powerful social networking features for games.In-game voice solutions have preliminarily integrated voice and gaming business scenarios, yet basically at the level of feature integration. As a result, standalone voice SDKs can only give players a game voice experience similar to a conference call, although players don't have to establish a chat channel themselves, or run any resource-consuming third-party software.<h3 style="margin-left:0pt;">/ 2.3 Game voice v2.5: Upgraded version of in-game voice</h3>To further improve players' game voice experiences, voice SDKs like TRTC offer voice processing capabilities such as voice changing and virtual 3D sound field. With these features, players can change their voice in real time based on their selected voice type, which adds fun to gaming and allows a vast design space for game voice features.<img src="https://trtc.io/media/5ceb7dcb-db05-474f-a59f-cdaaa6c1feb1.jpeg" alt="3D audio effects in real time in vr. game.jpeg">In FPS, battle royale, or VR games, players need to accurately identify the positions and directions of other players, which is vital to player communication about tips/tactics and an immersive gaming experience. The 3D audio effects technology that comes with voice SDKs offers an effective solution. The positions perceived by players through voice correspond to the relative positions of their characters in the game. As the relative distance between the characters changes, the voice intensity will increase or decrease accordingly, which well simulates real-world dialog scenarios.<img src="https://trtc.io/media/bb7f3a23-db71-4ef0-a882-40997ad3943c.jpeg" alt="3D audio effects in game scene.jpeg">Through the 3D audio effects technology, voice processing and gaming scenarios are combined, which, however, are limited to position and distance information in gaming scenarios. For a truly immersive experience, voice processing should cover all aspects of gaming scenarios. A voice SDK is unlikely to provide a dedicated API for every potential factor; otherwise, the SDK would be extremely complicated and bulky, and that's not really necessary. To take the game voice experiences up a notch, we need a new solution, namely the "Immersive Game Voice Solution".<h3 style="margin-left:0pt;">/ 2.4 Game voice v3.0: Immersive voice</h3>An immersive voice solution means that players' voice effects are rendered in real time based entirely on the game process. All players' voices are processed through digital signal processing (DSP) algorithms, and then played back in the headphones to simulate voice communication in real-world settings. Voice chat processed in this way can deliver a more immersive game voice experience, allowing players to communicate in a natural way.<img src="https://trtc.io/media/550e2c40-4b59-4fe9-ab6d-e635587b11ed.png" alt="Wwise with GME.png">Then, how is an immersive voice solution implemented? As mentioned above, it is not advisable to have a single voice SDK packed with all sorts of APIs. Moreover, voice service providers are generally not experts in audio processing algorithms compared with specialist audio technology companies. Therefore, to develop an all-encompassing voice SDK is virtually unviable.In view of this, a combination approach will work best, just as with the Wwise + GME solution. GME is dedicated to end-to-end real-time voice communication, and the Wwise interactive audio engine is adopted by many game developers as a tool for game sound design. The Wwise plugin acts as a bridge for data interactions between GME and the Wwise engine, and GME voice streams are seamlessly connected to the Wwise audio pipeline, so Wwise's rich sound effects processing and control features can be used in voice chat. Such a design makes it possible to deliver an immersive game voice experience.<figure class="image"><img src="https://trtc.io/media/3952e728-9ee0-4196-8111-40fc4b536c89.jpeg" alt="immersive game voice in real time in the game scene.jpeg"></figure>As an interactive audio authoring tool, Wwise is generally used to create high-quality audio content for games, and GME complements Wwise in the field of game voice. Now sound engineers can also use Wwise to create immersive and interesting voice features, opening up new gameplay possibilities.<h3 style="margin-left:0pt;">/ 2.5 Game voice v4.0: All-real voice</h3>Immersive voice, however, is definitely not the acme of game voice experiences – all-real voice takes it further.With the advances in AR, VR, and MR technologies, the metaverse has become a hot topic. Many technology giants are expanding into the metaverse, which is considered the next biggest opportunity in the realm of the internet in the coming decade. The metaverse refers to a parallel virtual world that is both independent of and interconnected with the real world, where people can interact, work, and do much more realistically.To make virtual worlds more lifelike, software and hardware technologies need to be integrated to simulate human senses. As voice communication is an important form of human interaction, metaverse scenarios have higher requirements for voice, that is, all-real voice. Currently, the metaverse is still more of a concept than reality, and we'll see what the future holds.Gaming is inherently a social activity in the internet age. Although voice chat is not a core feature for most game genres, it makes gaming more enjoyable and thus increases player retention. Therefore, it has become a common feature of online games.<img src="https://trtc.io/media/b3d8afa0-b6cd-41fb-a1ca-b9ac3d35e0c2.jpeg" alt="all-real voice in the online social games like WEREWOLF.jpeg">Game voice technology has evolved in response to players' growing demand for better experiences and gameplay. As players have higher expectations of gaming experiences, voice is bound to hold greater weight in gaming.

A Comprehensive Guide to Game Voice: Exploring RTC SDK, In-Game Voice, and Immersive Audio for an Enhanced Gaming Experience

Intro

Wwise

Next-Gen Media SDK Solution Design of Tencent RTC

Next-Gen Media SDK Solution Design of Tencent RTC.png

RTC Engine

Exploring Next-Generation Media SDK Solution Design | Tencent RTC Blog

Getting Started with Tencent Cloud Chat: A Step-by-Step Walkthrough 

Getting Started with Tencent Cloud Chat: A Step-by-Step Walkthrough .png

Chat

<img src="https://trtc.io/media/5b96ba30-61b7-4621-99d8-cb15c53236ce.png" alt="Getting Started with Tencent Cloud Chat: A Step-by-Step Walkthrough .png"><h2 style="margin-left:0pt;">What is Tencent Cloud Chat API?</h2><hr>The rise of remote communication makes Chat feature essential for almost all applications or websites. Chat API as a potential solution for developers, which is a set of tools and protocols that enable chat functionality integration into websites, apps and other digital platforms. By using Chat API, developers can provide with a seamless and efficient chat experience to communicate among users.<img class="image_resized" style="width:50%;" src="https://trtc.io/media/e67d78b9-6b21-4310-9d5d-14bf860532ac.png" alt="chat application of discussion group.png"><img class="image_resized" style="width:50%;" src="https://trtc.io/media/a97bfb08-d4ec-4c05-b579-cdb39dc427df.webp" alt="instant message in living streaming.webp">Tencent Cloud Chat provides Chat API for apps and websites, and integrates diverse chat capabilities such as one-to-one chat, group chat, chat room, and system notification into its SDKs and UIKit components to build engagement and develop your business quickly. We are trusted by 100,000+ customers worldwide, supporting 1 billion+ monthly active users, and over 550 billion daily peak messages. Our products can be applied to social, live, metaverse, gaming, education and on-demand service which can basically cover all your needs.<img src="https://trtc.io/media/70a92b20-ba89-4049-a251-81f6257ba293.png" alt="Instant interaction during live streaming like sending gifts, likes and so on.png">&nbsp;<h2 style="margin-left:0pt;">Tencent Cloud Chat brings in-app chat to the next level</h2><hr>Tencent Cloud Chat is a useful tool for building a complete in-app chat platform due to its easy integration, global access and support for multiple platforms：Easy and Quick IntegrationYou can run our demo in just ten minutes. By implementing the UI features based on <a href="https://www.tencentcloud.com/document/product/1047/50062">TUIKit</a> and calling the corresponding APIs of the chat SDK, you can build your own chat application in just a day.Independent IDC and global accessWith independent data storage nodes in US, Singapore, Germany, India and South Korea &amp; 2800+ global access points and cache nodes in all continents, messages can be delivered globally in 200ms on average.Full platforms supportedChat API platform covers a comprehensive range, including iOS, Android, Mac, Windows, Web, Unity, Flutter, and Electron. Tencent Cloud Chat offers various message types to improve the chat experience, including conversations that make it easier for users to receive or start chats, and announcements for timely notifications that can drive higher conversion rates.<h2 style="margin-left:0pt;">How to build your first app with Tencent Cloud Chat</h2><hr>Before you start building, please make sure that you have signed up for a Tencent Cloud account (<a href="https://www.tencentcloud.com/account/login?s_url=https%3A%2F%2Fconsole.tencentcloud.com%2Fim%3Ffrom_qcintl%3Dclick_products_im%26ext1%3DGet_Started">sign up here</a>). You can also explore our demo to better understand its key features: <a href="https://trtc.io/demo/homepage/#/detail?scene=messenger">chat demo</a>, <a href="https://web.sdk.qcloud.com/im/demo/intl/index.html?scene=live">livestreaming demo</a>.<img src="https://trtc.io/media/e850047c-9c00-4b35-bfb1-107133727292.png" alt="video and audio sharing in the chat application.png">Checklist for building your first app:<ul style="list-style-type:disc;"><li>Select your data center: Tencent Cloud Chat supports global access and stores data in Singapore, Seoul, Frankfurt, Mumbai, and Silicon Valley</li><li>Name your application</li><li>Read this documentation and guides to get started with your first app</li><li>Get started - <a href="https://www.tencentcloud.com/document/product/1047/34552">Get Started</a></li><li>UI included Integration - <a href="https://www.tencentcloud.com/document/product/1047/34283">Integration Solution (UI Included)</a></li><li>Integration (without UI) - <a href="https://www.tencentcloud.com/document/product/1047/34299">Integration Solution (No UI)&nbsp;</a></li><li>Run your app</li></ul><h2 style="margin-left:0pt;">Power in-app chat with TUIKit</h2><hr>TUIKit is a UI component library based on Tencent Cloud Chat SDK, providing universal UI components to enable features such as conversation, chat, search, relationship chain, group, and audio/video call features. With these pre-built UI components, you can quickly build your own business logic.<img src="https://trtc.io/media/88536c73-fbc4-4a03-b14d-055a6c04606f.png" alt="the components provided by Tencent RTC, like TUICallKit, TUISearch, TUIChat, TUIConversation, TUIGroup, TUIContact.png">Discover the advanced features within this TUIKit on Flutter, including <a href="https://www.tencentcloud.com/document/product/1047/52154">interface language</a>, <a href="https://www.tencentcloud.com/document/product/1047/52884">user online status</a>, <a href="https://www.tencentcloud.com/document/product/1047/52890">typing status</a>, <a href="https://www.tencentcloud.com/document/product/1047/52891">message read receipt</a> and <a href="https://www.tencentcloud.com/document/product/1047/52892">message reactions</a>.Three steps to build in-app chat via TUIKit:<ul><li>Select the UIKit that matches your app (Android, iOS, Web and Flutter are supported).</li><li>Integrate easily and quickly with only a few lines of code are needed.</li><li>Customize your own chat experience with the freedom to customize UI interface and business logic.</li></ul><h2 style="margin-left:0pt;">About Tencent RTC</h2><hr>Leveraging Tencent's 21 years of experience in network and audio/video technologies, Tencent RTC (Real-Time Communication) offers solutions for chat, group audio/video calls and low-latency interactive live streaming. With Tencent RTC, developers can quickly develop cost-effective, low-latency, and high-quality interactive audio/video services.If you want to enrich the functions of your platforms to provide a better overall experience for your users, please consider <a href="https://trtc.io?utm_source=website&amp;utm_medium=blog&amp;utm_term=trtc&amp;utm_campaign=blog&amp;_channel_track_key=vk1DdHNL">Tencent RTC</a>. We can also provide you with a smoother real-time interactive audio/video services, helping your users stay connected more easily and effectively.<h2 style="margin-left:0pt;">Contact Us</h2><hr>More detailed tutorials will be released gradually in the later stage, please stay tuned.If you have any questions about our product or would like to learn more, please directly reach out to tencentcloudchat@tencent.com to contact our team. Please feel free to <a href="https://trtc.io/contact?utm_source=website&amp;utm_medium=blog&amp;utm_term=trtc&amp;utm_campaign=blog&amp;_channel_track_key=EB6l06UE">contact us</a>, or join join us in&nbsp;<a href="https://discord.gg/hq7jW7zChW">Discord</a>&nbsp;.Follow&nbsp;<a href="https://twitter.com/TencentMedia">@TencentMedia</a>&nbsp;on Twitter to stay updated with our latest product information.

Get Started with Tencent Cloud Chat | Tencent RTC Blog

Set Up

Build App

trtc-meaning.png

<img src="https://trtc.io/media/233cf2e6-174a-4e60-9aa7-8f1fad484902.png" alt="trtc-meaning.png"><a href="https://trtc.io/">TRTC(Tencent RTC</a>) is a powerful cloud service designed to facilitate real-time audio and video communication. In this article, we will delve into the world of TRTC, exploring its capabilities and applications, and how it can revolutionize the way we communicate.<h2>What is TRTC?</h2>Let's start by analyzing the meaning of the name TRTC. Tencent Real-Time Communication &nbsp;is the official definition of TRTC.Firstly, let's decipher what TRTC stands for:T — TencentR-T — Real-TimeC — CommunicationTRTC(Tencent RTC) is a cloud-based service that enables real-time audio and video communication across various platforms. Developed by Tencent, a leading technology company known for its popular instant messaging apps QQ and WeChat, TRTC leverages the company's expertise in communication technology to provide a seamless and high-quality experience for users.<h2>Capabilities of TRTC</h2>TRTC(Tencent RTC) offers cross-platform solutions for audio/video calls and low-latency interactive live streaming. With SDKs for mini programs, web, Android, iOS, Electron, Windows, macOS, and other platforms, you can quickly integrate TRTC services into your projects and connect to the TRTC backend. You can also combine TRTC with other Tencent Cloud products such as <a href="https://trtc.io/products/call">Instant Messaging(IM)</a> , Cloud Streaming Services (CSS), and Video on Demand (VOD) to explore more use cases. The figure below shows how TRTC works together with other products.<img src="https://trtc.io/media/7d88b4b8-64a9-4234-938c-428b631b3298.png" alt="trtc.png">High-quality audio and video communication: TRTC offers high-quality audio and video communication, ensuring clear and smooth conversations. It employs advanced audio and video processing algorithms, such as noise reduction and echo cancellation, to deliver an exceptional user experience.Cross-platform compatibility: TRTC supports a wide range of platforms, including Android, iOS, Windows, macOS, and web browsers. This cross-platform compatibility allows users to communicate seamlessly, regardless of the device they are using.<a href="https://trtc.io/blog/details/throughput-latency">Low latency</a>: One of the key features of TRTC is its low latency, which ensures real-time communication with minimal delays. This is particularly important for applications such as online gaming, remote collaboration, and live streaming, where real-time interaction is crucial.Scalability: TRTC is designed to handle a large number of concurrent users, making it suitable for applications that require massive scalability, such as online conferences, virtual events, and social networking platforms.Security and privacy: Tencent's Real-Time Communication service prioritizes user security and privacy. It employs end-to-end encryption to protect user data and ensure secure communication.<h2>Technical Implementation of TRTC</h2>The original design intention of WebRTC was to solve 1v1 audio and video call problems. However, in actual enterprise-level applications, we often need more complex functions, such as multi-person calls, real-time meeting control, cloud mixing, and real-time recording. This requires us to innovate and expand on the basis of WebRTC.TRTC(Tencent RTC) has successfully addressed this issue by introducing mirrored instances in the cloud. These mirrored instances act like "pseudo-users" running in the cloud. They can communicate data with real users in the browser, while simultaneously "translating" the received data in real-time, converting it into a data format that the TRTC system can understand, thereby integrating it into the existing TRTC system.This is akin to adding a translator who understands both Arabic and Chinese between two Arabic-speaking individuals, enabling those who originally could not understand each other to comprehend what the other party is saying. Through this method, Tencent has successfully extended its RTC capabilities to browsers that support WebRTC, thereby meeting the needs of enterprise-level applications.This innovative solution fully demonstrates Tencent's leading position and strong capabilities in real-time communication technology,and it also provides a good reference for other enterprises.<h2>Applications of TRTC</h2>Online education: TRTC can be used to power online education platforms, enabling real-time interaction between teachers and students. Its high-quality audio and video communication, coupled with low latency, make it an ideal solution for virtual classrooms and remote learning.Remote collaboration: Businesses can leverage TRTC to facilitate remote collaboration among team members. Its cross-platform compatibility and low latency make it suitable for video conferencing, screen sharing, and real-time collaboration on projects.Live streaming: TRTC can be used to power live streaming platforms, providing high-quality audio and video communication with low latency. This ensures a smooth and engaging experience for both streamers and viewers.Telemedicine: Healthcare providers can use TRTC to offer telemedicine services, enabling real-time communication between doctors and patients. Its high-quality audio and video communication, along with its security features, make it a reliable solution for remote consultations and diagnoses.Social networking: TRTC can be integrated into social networking platforms to enable real-time audio and video communication among users. Its scalability and cross-platform compatibility make it an ideal choice for connecting people across the globe.<h2>Conclusion</h2><a href="https://trtc.io">TRTC(Tencent RTC)</a> is a powerful cloud service that offers a wide range of capabilities, making it suitable for various applications. Its high-quality audio and video communication, low latency, cross-platform compatibility, and scalability make it a game-changer in the world of real-time communication. By leveraging TRTC, businesses and individuals can revolutionize the way they communicate and collaborate, opening up new possibilities for innovation and growth.If you have any questions or need assistance, our support team is always ready to help. Please feel free to&nbsp;<a href="https://trtc.io/contact?utm_source=website&amp;utm_medium=blog&amp;utm_term=trtc&amp;utm_campaign=blog&amp;_channel_track_key=EB6l06UE">Contact Us</a>&nbsp;or join us in&nbsp;<a href="https://discord.gg/hq7jW7zChW">Discord</a>&nbsp;.

"Intro"

NOTHING FOUND