• Follow Us On : 

Agora Supports 360° Spatial Audio and Exclusive Avatars with MetaChat Solution

Redaksi | Senin,10 Januari 2022 - 17:19:51 WIB
Dibaca: 379 kali 
Agora Supports 360° Spatial Audio and Exclusive Avatars with MetaChat Solution

CHINA - 10 January 2022 - Register, log in, choose a name, generate your own avatar, select any chatroom to enter, and you will be able to interact with numerous other users in a low-latency, stable and smooth manner within the "metaverse". There are various virtual scenes for you to choose from; and 360° spatial audio allows "social butterfly" and"social phobia" to experience the immersive of "face-to-face" conversation even though they are thousands of miles away. The solution behind this is Agora's MetaChat solution.

Agora's MetaChat solution provides a new form of voice chat--users participate in the chat with their avatars. Currently, the solution already supports user-defined face pinching, clothing and hairstyle pairing and other features, which allowing users to create a unique avatar for themselves. In addition, a user's avatar style can be customized, to meet the needs of developers for various business scenarios including virtual reality and cartoon.

Agora's MetaChat solution currently provides three virtual scenarios: Party, Cafe, and Bar. In the future, the solution will expand diversified scenarios such as exhibition, study rooms and disco hall, etc. Developers can choose the suitable settings according to their business features, and can also customize senarios on-demand. Currently, each chatroom can support 16 players. Each player can see the avatars of other players, and interact with any of them. They can also choose any empty seat to sit down, drink at the bar, or dance.

Agora's MetaChat solution supports 360° spatial audio. It can create an immersive, lifelike experience for players in a chatroom, to make interactions more efficient and interesting. Agora's 360° spatial audio adopts a software-only algorithm which can simulate the stereo sound field in the spherical area of a person's head. Therefore, it is not limited by hardware, and users can wear normal headphones to experience it on their phone or PC. When users move their avatars in a virtual scenario, the audio effects heard by users will change with the orientations of the avatar's head and face as well as the angle and distance of the source of sound, to perfectly simulate the lifelike audios. Specifically, in a voice chatroom:

After entering a chatroom, players will hear the background music (BGM) played in the chatroom, such as the light music in a cafe or the live band or DJ in a bar. When the player moves to different spots in the chatroom, they will hear a different BGM effect.

For example, the BGM will turn down as the player moves away. A player can also move to other players and begin to chat with them by controlling his or her position back and forth or from left to right. In addition, the BGM in the chatroom can coexist with the audios of players. This means that a player can hear the BGM in the chatroom as well as the voices of other players within a certain range.

In the future, Agora's MetaChat will also support two other features: the voice-driven mouth shape and the voiceprint-based voice change.

1. For the voice-driven mouth shape, Agora will provide the following two solutions:

  • Audio-only: There is no need to capture facial expressions. The algorithm is able to intelligently associate the voices of Chinese or English (or other languages) with the mouth shapes and facial expressions of the avatars, to drive the avatars to speak like real people. The solution supports 2D portraits and 3D portrait models.
  • Facial expression capture: A facial expression capture device (i.e. the front-facing camera of a phone) will need to be activated to accurately identify movements such as blinking, frowning, opening mouth, or turning head by capturing facial expression coefficients.

2. Agora's voiceprint-based voice change feature supports the conversion of a person's voice into another person's voice or another style while keeping the semantics unchanged. There are two types: voice change and voice improvement:

  • Voice change: This includes voice change, style change, and emotion change. It is often used for entertainment.
  • Voice improvement: The solution can turn expressions that are not fluent into fluent ones and turn a tired voice into a resounding one. It is often used in business settings such as delivering a speech.

Akses Wahanariau.com Via Mobile m.Wahanariau.com
Untuk Berbagi Berita / Informasi / Peristiwa
Silahkan SMS ke nomor HP : 085271472010
atau email ke alamat : [email protected]
Harap camtumkan detail data diri Anda
Pengutipan Berita dan Foto, Cantumkan Wahanariau.com Sebagai Sumber Tanpa Penyingkatan
Rabu,04 September 2019

Agora Hospitality Group to Open Place Namba in Central Osaka

A newly renovated four-star hotel just 3-minute walk from Dotonbori JAPAN - 4 September 2

Kamis,30 September 2021

Agora: a New Item on Gen Z social Calendar-having Fun Together Maybe in Metaverse

CHINA - 30 September 2021 - With COVID-19 normalization and the rapid spread of real-time communicat

Senin,22 November 2021

Agora Helps Castbox Build the Best Free Podcast Platform in the World

CHINA - 22 November 2021 - In the U.S. market where half of Americans are listening to podcasts, it&

Kamis,02 Desember 2021

Agora Helps Yalla Build the Most Popular Voice-centric Social Platform in MENA

CHINA - 2 December 2021 - Online chatroom apps have been springing up in recent years, and they are

Jumat,05 Agustus 2022

NTU Singapore and RGE Launch S$6 Million Joint Research Centre to Tackle Textile Waste

SINGAPORE - 5 August 2022 - Nanyang Technological University, Singapore (NTU Singapore)&nb

Jumat,05 Agustus 2022

Bracell Launches One to One Commitment to Support Conservation of Areas of Native Vegetation and Forest in Brazil

Company commits to one hectare of conservation area for every hectare of plantation by 2025 Sever

Jumat,05 Agustus 2022

Rhenus Reaches First Milestone in LCL Carbon-Neutral Journey with Pilot Launch of Carbon Neutrality Label

SINGAPORE - 5 August 2022 - LCL consolidation shipments exported by Rhenus from the Central European