linkedin

dialpad.com
For viewers to delight in material such as films, sports video games and live events to the maximum, home TVs not only need excellent picture quality however impressive sound quality also. Understanding this, market leaders are pursuing 3D audio advancement to include a much deeper level of immersion to entertainment experiences - bringing to life thrilling action scenes and recording the quietest information of .

In other words, 3D audio makes listeners feel as if they're actually in the middle of the action. Typically only supported at particular venues such as theater or tape-recording studios, 3D audio is making its way into homes to give audiences a brand-new way to experience their favorite content.

Samsung Electronics' innovative research institute Samsung Research has been striving to promote 3D audio because 2020. To this end, Samsung dealt with Google to jointly establish Immersive Audio Model and Formats (IAMF) - an innovative 3D spatial audio innovation that was embraced by the Alliance for Open Media (AOM)1 in October 2023. Samsung Newsroom sat down with the team that established IAMF to hear the story of how the technology came to life.

▲ The Visual Technology Team at Samsung Research led the advancement of a requirement for audio innovation. (From left) SungHee Hwang, JeongHoon Park and WooHyun Nam

A New Way To Enjoy 3D Audio at Home

Ambient sound exists all over - from the noise of shoes scraping on the pathway to the gentle hum of vehicles driving down the road. While this noise might appear unnecessary in media, it's crucial in including depth and a sense of realness. 3D audio works to perfectly blend ambient sound with discussions and other sound impacts to develop a more vibrant and genuine entertainment experience.

"3D audio makes you feel as if you're really in the heart of the action by adjusting the strength, movement and vibrance of the noise," stated WooHyun Nam from the Visual Technology Team at Samsung Research. "In this method, audiences have the ability to enjoy a more full-bodied sound that records the 3D aspects of the world around us."

▲ SungHee Hwang from Samsung Research's Visual Technology Team

Despite the advantages of 3D audio, it has actually been difficult to apply the technology to home audio gadgets due to technological constraints. "3D sound details from material can not be interpreted effectively by home audio systems such as TV speakers or sound bars, resulting in a somewhat restricted audio experience that lacks information from the original material," said SungHee Hwang from the Visual Technology Team at Samsung Research.

To resolve this, Samsung worked diligently with Google to develop an audio option that would allow viewers to experience material audio as intended. "If the 3D audio information can be checked out by gadget manufacturers, they can adjust the noise in audio gadgets - enabling immersive audio experiences with standard TV speakers or sound bars in your home," said Nam. "By changing the audio to match the home gadget environment, listeners can experience audio just as the developer planned without any distortions or loss in quality."

A consistent standard is needed to send and receive audio information smoothly in between creators and device producers. "Samsung and Google's respective competence in devices and content made the companies ideal partners to produce IAMF technology," stated JeongHoon Park, Executive Vice President and Head of Visual Technology Team at Samsung Research. "By coming together to establish this extraordinary technology, we are leading the way for consumers to delight in 3D audio in their homes."

Three Characteristics of IAMF Technology: Vertical Audio, AI-Based Audio and Customized Audio

IAMF innovation uses 3 unique features that improve the audio experience.

▲ WooHyun Nam from Samsung Research's Visual Technology Team

1. Ability To Express Sound Vertically

Previous open-source audio codecs just supported horizontal sound expression. With IAMF innovation, audio can now be expressed vertically so that noise is increasingly multi-directional. "IAMF makes sound more reasonable, by allowing listeners to hear audio in front, behind or to either side and likewise above or listed below them," stated Nam. "As such, when IAMF technology is applied to home TV speakers and sound bars, it enables listeners to hear noises such as birds flying over their head on their TVs in your home."

2. AI-Based Scene Analysis and 3D Audio Effects

IAMF makes use of AI and deep-learning innovation to evaluate scenes and highlight certain elements of the material - changing audio levels for more boosted sound throughout the seeing experience. "In TV and film, there are certain scenes where the soundtrack or background music is the primary focus," stated Nam. "IAMF will stabilize the sound in these instances. Similarly, the innovation will tweak audio when there is character dialogue to enable the listener to focus on the conversation."

In addition, IAMF technology provides optimal noise in spite of changes in the gadget environment. "By changing the scene analysis audio information according to the gadget environment, IAMF innovation allows listeners to take pleasure in the content's original sound quality on basic home TVs," Hwang included.

3. Highly Customized Audio

Users will have the ability to freely change sound according to their choices with IAMF innovation. Whether viewers are aiming to magnify sound effects from an action scene or boost discussion, IAMF provides the versatility to personalize material audio for a more tailored experience.

▲ IAMF examines information from material and allows audiences to adjust and tailor audio settings. When seeing a sports game, users can straight select whether to stress the commentator's voice or the sounds of the game itself.

3D Audio Across the Industry With Open-Source IAMF

Open source is essential to producing a unified requirement throughout the market. IAMF is the very first open source-based audio technology basic adopted by AOM - implying both corporate and independent content creators across the industry can access the innovation and expand its use.

"In order to enable individuals to freely develop material with 3D audio innovation, associated innovation requires to be open up to all," stated Nam. "Providing a complete open-source structure for 3D audio, from creation to shipment and playback, will enable a lot more diverse audio material experiences in the future."

Similarly, Park highlighted how IAMF innovation will have a large effect on the audio landscape moving forward. "Because we live in a period controlled by content development, IAMF will assist lead, broaden and change the 3D audio community," he stated.

Success Accomplished Through Cooperation

Research on IAMF began in 2020 and took nearly four years to finish. Through a mix of perseverance and tough work, the team was able to accomplish success.

"The task involved numerous days of continuously work, and there were times when we needed to work at night due to the time difference between our workplace and Google's," said Hwang. "Despite these difficulties, I was proud in the end. It was a great opportunity to work with developers from other countries."

The teams established a sense of sociability along the method and constructed a strong foundation of trust and understanding. "A Google worker mentioned how this collaboration with Samsung has been the most enjoyable partnership he had finished so far," Park remembered. "We had the ability to accomplish this job due to the fact that our teams trusted each other. I'm really proud of and happy for our employee' efforts and their cooperation."

▲ JeongHoon Park, Corporate EVP and Head of the Visual Technology Team at Samsung Research

Additionally, Park praised each group member's unique skills and know-how which helped contribute to the development of IAMF. "WooHyun Nam contributed in proposing the innovation advancement ideas while SungHee Hwang arranged and documented our team's concepts in a precise manner," he said.

A Vision for 'Samsung Sound'

Upon its release, the Samsung Research group realized that the standardization of 3D spatial audio marked a brand-new period of sound innovation.

"Thanks to IAMF, we can start investigating innovations that will open up a world of audio possibilities," said Nam. In line with this, the Samsung Research team is presently developing a sophisticated variation of IAMF innovation that can be applied to different sectors such as mobile devices, the metaverse, computer game and more.

▲ With their combined efforts and relentless persistence, the Visual Technology Team at Samsung Research was able to effectively produce a brand-new requirement for 3D audio.

Given the success of IAMF, the Samsung Research group is motivated to produce better audio innovation for consumers. Each of the staff member shared their aspirations for the future of 3D audio.

Nam discussed his desire to create audio technology that is more immersive. "I wish to develop a more innovative 3D audio innovation that makes users feel like they are really in the scene of a motion picture, TV program or live occasion," he stated. "I also intend to continue this research till 3D audio is used to Samsung's mobile phones."

More broadly, Hwang discussed how he hopes Samsung will be able to develop unrivaled audio technology that will put it among the ranks of other leading audio business. "My goal is to establish an innovation that customers will be able to easily identify as 'Samsung Sound' when they hear it," he stated. "I am positive that the IAMF requirement is a stepping stone towards this dream. "

"My hope is that Samsung's sound innovation will allow customers to delight in an updated audio experience that is on par with that of present visual experiences," said Park. "I hope that content creators will use Samsung's audio technology to make 3D audio material accessible. Additionally, we aim to produce a supportive environment that makes it possible for researchers to take on vibrant and interesting obstacles such as expanding Samsung's audio technology."

Technological standards such as IAMF will make entertainment more immersive for audiences throughout the board. The Samsung Research team is leading the way for developments that will change the future of audio.

1 A non-profit industry consortium formed to establish and share technology for multimedia shipment, enabling creators to make use of the technology without fretting about cost. It is operated by an alliance of 38 companies including Samsung Electronics, Google, Amazon, Apple and Meta.
popularmechanics.com