GAMES Sony patent proposes converting game audio into visual and haptic cues for deaf players GAMES EA develops Project Gridiron, a standalone American football game with open-world co-op exploration GAMES GameMaker Engine Makes Commercial Use Free for PC, Mobile, and Web Starting January 2027 GAMES Nirvanana’s Project Zeta introduces 4-team MOBA format with 24-minute matches NVIDIA Nvidia Driver Update Breaks Call of Duty: Modern Warfare 4 Graphics with Washed-Out Textures AMD Maxtang NXALN51 mini PC packs four 2.5G Ethernet ports in a fanless 12.7 cm chassis TABLETS Blackview Zeno 2 tablet adds IP54 dust and water resistance to Android 16 NINTENDO Nintendo Switch games run natively on Apple Silicon Macs with nxnative ANDROID Samsung Exynos 2700 reportedly beats Snapdragon 8 Elite Extreme Gen 6 by up to 20% in benchmarks GAMES Morrowind Rebirth 7.2 update fixes broken spells, improves navigation and visuals GAMES Starship Troopers: Extermination Update 13 Adds Flying Hoppers That Abduct Soldiers NINTENDO SWITCH Hockey roguelike Tape to Tape 1.0 launches on Steam and consoles after three-year early access GAMES No More Room in Hell 2 adds permanent +29 level boost with new Responder Retirement system LINUX Valve adds Steam Frame external disc drive support in under 10 minutes after user request

Sony patent proposes converting game audio into visual and haptic cues for deaf players

Simon Ellis 0 comments 3 min read

Sony has patented a system that converts game audio into visual and haptic cues for deaf or hard- of- hearing players, including on- screen icons and controller vibrations.

Sony patent proposes converting game audio into visual and haptic cues for deaf players
GAMES

Sony has just patented the ability to display game audio information visually and through the controller for deaf or hearing impaired players. This system hopes to address important audio information while also not needing games to be reworked to achieve this. This patent, now made public (US 2026/0329526 A1 on Oct 22) provides a method to provide on-screen text and icons, as well as controller vibrations to represent audio. This is a potential change in the direction of accessibility at the OS level for console games.

Sony patent filing details system converting game audio into visual and haptic cues

Part of the process here involves categorizing sounds within the game and then representing the audio in certain ways. These categories include (per the patent filing) alerts and notifications, ambient and mood, dialogue, and environmental sounds. But the system also categorizes by 'emotion', such as being friendly, neutral, or aggressive in tone. There are also classifications for events trying to build suspense or surprise and so should be more noticeable for the player.

  • Sound Classification Categories: Alerts, notifications, ambient mood, dialogue, environmental effects, tension/surprise, friendly, neutral, aggressive
  • Visual Cue Examples: Warning icons near threats, on-screen text (e.g., 'Roar!'), graphical indicators around character, directional LEDs on controller
  • Audio Positioning Support: Stereo, 5.1, and 7.1 surround audio
  • Patent Publication Number: US 2026/0329526 A1

Additional visual cues can also be rendered directly on screen to help reinforce the audio event. For instance, warning icons could appear close to monsters that are attacking you. On-screen text like 'Roar!' might also appear.

Or a 'visual marker' can be around your character to represent where the sound is coming from. The controller can have directional LEDs around the touchpad to help with orientation through light.

This system supports stereo, 5.1, and 7.1 surround sound. It will pull left and right positioning from stereo but higher resolution information from the surround sound channels. There will be specific vibration patterns on the controller that relate to the sound classification. The idea here is that it could work as a helper app, or at the OS level and not require any specific code changes from game developers.

Sony hasn't specifically tied this into the PS5 or to the next console. A patent application doesn't mean it'll be part of current or next-gen hardware. Invented by Rajeev Gupta, Mark Jacobus Breugelmans, Carl Pryke, and Lloyd Preston Stemple.

This is a continuation of their 2023 application. For now, it's more of a conceptual design.

Source: NotebookCheck

Related stories

Discussion

0 comments

Leave a comment