EchoCompass active
Lawliet-ai vunknown added 2026-08-01 verified 2026-08-01
You need to visualize sound directionality from FPS game audio for deaf or hard-of-hearing players without accessing game memory or processes.
about
EchoCompass captures the binaural stereo audio output of FPS games and derives directional information by analyzing inter-aural level differences during transient attack windows. Gunshots appear as red spikes and footsteps as blue dots on a compass display, distributed across a PC window, ESP32 round LCD (GC9A01 240x240), or a phone browser over LAN.
Direction is computed with pure signal processing — no ML model, no network calls, no game process access. The tool reads only the OS audio output (what the headphones already receive) and converts it into a visual equivalent of the spatial cues a hearing player gets for free. A legacy 7.1 discrete-channel energy-weighted path is also retained for games that output true surround.
Known hard limits: front/back discrimination is not solved (physics boundary for two-channel ILD), simultaneous multi-source events only show one direction, and real-game reflections/reverb cause frequent angle drift. The authors describe it as a validated skeleton — full pipeline works, but real-game accuracy is inconsistent. Intended as an accessibility research starting point, not a finished product.
related
libmysofa
Standalonelibmysofa is a C library for reading and processing Head-Related Transfer Function (HRTF) data stored in AES SOFA files conforming to the AES69-2015 standard. It provides functions to load SOFA files, extract HRTF filters for specific spatial coordinates, and convert between Cartesian and spherical coordinate systems. The library handles automatic normalization of HRTF data, nearest-neighbor interpolation for arbitrary listener positions, and efficient caching of multiple SOFA files. It supports both integer and floating-point filter extraction with configurable sample rates and neighbor search parameters. Designed for integration into spatial audio engines and renderers, libmysofa offers both simple and advanced APIs for developers who need direct access to HRTF data without implementing SOFA parsing from scratch.
Microsoft Spatializer
UnityA cross-platform spatializer plugin that integrates spatial audio processing into Unity projects. The plugin uses efficient DSP algorithms to render head-related transfer functions (HRTF) for immersive 3D audio positioning. Designed to fit Unity's audio engine architecture, it supports both Windows and Android platforms. Version 2.0 represents a complete rewrite focused on performance optimization and cross-platform compatibility. The plugin uses a multi-source mixer architecture that reduces CPU overhead compared to previous implementations. While an older HoloLens 2-specific version (v1) offered hardware DSP offload, the current version prioritizes flexibility and integration with Unity's audio pipeline. Note: the GitHub repository was archived (made read-only) in July 2024 and is no longer actively developed, though it remains usable for existing projects. It enables realistic directional audio cues essential for VR, AR, and immersive gaming experiences.
Omnitone
StandaloneOmnitone is a Web Audio API implementation of ambisonic decoding and binaural rendering. It supports first-order (4-channel) and higher-order ambisonic streams (2nd and 3rd order, up to 16 channels). The library uses native Web Audio nodes for performance-critical processing, ensuring efficient CPU usage. The implementation follows the Google spatial media specification and uses SADIE binaural filters for rendering. It accepts input from HTML media elements or multichannel AudioBufferSourceNodes, with support for dynamic rotation matrices to orient the sound field in response to user interaction or sensor data. Omnitone powers the Resonance Audio SDK for web and provides both ambisonic and bypass rendering modes. The library is designed for browser-based spatial audio applications, VR experiences, and 360-degree video playback. Note: the last release (v1.3.0) was in January 2019, so the project is effectively dormant.
Resonance Audio for Wwise
WwiseResonance Audio for Wwise is a plugin package that integrates Google's spatial audio engine into the Wwise authoring and runtime pipeline. It provides two plugins: a Renderer that spatializes sound sources binaurally via Wwise's Ambisonic bus pipeline (supporting up to third-order Ambisonics), and a Room Effects plugin that simulates early reflections and late reverberation based on parametric room geometry. The integration targets desktop (Windows, macOS, Linux) and mobile (Android, iOS) platforms. You set up an Ambisonic audio bus in Wwise Authoring, attach the Resonance Audio Renderer as a mixer plugin, and route sound sources through it. Room effects are applied per-source, letting you vary acoustic character across game spaces without baking impulse responses. Requires Wwise 2017.1.0.6302 or newer. This is useful when you need consistent, cross-platform binaural output from Wwise without relying on platform-native spatial audio APIs.