This repository contains MATLAB functions to obtain binaural rendering filters for the least squares (LS) method, the magnitude least squares (MagLS) method, and the newly proposed End-to-End MagLS methods using SH-domain processing (eMagLS) and using (raw) microphone signals (eMagLS2).
The following files demonstrate the generation of rendering filters and binaural rendering:
testEMagLs.m: showcases rendering from spherical and equatorial microphone arrays (SMAs and EMAs)testEMagLsFromAtfs.m: showcases rendering for arbitrary arrays based on array transfer functions (ATFs)
For more information and if you want to reference the code please refer to the publication for SMAs or the publication for EMAs respectively.
T. Deppisch, H. Helmholz, and J. Ahrens,
“End-to-End Magnitude Least Squares Binaural Rendering of Spherical Microphone Array Signals,”
in 2021 Immersive and 3D Audio: from Architecture to Automotive (I3DA), 2021, pp. 1–7. doi: 10.1109/I3DA48870.2021.9610864.
H. Helmholz, T. Deppisch, and J. Ahrens,
“End-to-End Magnitude Least Squares Binaural Rendering for Equatorial Microphone Arrays,”
in Fortschritte der Akustik -- DAGA 2023, 2023, pp. 1679–1682.
ATF-based rendering of signals from smartglasses was e.g. used in
Thomas Deppisch, Nils Meyer-Kahlen, Sebastia Amengual Gari, "Blind Identification of Binaural Room Impulse Responses from Smart Glasses",
IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 32, pp. 4052-4065, 2024,
doi: 10.1109/TASLP.2024.3454964.
Make sure to clone the repository including submodules git clone --recurse-submodules or add the Spherical Harmonic Transform Library and the Ambisonic Encoding Toolbox manually to the dependencies/ folder.
This repository depends on the Spherical Harmonic Transform Library, the Array Response Simulator, and uses a publicly accessible HRIR set for demonstration purposes. It further uses an excerpt of an em32 recording from the 3D-MARCo library. Files from external sources are subject to their corresponding licenses.
We thank Facebook Reality Labs Research for funding this project.
See CHANGELOG for full details.
This software is licensed under a Non-Commercial Software License (see LICENSE for full details).