Audio Space Time Processing

  1. Members
  2. Research Projects
  3. Publications

Members

NameInterests
Prof. Augusto Sarti
associate professor
Prof. Fabio Antonacci
assistant professor
Dr. Antonio Canclini
postdoc researcher
Distributed Microphone Networks, Acoustics of Musical Instruments, Acoustic scene rendering
Dr. Marco Compagnoni
postdoc researcher
Mathematical modeling of space-time processing algorithms
Dr. Dejan Marković
postdoc researcher
Acoustic scene analysis, modeling of acoustic propagation in complex environments
Dr. Paolo Bestagini
postdoc researcher
Distributed Microphone Networks
Ing. Lucio Bianchi
PhD student
Acoustic scene Analysis and rendering
Ing. Muhammad Shahnawaz
PhD student
Binaural Rendering, Head Related Transfer Function

top

Research Themes


The use of low-cost devices for acquisition of audio streams is becoming widespread. In this context, the space-time processing research community is interested to enable functionalities such as source localization and separation, denoising etc. on such devices, to keep at bay the cost of equipment. The research activity of ISPG aims at attaining this goal with ad-hoc algorithms to overcome the inherent challenges that pop up when one intends to use multiple independent devices. In particular, the research activity focuses on synchronization of streams acquired with different clocks, self-calibration, and reduction of the computational cost of space-time processing algorithms.



The activity of ISPG in the Musical Acoustics lab in Cremona is twofold: on one side state-of-the-art analysis techniques are used to measure acoustic parameters of instruments. Vibrometric measurements using laser vibrometer or accelerometers and instrumented hammer are used to estimate in a short time the patterns of vibration modes. On the other side ISPG focuses also on innovating the measurement methodology, thanks to the achievements attained in the space-time processing research area. An exemplary case is the introduction of a novel technique for the measurement of the radiation pattern of violins, which does not require the instrument to be played by mechanical bows and does not constrain the player to unnatural poses.



Starting from 2010, ISPG collaborates with researchers from Dept. of Mathematics in Politecnico di Milano. The goal is to shed light on the mathematical aspects of space-time processing algorithms, such as source localization from Time Differences Of Arrival. This task is accomplished through formalization, in mathematical terms, of the measurement space (e.g. TDOAs), and of the map from the measurement space to the source locations with tools from algebraic geometry, computational algebraic geometry, information geometry and statistical geometry. This analysis enables to obtain useful information about estimators, such as their robustness against noise, and also to innovate existing estimators, to attain a better performance in terms of accuracy, computational stability, etc.



The use of microphone arrays for the analysis of acoustic scenes has been a hot research topic for the last twenty years. Recently, ISPG has developed the plenacoustic framework: a representation of the sound field as a function of time, space, and direction of propagation, in which acoustic primitives of interest (such as sources, receivers, reflectors, etc.) are conveniently represented as linear patterns. It is therefore easier in this framework to perform tasks such as source localization, localization of reflectors and obstacles, extraction of acoustic sources from mixtures, etc. ISPG also works on the rendering of acoustic scenes through loudspeaker arrays. In this context different methodologies have been proposed, the most recent of which is based on the use of the plenacoustic framework.



Accurate and fast tracing acoustic paths from source to listener in complex environments is of great interest to architects and engineers to predict the acoustics of complex environments, such as auditoria, cinemas, theatres, etc. before their building. Moreover, accurate modeling of propagation is crucial for the rendering of virtual environments, e.g. immersive gaming and walkthrough. Inter In the last ten years ISPG has developed methodologies for accurate and fast tracing of acoustic beams based on a pre-computation of the mutual visibility between walls of the environment. Once this information has been computed in advance, and source and receiver locations are specified, the tracing of acoustic paths consist of a simple lookup on the pre-computed data structure. Techniques have been developed for both complex 3D and 2D environments.



In order for a binaural stream to deliver the sense of presence, a suitable modeling of the Head Related Transfer Function (HRTF) must be implemented, which models the response of the ear of the listener to sounds incoming from different directions. Every person has its own HRTF, and the use of a wrong HRTF impairs the listening experience. ISPG is developing techniques for accurate and simple personalization of the HRTF, by means of both direct measurement and prediction.


top

Publications


  1. D. Markovic, F. Antonacci, A. Sarti, S. Tubaro, "Multiview Soundfield Imaging in the Projective Ray Space," IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol.23, no.6, pp.1054,1067, June 2015 doi: 10.1109/TASLP.2015.2419076
  2. Canclini, P. Bestagini, F. Antonacci, M. Compagnoni, A. Sarti, S. Tubaro, "A Robust and Low-Complexity Source Localization Algorithm for Asynchronous Distributed Microphone Networks," IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol.23, no.10, pp.1563--1575, Oct. 2015 doi: 10.1109/TASLP.2015.2439040
  3. F. D'Amelio, L. Bianchi, F. Antonacci, A. Sarti, S. Tubaro, "A Plenacoustic Approach to acoustic signal extraction", in proceedings of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2015, New Paltz (NY), USA
  4. F. D'Amelio, L. Bianchi, F. Antonacci, A. Sarti, S. Tubaro, "A Plenacoustic Approach to acoustic signal extraction", in proceedings of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2015, New Paltz (NY), USA
  5. L. Bianchi, M. Verdi, F. Antonacci, A. Sarti, S. Tubaro, "High Resolution Imaging with Spherical Microphone Array", in proceedings of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2015, New Paltz (NY), USA
  6. D. Marković, F. Antonacci, A. Sarti, S. Tubaro, "Resolution issues in Soundfield Imaging: a multiresolution approach to sound source localization, in proceedings of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, WASPAA 2015, New Paltz (NY), USA
  7. Canclini, L. Mucci, F. Antonacci, A. Sarti and S. Tubaro, "A methodology for Estimating the Radiation Pattern of a violin during the Performance", in proceedings of 2015 European Signal Processing Conference (EUSIPCO 2015), Nice, France
  8. M. Buccoli, M. Zanoni, F. Setragno, F. Antonacci and A. Sarti, "An unsupervised approach to the semantic description of the sound quality of violins", in proceedings of 2015 European Signal Processing Conference (EUSIPCO 2015), Nice, France
  9. M. Mascia, A. Canclini, F. Antonacci, M. Tagliasacchi, A. Sarti and S. Tubaro, "Forensic and anti-forensic analysis of indoor/outdoor classifiers based on acoustic clues", in proceedings of 2015 European Signal Processing Conference (EUSIPCO 2015), Nice, France
  10. Canclini, L. Mucci, F. Antonacci, A. Sarti, S. Tubaro, "Estimation of the Radiation Pattern of a Violin During the Performance Using Plenacoustic Methods", in proceedings of the 138th AES International Convention, Warsaw, Poland, May 7-10 2015
  11. M. Zanoni, F. Setragno, F. Antonacci, A. Sarti, G. Fazekas, M. B. Sandler, "Training-Based Semantic Descriptors Modeling for Violin Quality Sound Characterization", in proceedings of the 138th AES International Convention, Warsaw, Poland, May 7-10 2015




  1. A.Canclini, D.Marković, L.Bianchi, F.Antonacci, A.Sarti and S.Tubaro, "A Robust Geometrical Approach to Room Compensation for Sound Field Rendering", in IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, vol. 2014, no. 9, pp. 1884-1892, 2014
  2. M.Compagnoni, R.Notari, F. Antonacci, A. Sarti, "A comprehensive analysis of the geometry of TDOA maps in localisation problems", Inverse Problems, IOP Science, volume 30, pages 1-49
  3. D. Marković, K.Kowalzcyk, F.Antonacci, C.Hoffman, W.Kellermann, A.Sarti "Estimation of acoustic reflection coefficients through pseudospectrum matching", IEEE/ACM Transactions on Audio Speech and Language Processing, volume 22, issue 1
  4. Canclini, D. Marković, L. Bianchi, F. Antonacci, A. Sarti, S. Tubaro, "A Geometrical Approach to Room Compensation for Sound Field Rendering Applications", in proc. of 2014 European Signal Processing Conference (EUSIPCO 2014), Lisbon, Sep. 1-5, 2014
  5. L.Bianchi, R. Magalotti, F.Antonacci, A.Sarti, and S.Tubaro, "Robust Beamforming Under Uncertainties in the Loudspeakers Directivity Pattern", in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP'14), Firenze, IT, May 4 - 9, 2014 2013
  6. D. Marković, F. Antonacci, A. Sarti, S. Tubaro, "Soundfield imaging in the ray space" IEEE/ACM Transactions on Audio, Speech and Language Processing, volume 21, issue 12
  7. Canclini,F. Antonacci, A. Sarti, S. Tubaro, "Acoustic Source Localization with Distributed Asynchronous Microphone Networks", in IEEE Transactions on Audio, Speech and Language Processing, volume 21, issue 2, Feb. 2013
  8. P. Bestagini , M. Compagnoni, F. Antonacci, A. Sarti, S. Tubaro, "TDOA-Based Acoustic Source Localization in the Space-Range Reference Frame",Multidimensional Systems and Signal Processing, March 2013, doi 10.1007/s11045-013-0233-8
  9. L.Bianchi, D.Marković, F.Antonacci, A.Sarti, S.Tubaro, "Deconvolution of Plenacoustic Images", in Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA'13), New Paltz, NY, US, Oct. 20 - 23




  1. L.Bianchi, F.Antonacci, A. Sarti, and S.Tubaro, "Rendering of Directional Sources through Loudspeaker Arrays based on Plane Wave Decomposition," in Proc. IEEE Int. Workshop on Multimedia Signal Processing (MMSP'13), Pula, IT, Sept. 30 - Oct. 2, 2013. Recipient of BEST STUDENT PAPER AWARD
  2. L.Bianchi, F.Antonacci, A.Canclini, A.Sarti, and S.Tubaro, "Localization of Virtual Acoustic Sources based on the Hough Transform for Sound Field Rendering Applications", in Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing (ICASSP'13), Vancouver, CA, May 26 - 31, 2013
  3. D. Marković, F.Antonacci, A. Sarti, S.Tubaro, "Estimation of Room Dimensions from a single Impulse Response", in proc. of 2013 IEEE International workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA'13)




  1. M.Compagnoni, P.Bestagini, F. Antonacci, A.Sarti, S.Tubaro, “Localization of Acoustic Sources through the Fitting of Propagation Cones using Multiple Independent Arrays”, IEEE Transactions on Audio, Speech and Language Processing, volume 20, issue 7, Sept. 2012
  2. F. Antonacci, J. Filos, M. R. P. Thomas, E. A. P. Habets, A. Sarti, P. A. Naylor and S. Tubaro (2012), "Inference of Room Geometry from Acoustic Impulse Responses," IEEE Transactions on Audio, Speech and Language Processing, volume 20, issue 10, Dec. 2012, pp. 2683-2695
  3. L.Bianchi, F.Antonacci, A.Canclini, A.Sarti, and S.Tubaro, "A Psychoacoustic-Based Analysis of the Impact of Pre-Echoes and Post-Echoes in Sound Field Rendering Applications", in Proc. Int. Workshop on Acoustic Signal Enhancement (IWAENC'12), Aachen, DE, Sept. 4-6, 2012
  4. Canclini, D. Marković, F. Antonacci, A. Sarti, S. Tubaro, "A Room-compensated virtual surround systesm exploiting early reflections in a reverberant room", in proc. of 2012 European Signal Processing Conference (EUSIPCO 2012)
  5. A.Contini, A. Canclini, F.Antonacci, M.Compagnoni, A.Sarti, S.Tubaro, “Self-calibration of microphone arrays from measurement of Times Of Arrival of acoustic signals”, in proc. of 5th International Symposium on Communications, Control and Signal Processing, ISCCSP 2012
  6. J.Filos, A.Canclini, F.Antonacci, A.Sarti, P.A.Naylor, "Localization of planar acoustic reflectors from the combination of linear estimates", in proc. of 2012 European Signal Processing Conference
  7. Canclini, F. Antonacci, J. Filos, A.Sarti and P.A.Naylor "Exact localization of planar acoustic reflectors in three-dimensional geometries", in proc. of 2012 International Workshop on Acoustic, Echo and Noise Control (IWAENC'12)
  8. D. Marković, C. Hofmann, F. Antonacci, K. Kowalzcyk, A.Sarti, W.Kellermann, "Reflection coefficient estimation by pseudospectrum matching", in proc. of 2012 International Workshop on Acoustic, Echo and Noise Control (IWAENC'12)
  9. D. Marković, G. Sandrini, F.Antonacci, A.Sarti, S.Tubaro, "Plenacoustic imaging in the ray space", in proc. of 2012 International Workshop on Acoustic, Echo and Noise Control (IWAENC'12)




  1. L.An, P.Wang, A. Sarti, F.Antonacci, J.Shi, “Hyperbolic boiler tube leak location based on quaternary acoustic array”, Elsevier J. of Applied Thermal Engineering, volume 31
  2. Canclini, P. Annibale, F. Antonacci, A. Sarti, R. Rabenstein, S. Tubaro, “A Methodology for evaluating the accuracy of wave field rendering techniques”, in proc. of 2011 International Conference on Acoustics, Speech and Signal Processing (ICASSP 2011), pp. 69-72, Prague, Czech Republic, May 2011
  3. A.Canclini, P. Annibale, F. Antonacci, R.Rabenstein, A. Sarti, S. Tubaro, “An angular frequency domain metric for the evaluation of wave field rendering techniques”, in proc. of 19th European Signal Processing Conference (EUSIPCO’11), pp., Barcelona, Aug. 29, Sept. 2, 2011
  4. Sarti, W. Kellermann, R. Rabenstein, P. A. Naylor, M. Omologo, P. Svaizer, F. Antonacci, P. Annibale, P. Bestagini, A. Canclini, D. Marković, K. Kowalzcyk, M. R. P. Thomas and A. Brutti, L. Cristoforetti, A. Lombard, E. Mabande "The SCENIC Project: Space-Time Audio Processing for Environment-Aware Acoustic Sensing and Rendering," in Proc. AES 131st Convention, New York, Oct. 2011
  5. Canclini, P. Annibale, F. Antonacci, R. Rabenstein, A. Sarti, S.ubaro, “From direction of arrival estimates to localization of planar reflectors in a two dimensional geometry”, in proc. of 2011 International Conference on Acoustics, Speech and Signal Processing (ICASSP 2011), pp. 2620-2623, Prague, Czech Republic, May 2011
  6. J.Filos, M.R.P. Thomas, F. Antonacci, A.Sarti, P.Naylor, “Robust inference of room geometry from acoustic measurements using the Hough transform”, in proc. of 19th European Signal Processing Conference (EUSIPCO’11), pp. 161-165, Barcelona, Aug. 29, Sept. 2, 2011
  7. E.Nastasia, F. Antonacci, A. Sarti, S.Tubaro, “Localization of planar acoustic reflectors through emission of controlled stimuli”, in proc. of 19th European Signal Processing Conference (EUSIPCO’11), pp. 156-160, Barcelona, Aug. 29, Sept. 2, 2011
  8. Canclini, F. Antonacci, M. R. P. Thomas, J. Filos, A. Sarti, P. A. Naylor and S. Tubaro," Exact Localization of Acoustic Reflectors from Quadratic Constraints," in Proc. Workshop on App. of Signal Processing to Audio and Acoust. (WASPAA 2011), pp. 17-20, New Paltz, New York, Oct. 2011




  1. F.Antonacci, A.Sarti, S.Tubaro, “Two-dimensional beam-tracing from Visibility Diagrams for Real-Time Acoustic Rendering”, EURASIP Journal on Advances in signal Processing (ISSN: 1687-6172), 2010, pages 1-18
  2. D.Marković, A. Canclini, F. Antonacci, A. Sarti, S. Tubaro, “Visibility-Based Beam Tracing for Soundfield Rendering”, in proc. of International Workshop on Multimedia Signal Processing, MMSP2010, Saint Malo, France, October 2010
  3. S.D. Valente, F.Antonacci, M.Tagliasacchi, A.Sarti, S.Tubaro, “Self-calibration of two microphone arrays from volumetric acoustic maps in non-reverberant rooms”, in proc. of International Symposium on Communications Control and Signal Processing, Cyprus, March 2010
  4. S.D. Valente, M. Tagliasacchi, F. Antonacci, P.Bestagini, A.Sarti, S.Tubaro, “Geometric calibration of distributed microphone arrays from acoustic source correspondences”, in proc. of International Workshop on Multimedia Signal Processing, MMSP2010, October 2010
  5. F.Antonacci, A. Sarti, S. Tubaro, "Geometric reconstruction of the environment from its response to multiple acoustic emissions," 2010 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP), vol., no., pp.2822-2825, 14-19 March 2010



top