Research
machine learning for audio, audio signal processing, music information retrieval, binaural audio
Interests
Johan’s aim is to make machines understand audio to the level of a trained professional, such that new tools can be developed to assist musicians performing live or in the studio, listeners navigating large music collections and learners studying music. To that end, he uses a combination of machine learning, signal processing, data science and music theory. In recent years, he has been working on narrowing the gap between academic research and user-centric applications, web-based music services and the personalisation of spatial and immersive audio.
Publications of specific relevance to the Centre for Multimodal AI
Publications of specific relevance to the Centre for Multimodal AI
2025
Towards a Unified Representation Evaluation Framework Beyond Downstream TasksPlachouras C Guinot J Fazekas G Quinton E Benetos E Pauwels J
International Joint Conference on Neural Networks Rome, Italy 30 Jun 2025 - 5 Jul 2025.
30-06-2025Learning Music Audio Representations With Limited DataPlachouras C Benetos E Pauwels J
ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 6 Apr 2025 - 11 Apr 2025., 1-5.
06-04-2025 Evaluating Contrastive Methodologies for Music Representation Learning Using Playlist Data ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 6 Apr 2025 - 11 Apr 2025., 1-5.
06-04-2025 Listener Acoustic Personalization Challenge—LAP24: Head-Related Transfer Function Dataset HarmonizationDaugintis R Barumerli R Geronazzo M Pauwels J Picinali L Poole KC
IEEE Open Journal of Signal Processing,
Institute of Electrical and Electronics Engineers (IEEE) vol. 6, 950-964.
01-01-2025 2024
Musician-AI partnership mediated by emotionally-aware smart musical instrumentsTurchet L Stefani D Pauwels J
International Journal of Human-Computer Studies,
Elsevier Bv vol. 191, 103340-103340.
01-11-2024 Multi-Signal Informed Attention for Beat and Downbeat DetectionBolt J Pauwels J Fazekas G
2024 IEEE 5th International Symposium on the Internet of Sounds (IS2) 30 Sep 2024 - 2 Oct 2024., 1-7.
30-09-2024 Evaluation of pretrained language models on music understandingVasilakis Y Bittner R Pauwels J
17-09-2024 I can listen but cannot read: An evaluation of two-tower multimodal\n systems for instrument recognitionVasilakis Y Bittner R Pauwels J
25-07-2024 Time-of-arrival Estimation and Phase Unwrapping of Head-related Transfer\n Functions With Integer Linear ProgrammingYu C-Y Pauwels J Fazekas G
10-05-2024 I CAN LISTEN BUT CANNOT READ: AN EVALUATION OF TWO-TOWER MULTIMODAL SYSTEMS FOR INSTRUMENT RECOGNITIONVasilakis Y Bittner R Pauwels J
01-01-2024 Evaluation of pretrained language models on music understandingVasilakis Y Bittner R Pauwels J
Proceedings of the 3rd Workshop on Nlp for Music and Audio Nlp4musa 2024., 98-106.
01-01-2024 Time-of-arrival estimation and phase unwrapping of head-related transfer functions with integer linear programmingYu CY Pauwels J Fazekas G
AES Madrid 2024 156th Audio Engineering Society Convention.
01-01-2024 2023
On the Relevance of the Differences Between HRTF Measurement Setups for Machine LearningPauwels J Picinali L
ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 4 Jun 2023 - 10 Jun 2023., 1-5.
04-06-2023 The SONICOM HRTF DatasetEngel I Daugintis R Vicente T Hogg AOT Pauwels J Tournier AJ Picinali L
Journal of The Audio Engineering Society,
Audio Engineering Society vol. 71 (5), 241-253.
17-05-2023 “Give me happy pop songs in C major and with a fast tempo”: A vocal assistant for content-based queries to online music repositoriesTurchet L Zanotto C Pauwels J
International Journal of Human-Computer Studies,
Elsevier Bv vol. 173, 103007-103007.
01-05-2023 The Hartufo toolkit for machine learning with HRTF dataPauwels J
International Conference on Spatial and Immersive Audio 2023., 218-229.
01-01-2023 POLAR MANHATTAN DISPLACEMENT: MEASURING TONAL DISTANCES BETWEEN CHORDS BASED ON INTERVALLIC CONTENTMiller J Pauwels J Sandler M
24th International Society for Music Information Retrieval Conference Ismir 2023 Proceedings., 868-874.
01-01-2023 2022
On The Relevance Of The Differences Between HRTF Measurement Setups For\n Machine LearningPauwels J Picinali L
08-12-2022 Music Emotion Recognition: Intention of Composers-Performers Versus Perception of Musicians, Non-Musicians, and Listening MachinesTurchet L Pauwels J
IEEE/Acm Transactions on Audio, Speech, and Language Processing,
Institute of Electrical and Electronics Engineers (IEEE) vol. 30, 305-316.
01-01-2022 2021
The WASABI Dataset: Cultural, Lyrics and Audio Analysis Metadata About 2 Million Popular Commercially Released SongsBuffa M Cabrio E Fell M Gandon F Giboin A Hennequin R Michel F Pauwels J et al.
In
Lecture Notes in Computer Science,
Springer International Publishing 515-531.
01-01-2021 2020
Cloud-smart Musical Instrument InteractionsTurchet L Pauwels J Fischione C Fazekas G
Acm Transactions on Internet of Things,
Association For Computing Machinery (Acm) vol. 1 (3), 1-29.
01-06-2020 A Critical Look at the Applicability of Markov Logic Networks for Music\n Signal AnalysisPauwels J Fazekas G Sandler MB
16-01-2020 2019
Guitar String Separation Using Non-Negative Matrix Factorization and Factor DeconvolutionSenvaityte D Pauwels J Sandler M
AM'19: Audio Mostly., 239-243.
18-09-2019 Finding new practice material through chord-based exploration of a large music cataloguePauwels J Sandler MB
Proceedings of the Sound and Music Computing Conferences., 497-498.
20-05-2019 A web-based system for suggesting new practice material to music learners based on chord contentPauwels J Sandler MB
Ceur Workshop Proceedings. vol. 2327
01-01-2019 20 years of automatic chord recognition from audioPauwels J O'Hanlon K Gómez E Sandler MB
Proceedings of the 20th International Society for Music Information Retrieval Conference Ismir 2019., 54-63.
01-01-2019 2018
Exploring Real-time Visualisations to Support Chord Learning with a Large Music CollectionPauwels J Xambo Sedo A Roma G Barthet M Fazekas G
4th Web Audio Conference (WAC) Berlin, Germany 19 Sep 2018 - 21 Sep 2018.
19-09-2018 pywebaudioplayer: Bridging the gap between audio processing code and attractive visualisations based on web technologyPauwels J Sandler M
4th Web Audio Conference (WAC) Berlin, Germany 19 Sep 2018 - 21 Sep 2018.
19-09-2018 Recommending songs to music learners based on chord contentPauwels J Fazekas G Sandler M
2018 Joint Workshop on Machine Learning for Music Stockholm, Sweden 14 Jul 2018.
14-07-2018 Jam with Jamendo: Querying a Large Music Collection by Chords from a Learner's PerspectiveXambo A Pauwels J Roma G Barthet M Fazekas G
2018 CONFERENCE ON INTERACTION WITH SOUND (AUDIO MOSTLY): SOUND IN IMMERSION AND EMOTION (AM'18).
01-01-2018 GuitarSet: A Dataset for Guitar Transcription.Xi Q Bittner RM Pauwels J Ye X Bello JP
ISMIR., 453-460.
01-01-2018 2017
Guitar-set preview: a dataset for guitar transcription and moreXi Q Bittner RM PAUWELS J EWERT S Bello JP
18th Conference of the International Society for Music Information Retrieval (ISMIR): Late Breaking/Demo Session Suzhou, China 23 Oct 2017 - 27 Dec 2017.
23-10-2017 Improved template based chord recognition using the CRP featureO'Hanlon K Ewert S Pauwels J Sandler MB
2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 5 Mar 2017 - 9 Mar 2017., 306-310.
01-03-2017 Confidence measures and their applications in music labelling systems based on hidden markov modelsPauwels J O'Hanlon K Fazekas G Sandler MB
Proceedings of the 18th International Society for Music Information Retrieval Conference Ismir 2017., 279-285.
01-01-2017 2016
Music Data Analysis 17-11-2016 Exploiting prior knowledge during automatic key and chord estimation from musical audioPAUWELS J
24-03-2016 2014
Combining Musicological Knowledge About Chords and Keys in a Simultaneous Chord and Local Key Estimation SystemPauwels J Martens J-P
Journal of New Music Research,
Informa Uk Limited vol. 43 (3), 318-330.
03-07-2014 On comparative statistics for labelling tasks: What can we learn from MIREX ACE 2013?Burgoyne JA de Haas WB Pauwels J
Proceedings of the 15th International Society for Music Information Retrieval Conference Ismir 2014., 525-530.
01-01-2014 2013
Segmenting music through the joint estimation of keys, chords and structural boundariesPauwels J Peeters G
MM '13: ACM Multimedia Conference., 741-744.
21-10-2013 Evaluating automatically estimated chord sequencesPauwels J Peeters G
ICASSP 2013 - 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 26 May 2013 - 31 May 2013., 749-753.
01-05-2013 Combining harmony-based and novelty-based approaches for structural segmentationPauwels J Kaiser F Peeters G
Proceedings of the 14th International Society for Music Information Retrieval Conference Ismir 2013., 601-606.
01-01-2013 2011
The Influence of Chord Duration Modeling on Chord and Local Key ExtractionPauwels J Martens J-P Leman M
2011 Tenth International Conference on Machine Learning and Applications (ICMLA 2011) 18 Dec 2011 - 21 Dec 2011., 136-141.
01-12-2011 Modeling musicological information as trigrams in a system for simultaneous chord and local key extractionPauwels J Martens J-P Leman M
2011 IEEE International Workshop on Machine Learning for Signal Processing (MLSP) 18 Sep 2011 - 21 Sep 2011., 1-6.
01-09-2011 Improving the key extraction performance of a simultaneous local key and chord estimation systemPauwels J Martens J-P Lemanz M
2011 IEEE International Conference on Multimedia and Expo (ICME) 11 Jul 2011 - 15 Jul 2011., 1-6.
01-07-2011 2010
Integrating musicological knowledge into a probabilistic framework for chord and key extractionPauwels J Martens JP
128th Audio Engineering Society Convention 2010. vol. 2, 717-725.
01-12-2010 2008
A novel chroma representation of polyphonic music based on multiple pitch tracking techniquesVarewyck M Pauwels J Martens J-P
MM08: ACM Multimedia Conference 2008., 667-670.
26-10-2008 A 2 Million Commercial Song Interactive NavigatorBuffa M Pauwels J Lebrun J Pellerin G
Proceedings of the 5th Web Audio Conference (WAC) Trondheim, Norway 4 Dec 2019 - 6 Dec 2019.
