General sound classification and similarity in MPEG-7

Michael Casey

doi:10.1017/S1355771801002126

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

We introduce a system for generalised sound classification and similarity using a machine-learning framework. Applications of the system include automatic classification of environmental sounds, musical instruments, music genre and human speakers. In addition to classification, the system may also be used for computing similarity metrics between a target sound and other sounds in a database. We discuss the use of hidden Markov models for representing the temporal evolution of audio spectra and present results of testing the system on classification and retrieval tasks. The system has been incorporated into the MPEG-7 international standard for multimedia content description and is therefore publicly available in the form of a set of standardised interfaces and software reference tools for developers and researchers.

Crossref Citations

This article has been cited by the following publications. This list is generated based on data provided by Crossref.

Eronen, A. 2003. Musical instrument recognition using ICA-based transform of features and discriminatively trained HMMs. p. 133.

Shakra, l. Frederico, G. and Saddik, A.E. 2004. Music indexing and retrieval. p. 83.

Yogurtcu, O.N. and Erzin, E. 2005. Musical instrument recognition using reflection coefficients. p. 203.

Eronen, A.J. Peltonen, V.T. Tuomi, J.T. Klapuri, A.P. Fagerlund, S. Sorsa, T. Lorho, G. and Huopaniemi, J. 2006. Audio-based context recognition. IEEE Transactions on Audio, Speech and Language Processing, Vol. 14, Issue. 1, p. 321.

Levy, Mark and Sandler, Mark 2008. Structural Segmentation of Musical Audio by Constrained Clustering. IEEE Transactions on Audio, Speech, and Language Processing, Vol. 16, Issue. 2, p. 318.

Holzapfel, AndrÉ and Stylianou, Yannis 2008. Musical Genre Classification Using Nonnegative Matrix Factorization-Based Features. IEEE Transactions on Audio, Speech, and Language Processing, Vol. 16, Issue. 2, p. 424.

Potamitis, Ilyas and Ganchev, Todor 2008. Multimedia Services in Intelligent Environments. Vol. 120, Issue. , p. 41.

Paulus, Jouni and Klapuri, Anssi 2009. Music Structure Analysis Using a Probabilistic Fitness Measure and a Greedy Search Algorithm. IEEE Transactions on Audio, Speech, and Language Processing, Vol. 17, Issue. 6, p. 1159.

Cheng, Heng-Tze Yang, Yi-Hsuan Lin, Yu-Ching and Chen, Homer H. 2009. Multimodal structure segmentation and analysis of music using audio and textual information. p. 1677.

Zwan, Pawel and Czyzewski, Andrrzej 2010. Verification of the Parameterization Methods in the Context of Automatic Recognition of Sounds Related to Danger. Journal of Digital Forensic Practice, Vol. 3, Issue. 1, p. 33.

Roma, Gerard Janer, Jordi Kersten, Stefan Schirosa, Mattia Herrera, Perfecto and Serra, Xavier 2010. Ecological Acoustics Perspective for Content-Based Retrieval of Environmental Sounds. EURASIP Journal on Audio, Speech, and Music Processing, Vol. 2010, Issue. 1, p. 960863.

Łopatka, Kuba Zwan, Paweł and Czyżewski, Andrzej 2010. Advances in Multimedia and Network Information System Technologies. Vol. 80, Issue. , p. 49.

Klapuri, Anssi and Virtanen, Tuomas 2010. Representing Musical Sounds With an Interpolating State Model. IEEE Transactions on Audio, Speech, and Language Processing, Vol. 18, Issue. 3, p. 613.

Gygi, Brian and Shafiro, Valeriy 2010. Development of the Database for Environmental Sound Research and Application (DESRA): Design, Functionality, and Retrieval Considerations. EURASIP Journal on Audio, Speech, and Music Processing, Vol. 2010, Issue. 1, p. 654914.

Hafen, Ryan P. and Henry, Michael J. 2012. Speech information retrieval: a review. Multimedia Systems, Vol. 18, Issue. 6, p. 499.

Vozarikova, Eva Lojka, Martin Juhar, Jozef and Cizmar, Anton 2012. Multimedia Communications, Services and Security. Vol. 287, Issue. , p. 350.

Vavrek, Jozef Vozarikova, Eva Pleva, Matus and Juhar, Jozef 2012. Broadcast news audio classification using SVM binary trees. p. 469.

Esling, Philippe and Agon, Carlos 2013. Multiobjective Time Series Matching for Audio Classification and Retrieval. IEEE Transactions on Audio, Speech, and Language Processing, Vol. 21, Issue. 10, p. 2057.

Doherty, Jonathan Curran, Kevin and Mckevitt, Paul 2013. A self-similarity approach to repairing large dropouts of streamed music. ACM Transactions on Multimedia Computing, Communications, and Applications, Vol. 9, Issue. 3, p. 1.

Ntalampiras, Stavros 2014. Directed Acyclic Graphs for Content Based Sound, Musical Genre, and Speech Emotion Classification. Journal of New Music Research, Vol. 43, Issue. 2, p. 173.

Download full list

Article contents

General sound classification and similarity in MPEG-7

Abstract

Save article to Kindle

Save article to Dropbox

Save article to Google Drive

Reply to: Submit a response

Your details

You have entered the maximum number of contributors

Conflicting interests