Method developed to identify musical notes at any venue

April 23, 2010

A team of telecommunications engineers from the University of Jaen (UJA) has created a new method to automatically detect and identify the musical notes in an audio file and generate sheet music. The system identifies the notes even when the type of instrument, musician, type of music or recording studio conditions vary.

"We propose an automatic system to detect and transcribe musical notes for one-instrument musical signals which, unlike other methods, is capable of adapting to the music scene", Julio José Carabias, co-author of the paper and a researcher from the Department of Telecommunications Engineering at the University of Jaen explained to SINC.

The details of the method were published recently in IEEE Transactions on Audio, Speech, and Language Processing. The fact that the new system can "adapt" means it will work even if elements such as the type of instrument, music, style, studio or microphone position vary.

"Automatic music transcription has many practical applications for musicological analysis and is of enormous assistance, for example, in recovering musical content, separating audio sources and codifying or converting audio files", Carabias says.

The researchers start with a 'wav' file, a common format for audio recordings, and after applying the method they obtain a 'midi' file, a musical instrument communication protocol that makes it possible to visualise the sheet music and listen to the result.

Harmonic Dictionary

"Another advantage of this method is that it does not require prior training with a musical database," the engineer highlights. What the technique does determine is the note or 'spectral pattern' of the musical notes of an instrument, which are used to compile a harmonic dictionary.

In music, people talk about 'harmonicity' when the energy produced by a note is distributed across the multiple positions of a fundamental frequency. The distribution of the harmonic energy of a musical note is what defines its spectral pattern. The harmonic diction is a matrix in which the typical spectral patterns of all musical notes are represented.

With the help of this dictionary and a computer algorithm called 'Matching Pursuit', the musical notes with patterns that most resemble the harmonic dictionary are identified. While the method can only be applied to files with one sole instrument at present, the scientists are already investigating how it can be applied to several.

J. J. Carabias-Orti, P. Vera-Candeas, F. J. Cañadas-Quesada y N. Ruiz-Reyes. "Music Scene-Adaptive Harmonic Dictionary for Unsupervised Note-Event Detection". IEEE Transactions on Audio, Speech, and Language Processing 18 (3): 473 - 486, marzo de 2010.

FECYT - Spanish Foundation for Science and Technology

Related Music Articles from Brightsurf:

Seeing chemical reactions with music
Audible sound enables chemical coloring and the coexistence of different chemical reactions in a solution.

Music on the brain
A new study looks at differences between the brains of Japanese classical musicians, Western classical musicians and nonmusicians.

We feel connected when we move together in time with music
Go dancing! A new study conduted at Center for Music in the Brain at Aarhus University, Denmark, suggest that then moving together with music, synchronous movements between individuals increase social closeness.

The 'purrfect' music for calming cats
Taking a cat to the vets can be a stressful experience, both for cat and owner.

Young people putting music to the crisis: the role of music as a political expression
On February 1, 2020, the journal Young is publishing a special issue on youth, music and crisis involving Mònica Figueras, José Sánchez-García and Carlos Feixa, researchers from the Youth, Society and Communication Research Group ( at the Department of Communication.

Music is universal
Exactly what about music is universal, and what varies? Harvard researchers have demonstrated that across cultures, people share psychological mechanisms that make certain songs sound 'right' in specific social and emotional contexts.

Why music makes us feel, according to AI
In a new study, a team of USC researchers, with the help of artificial intelligence, investigated how music affects listeners' brains, bodies and emotions.

The brain's favorite type of music
People prefer songs with only a moderate amount of uncertainty and unpredictability, according to research recently published in JNeurosci.

Watching music move through the brain
Scientists have observed how the human brain represents a familiar piece of music, according to research published in JNeurosci.

Storing data in music
Researchers at ETH Zurich have developed a technique for embedding data in music and transmitting it to a smartphone.

Read More: Music News and Music Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to