|
Online game feeds music search engine project at UC San Diego
September 26, 2007UC San Diego electrical engineers and computer scientists are working together on a computerized system that will make it easy for people who are not music experts (like the senior author's mom) to find the kind of music they want to listen to - without knowing the names of artists or songs.
In a new paper, the researchers demonstrate that the online music game they created provides crucial data for building the back-end of a music search engine that allows users to type in words in order to find songs.
"When my mom gets up in the morning and is like, 'I need some energy to go jogging,' she has no clue what title or artist is going to help her with that," said Gert Lanckriet, the UCSD electrical engineering professor overseeing the project.
What Gert's mom needs is a "Google for music" - a search engine for music that lets you type in regular words like "high energy instrumental with piano," "funky guitar solos" or "upbeat music with female vocals," and get songs in return.
One option for creating this kind of natural-language music search engine is to manually annotate as many songs as possible - but this is expensive and limits the depth and breadth of the search engine's reach. Another option is to train computers to do the song annotations.
The UCSD researchers have, in fact, built such a system over the last two years. They call it a computer audition system. You feed it songs and it annotates them, thanks to a series of algorithms they created. Once a song is annotated, you can retrieve it using a text-based search engine. But before the system can start annotating songs, it has to be trained - via a process of machine learning. Getting enough data to properly train the system to label a wide range of music accurately is difficult.
At an academic conference on music information retrieval this week in Vienna, Austria, the UCSD researchers describe important progress toward this goal. Lanckriet and others from UCSD report that an online music game they created, called Listen Game, is capable of capturing the crucial word-song combinations that are needed to train their system to label large numbers of songs automatically.
Listen Game is an online, multiplayer game prototype that gets players to label songs with words. Like the popular image labeling games, such as ESP game, Peekaboom and Phetch, Listen Game relies on people surfing the Web to generate valuable data while playing the game. For Listen Game, the "human computation" occurs when users listen to clips of songs and determine which words are most and least relevant to the song. Users earn points when they pick the same words as others who are playing at the same time and listening to the same song clips.
Collections of reliable word-song combinations are of great interest to the UCSD researchers. They use these "semantic annotations of music" to train their home-grown computer system to label songs it has not previously encountered.
In their paper, the UCSD researchers show that the word-song combinations generated by people playing Listen Game can be used to accurately train their system to label new songs.
"We've shown - in academic terms - that our game works. We're close to the performance we get with comparable survey data from the music undergrads we paid to fill out music surveys," said Doug Turnbull, a computer science Ph.D. student at UCSD who, along with Lanckriet, is an author on three papers presented at ISMIR, the music information retrieval conference.
Thanks to a grant from the UCSD Jacobs School of Engineering's von Liebig Center, the team is working with interactive designers to make the game more fun and engaging. With the new games, the researchers hope to collect the data necessary to continue to develop their automated music annotation system.
"A bunch of engineers made Listen Game. The second generation will have a livelier look and feel," said Lanckriet.
The researchers will release new games later in 2007. The games will be free and will carry no advertising. Players will be able to play anonymously or they can log in and customize and personalize the games and socialize with other players in real time. Send an email to gert@ece.ucsd.edu to be notified when the new games are released.
In addition to the ISMIR paper focused on Listen Game, the UCSD researchers are presenting a paper at the same conference on identifying words that are most likely to be meaningful to music search engines and another paper on detecting boundaries within songs.
Work on the word identification paper began two years ago, when the researchers were mining text from music reviews of specific songs, in search of words that are meaningful and useful in the context of a music search engine.
"If you look at a music review, there are so many words that are not relevant, you want to filter them out to get the quality training data, to get words that are acoustically describing the song," said David Torres, a UCSD computer science student working on his master's degree and an author on the paper.
The authors propose an approach for identifying musically meaningful words and show that this kind of filtering can improve the performance of the music annotation and retrieval system.
They also highlight complications that arise from the fact that music is subjective. "For example, a pre-teen girl might consider a Backstreet Boys song to be 'touching and powerful' whereas a dj at an indie radio station may consider it 'abrasive and pathetic,'" the authors write. To account for this subjectivity, electrical engineering Ph.D. student and paper author Luke Barrington explained that the team considers the level of human agreement for different words when filtering through the music annotations they collect.
In the third paper, Turnbull, Lanckriet and authors from Japan's National Institute of Advanced Industrial Science and Technology, present their work on detecting boundaries between musical segments in a song, such as between a verse and a chorus. The researchers' strategy for automatic boundary detection could be useful for generating music thumbnails, for efficient music browsing and for music information retrieval.
"In order to analyze the audio of a song, it is useful to be able to chop it up into meaningful segments," said first author Doug Turnbull.
"Maybe you want to listen to the Beatles, but mellow Beatles. You don't want to listen to "Back in the USSR." We are building a system that lets you use natural language to search for music with this level of detail," said Turnbull.
University of California - San Diego
What Gert's mom needs is a "Google for music" - a search engine for music that lets you type in regular words like "high energy instrumental with piano," "funky guitar solos" or "upbeat music with female vocals," and get songs in return.
One option for creating this kind of natural-language music search engine is to manually annotate as many songs as possible - but this is expensive and limits the depth and breadth of the search engine's reach. Another option is to train computers to do the song annotations.
The UCSD researchers have, in fact, built such a system over the last two years. They call it a computer audition system. You feed it songs and it annotates them, thanks to a series of algorithms they created. Once a song is annotated, you can retrieve it using a text-based search engine. But before the system can start annotating songs, it has to be trained - via a process of machine learning. Getting enough data to properly train the system to label a wide range of music accurately is difficult.
At an academic conference on music information retrieval this week in Vienna, Austria, the UCSD researchers describe important progress toward this goal. Lanckriet and others from UCSD report that an online music game they created, called Listen Game, is capable of capturing the crucial word-song combinations that are needed to train their system to label large numbers of songs automatically.
Listen Game is an online, multiplayer game prototype that gets players to label songs with words. Like the popular image labeling games, such as ESP game, Peekaboom and Phetch, Listen Game relies on people surfing the Web to generate valuable data while playing the game. For Listen Game, the "human computation" occurs when users listen to clips of songs and determine which words are most and least relevant to the song. Users earn points when they pick the same words as others who are playing at the same time and listening to the same song clips.
Collections of reliable word-song combinations are of great interest to the UCSD researchers. They use these "semantic annotations of music" to train their home-grown computer system to label songs it has not previously encountered.
In their paper, the UCSD researchers show that the word-song combinations generated by people playing Listen Game can be used to accurately train their system to label new songs.
"We've shown - in academic terms - that our game works. We're close to the performance we get with comparable survey data from the music undergrads we paid to fill out music surveys," said Doug Turnbull, a computer science Ph.D. student at UCSD who, along with Lanckriet, is an author on three papers presented at ISMIR, the music information retrieval conference.
Thanks to a grant from the UCSD Jacobs School of Engineering's von Liebig Center, the team is working with interactive designers to make the game more fun and engaging. With the new games, the researchers hope to collect the data necessary to continue to develop their automated music annotation system.
"A bunch of engineers made Listen Game. The second generation will have a livelier look and feel," said Lanckriet.
The researchers will release new games later in 2007. The games will be free and will carry no advertising. Players will be able to play anonymously or they can log in and customize and personalize the games and socialize with other players in real time. Send an email to gert@ece.ucsd.edu to be notified when the new games are released.
In addition to the ISMIR paper focused on Listen Game, the UCSD researchers are presenting a paper at the same conference on identifying words that are most likely to be meaningful to music search engines and another paper on detecting boundaries within songs.
Work on the word identification paper began two years ago, when the researchers were mining text from music reviews of specific songs, in search of words that are meaningful and useful in the context of a music search engine.
"If you look at a music review, there are so many words that are not relevant, you want to filter them out to get the quality training data, to get words that are acoustically describing the song," said David Torres, a UCSD computer science student working on his master's degree and an author on the paper.
The authors propose an approach for identifying musically meaningful words and show that this kind of filtering can improve the performance of the music annotation and retrieval system.
They also highlight complications that arise from the fact that music is subjective. "For example, a pre-teen girl might consider a Backstreet Boys song to be 'touching and powerful' whereas a dj at an indie radio station may consider it 'abrasive and pathetic,'" the authors write. To account for this subjectivity, electrical engineering Ph.D. student and paper author Luke Barrington explained that the team considers the level of human agreement for different words when filtering through the music annotations they collect.
In the third paper, Turnbull, Lanckriet and authors from Japan's National Institute of Advanced Industrial Science and Technology, present their work on detecting boundaries between musical segments in a song, such as between a verse and a chorus. The researchers' strategy for automatic boundary detection could be useful for generating music thumbnails, for efficient music browsing and for music information retrieval.
"In order to analyze the audio of a song, it is useful to be able to chop it up into meaningful segments," said first author Doug Turnbull.
"Maybe you want to listen to the Beatles, but mellow Beatles. You don't want to listen to "Back in the USSR." We are building a system that lets you use natural language to search for music with this level of detail," said Turnbull.
University of California - San Diego
Search Engine News and Current Search Engine Events RSSScientists launch first comprehensive database of human oral microbiome
Scientists know more today than ever before about the microbes that inhabit our mouths. They know so much, in fact, that gathering all of the relevant bits of information into one place when designing experiments can be a job in itself.
Study shows Google favored over other search engines by webmasters
Web site policy makers who use robots.txt files as gatekeepers to specify what is open and what is off limits to Web crawlers have a bias that favors Google over other search engines, say Penn State researchers whose study of more than 7,500 Web sites revealed Google's advantage.
MIT develops lecture search engine to aid students
Imagine you are taking an introductory biology course. You're studying for an exam and realize it would be helpful to revisit the professor's explanation of RNA interference. Fortunately for you, a digital recording of the lecture is online, but the 10-minute explanation you want is buried in a 90-minute lecture you don't have time to watch.
New proteomics research promises to revolutionize biomedical discovery
Human cells function through the concerted action of thousands of proteins that control their growth and differentiation. Yet, the specific function of most human proteins remains either unknown or poorly characterized.
Key science Web sites buried in information avalanche
As more and more people are turning to the Internet to find information, important science websites are in danger of becoming buried in the sheer avalanche of facts now available online. Key science sites are failing to register in the top 30 Google search results.
IU informatics researchers throttle notion of search engine dominance
Search engines are not biased toward popular Web sites, and may even be egalitarian in the way they direct traffic.
Enterprise management facilities for public authorities
Public authorities have long needed the equivalent of the enterprise management system - as used by leading companies around the world - but seldom had the resources to afford it. Now a new collaborative-working platform developed under the ICTE-PAN project may hold the solution.
Adding semantics to the Web
"The Web will become more than what we see on our computer screens, it will become a place where computers interact with each other and where meaning is attached to information." That is the vision behind a cutting-edge Semantic Web project.
Adding more meaning from place searches
Trawling the web for place-related information is tedious at the best of times. A new search engine, being tested in Europe, recognises geographical terminology and has the intelligence to understand the searches and match them to places.
Firing up knowledge for fire-fighters
Major industrial fires and incidents involving hazardous materials often place fire-fighters in the most dangerous situations of their working lives. Yet as such occurrences are rare, many will face these situations for the first time with little foreknowledge of such incidents. RIMSAT aimed to improve the odds in the fire-fighters' favour.
More Search Engine News Articles
| © 2008 BrightSurf.com |