Robot drummer posts pictures of jamming sessions on Facebook

December 20, 2017

The study, by researchers at Queen Mary University of London, looks at how humans interact with robots over time and in particular how social media can enhance that relationship.

Relationships between humans and robots require both long term engagement and a feeling of believability, or social presence, towards the robot. The researchers contend that music can provide this engagement and developed a robotic drummer, called Mortimer, who is able to compose music responsively to human pianists in real-time.

To help trigger a sense of believability, the researchers extended Mortimer's capabilities to allow him to take pictures during sessions and post them with a supporting comment to Facebook while also tagging the keyboard player.

The study was published in IEEE Transactions on Cognitive and Developmental Systems.

Lead author Louis McCallum, from Queen Mary's School of Electronic Engineering and Computer Science, said: "We'd previously uncovered new and exciting findings that suggested open-ended creative activities could be a strong bedrock to build long-term human-robot relationships. This particular research sought to examine whether the relationships that were initially developed face-to-face, but under lab conditions, could be extended to the more open, but virtual, realm of social media."

During the study, two groups of participants were chosen. One group was sent a Facebook friend request from Mortimer allowing the robot to tag them in pictures taken during the session. The other group was not sent a request and had no contact with the robot outside of the sessions.

Participants took part in six weekly sessions in a controlled studio environment and were instructed to stay for a minimum of 20 minutes but could optionally stay for up to 45.

They were greeted by Mortimer, who communicates via speech synthesis software, and used a tablet to interact with him.

During each session, a picture of Mortimer and the participant playing was taken automatically by a webcam in the lab and an accompanying comment was generated. In some instances, the participants also took a selfie with Mortimer and posted it to their own Facebook accounts.

From the Facebook data, there were considerably more 'likes' for posts made by a user as opposed to one of Mortimer's posts that the user was tagged in.

Dr McCallum said: "One of the most interesting findings was that posts by human participants about the music sessions between them carried significantly more weight within their networks than posts by the robot itself. This suggests a discerning approach to generated posts that is especially relevant in today's world of social media bots, automated content and fake news."

The researchers found that the time spent with the robot increased over the study but session length for the group who were Facebook friends with Mortimer reduced over time. They suggest this may be because the participants had additional contact with Mortimer outside the sessions.

Co-author of the study Professor Peter McOwan added: "There are signs of high engagement, such as high self-reported repeat interaction, across all participants that strengthen previous results about the use of music as a good base for improving long-term human-robot relationships. But we found the effects of extending the relationship into the virtual world were less pronounced than expected. This doesn't mean that virtual interaction doesn't help, but maybe the quality of the interaction needs to be improved."
The study was funded by The Engineering and Physical Sciences Research Council (EPSRC).

Queen Mary University of London

Related Social Media Articles from Brightsurf:

it's not if, but how people use social media that impacts their well-being
New research from UBC Okanagan indicates what's most important for overall happiness is how a person uses social media.

Social media postings linked to hate crimes
A new paper in the Journal of the European Economic Association, published by Oxford University Press, explores the connection between social media and hate crimes.

How Steak-umm became a social media phenomenon during the pandemic
A new study outlines how a brand of frozen meat products took social media by storm - and what other brands can learn from the phenomenon.

COVID-19: Social media users more likely to believe false information
A new study led by researchers at McGill University finds that people who get their news from social media are more likely to have misperceptions about COVID-19.

Stemming the spread of misinformation on social media
New research reported in the journal Psychological Science finds that priming people to think about accuracy could make them more discerning in what they subsequently share on social media.

Looking for better customer engagement value? Be more strategic on social media
According to a new study from the University of Vaasa and University of Cyprus, the mere use of social media alone does not generate customer value, but rather, the connections and interactions between the firm and its customers -- as well as among customers themselves -- can be used strategically for resource transformation and exchanges between the interacting parties.

Exploring the use of 'stretchable' words in social media
An investigation of Twitter messages reveals new insights and tools for studying how people use stretched words, such as 'duuuuude,' 'heyyyyy,' or 'noooooooo.' Tyler Gray and colleagues at the University of Vermont in Burlington present these findings in the open-access journal PLOS ONE on May 27, 2020.

How social media platforms can contribute to dehumanizing people
A recent analysis of discourse on Facebook highlights how social media can be used to dehumanize entire groups of people.

Social media influencers could encourage adolescents to follow social distancing guidelines
Public health bodies should consider incentivizing social media influencers to encourage adolescents to follow social distancing guidelines, say researchers.

Social grooming factors influencing social media civility on COVID-19
A new study analyzing tweets about COVID-19 found that users with larger social networks tend to use fewer uncivil remarks when they have more positive responses from others.

Read More: Social Media News and Social Media Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to