Nav: Home

Finding credibility clues on Twitter

January 27, 2017

By scanning 66 million tweets linked to nearly 1,400 real-world events, Georgia Institute of Technology researchers have built a language model that identifies words and phrases that lead to strong or weak perceived levels of credibility on Twitter. Their findings suggest that the words of millions of people on social media have considerable information about an event's credibility -- even when an event is still ongoing.

"There have been many studies about social media credibility in recent years, but very little is known about what types of words or phrases create credibility perceptions during rapidly unfolding events," said Tanushree Mitra, the Georgia Tech Ph.D. candidate who led the research.

The team looked at tweets surrounding events in 2014 and 2015, including the emergence of Ebola in West Africa, the Charlie Hebdo attack in Paris and the death of Eric Garner in New York City. They asked people to judge the posts on their credibility (from "certainly accurate" to "certainly inaccurate"). Then the team fed the words into a model that split them into 15 different linguistic categories. The classifications included positive and negative emotions, hedges and boosters, and anxiety.

The Georgia Tech computer then examined the words to judge if the tweets were credible or not. It matched the humans' opinions about 68 percent of the time. That's significantly higher than the random baseline of 25 percent.

"Tweets with booster words, such as 'undeniable,' and positive emotion terms, such as 'eager' and 'terrific,' were viewed as highly credible," Mitra said. "Words indicating positive sentiment but mocking the impracticality of the event, such as 'ha,' 'grins' or 'joking,' were seen as less credible. So were hedge words, including 'certain level' and 'suspects.'"

Higher numbers of retweets also correlated with lower credibility scores. Replies and retweets with longer message lengths were thought to be more credible.

"It could be that longer message lengths provide more information or reasoning, so they're viewed as more trustworthy," she said. "On the other hand, a higher number of retweets, which was scored lower on credibility, might represent an attempt to elicit collective reasoning during times of crisis or uncertainty."

The system isn't deployable yet, but the Georgia Tech team says it could eventually become an app that displays the perceived trustworthiness of an event as it unfolds on social media.

"When combined with other signals, such as event topics or structural information, our linguistic result could be an important building block of an automated system," said Eric Gilbert, Mitra's advisor and an assistant professor in Georgia Tech's School of Interactive Computing. "Twitter is part of the problem with spreading untruthful news online. But it can also be part of the solution."
-end-
The paper, "A Parsimonious Language Model of Social Media Credibility Across Disparate Events," will be presented in February at the 20th ACM Conference on Computer-Supported Cooperative Work and Social Computing in Portland, Oregon.

Georgia Institute of Technology

Related Social Media Articles:

Can seeing the Facebook logo make you crave social media?
A new study examined how social media cues such as the Facebook logo may affect frequent and less frequent social media users differently, sparking spontaneous hedonic reactions that make it difficult to resist social media cravings.
People could be genetically predisposed to social media use
Chance York (Kent State University) used a behavior genetics framework and twin study data from the 2013 Midlife in the United States survey, York examined how both environmental and genetic factors contribute to social media use by applying an analytical model called Defries-Fulker Regression.
New survey reveals almost 6 in 10 teens take a break from social media
A new survey reveals that 58 percent of American teens report taking significant breaks from social media, and that many of these breaks are voluntary.
Who are you on social media? New research examines norms of online personas
According to the Pew Research center, the majority of adults on the internet have more than one social networking profile on sites like Facebook, Twitter, and LinkedIn.
Social media tools can reinforce stigma and stereotypes
Researchers have developed new software to analyze social media comments, and used this tool in a recent study to better understand attitudes that can cause emotional pain, stigmatize people and reinforce stereotypes.
Floods and hurricanes predicted with social media
Social media can warn us about extreme weather events before they happen -- such as hurricanes, storms and floods - according to new research by the University of Warwick.
Why is some social media content interpreted as bragging?
People who post personal content on social networking sites such as Facebook and try to present themselves in a positive light may be perceived as bragging, and therefore be less attractive to others, according to a new study published in Cyberpsychology, Behavior, and Social Networking.
Your (social media) votes matter
Tim Weninger, assistant professor of computer science and engineering at the University of Notre Dame, conducted two large-scale experiments on Reddit and the results provide insight into how a single up/down vote can influence what content users see on the site.
Multi-social millennials more likely depressed than social(media)ly conservative peers
Compared with the total time spent on social media, use of multiple platforms is more strongly associated with depression and anxiety among young adults, the University of Pittsburgh Center for Research on Media, Technology and Health found in a national survey.
Computers can take social media data and make marketing personas
Computers may be able to group consumers into marketing segments in real time just by observing how they respond to online videos and other social media data, according to a team of researchers.

Related Social Media Reading:

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Anthropomorphic
Do animals grieve? Do they have language or consciousness? For a long time, scientists resisted the urge to look for human qualities in animals. This hour, TED speakers explore how that is changing. Guests include biological anthropologist Barbara King, dolphin researcher Denise Herzing, primatologist Frans de Waal, and ecologist Carl Safina.
Now Playing: Science for the People

#SB2 2019 Science Birthday Minisode: Mary Golda Ross
Our second annual Science Birthday is here, and this year we celebrate the wonderful Mary Golda Ross, born 9 August 1908. She died in 2008 at age 99, but left a lasting mark on the science of rocketry and space exploration as an early woman in engineering, and one of the first Native Americans in engineering. Join Rachelle and Bethany for this very special birthday minisode celebrating Mary and her achievements. Thanks to our Patreons who make this show possible! Read more about Mary G. Ross: Interview with Mary Ross on Lash Publications International, by Laurel Sheppard Meet Mary Golda...