Nav: Home

Tweets better than Google Trends at forecasting TV program ratings

August 01, 2016

CATONSVILLE, MD, AUGUST 1, 2016 - How well does the emotional and instantaneous content in tweets perform relative to the more deliberate searches recorded in Google Trends in forecasting future TV ratings? In a massive big data analysis using data from Twitter, Google Trends and other widely used websites for entertainment information, a forthcoming article in the INFORMS journal Marketing Science finds that mining Twitter content is significantly more effective than Google Trends in its ability to predict future TV ratings.

In a business world where the number of episodes and advertising rates are determined by the expected viewership of shows, the science of forecasting views is more important than ever. The research conducted by Professor Xiao Liu of New York University and Professors Param Vir Singh and Kannan Srinivasan of Carnegie Mellon University compared the content of more than 1.8 billion tweets versus 113 million Google searches of about 30 U.S. TV shows and regular season NFL games during the 2008-2012 seasons. The authors found that tweets significantly outperform Google searches at predicting future views. Online reviews at IMDB, as well as page views of Wikipedia or Huffington Post also did not efficiently forecast views.

The authors identified some interesting differences in audience interactions with the different websites. Tweets peaked during the show, Google searches peaked after the show, and views of Wikipedia and Huffington Post gradually increased for several days after the show. These results suggest that Twitter captures more of the emotions generated during the show, while the other sites capture more of the information about the show. Professor Kannan Srinivasan conjectured, "It is perhaps the detailed emotional content in the tweets that we are able to extract through our algorithms that plausibly makes Twitter mining such fertile ground for viewership forecasting."

The authors noted that their analysis used state-of-the-art machine learning techniques to mine the text content in tweets. "Merely classifying tweet sentiment as positive and negative is not enough for good forecasting," said Professor Liu. "We developed an approach where the machine learning algorithm would automatically analyze the content of the data to identify relevant features that would be useful for predicting ratings and then automatically classify tweets based on these features."

On the scope of 1.8 billion tweets, Professor Singh explained, "Our automated algorithm ensured the discovery of all relevant tweet characteristics, without human preconceptions, and we exploited the latest in scalable and distributed computing technologies for our analysis."

The authors cautioned that their conclusion about Twitter's superiority in forecasting TV ratings should not be generalized to other settings. Professor Liu noted that "while the emotions captured in Twitter may be more useful for predicting TV ratings, Google Search might be better at forecasting the flu, as information search may be more important here than recording emotion."

With nearly 12,000 members from across the globe, INFORMS is the leading international association for professionals in operations research and analytics. More information about INFORMS is available at or @informs.

Institute for Operations Research and the Management Sciences

Related Twitter Articles:

Researchers use Twitter to track the flu in real time
An international team led by Northeastern University professor Alessandro Vespignani has developed a unique computational model to project the spread of the seasonal flu in real time.
As scientists take to Twitter, study shows power of 'visual abstract' graphics
When it comes to sharing new research findings with the world, Twitter has emerged as a key tool for scientists -- and for the journals where they publish their findings.
Twitter could have predicted the outcome of the Brexit vote
Leave campaigners were not only victorious in the June 2016 Brexit vote but also in the battle of the twittersphere, a new study in the British Journal of Politics and International Relations reports.
Spreading rumors on Twitter and mistaking retweets for truth
A new study of the believability of information received via Twitter and the intention to pass on a tweet -- whether news or rumor -- is influenced by the number of times the information has already been retweeted.
Twitter researchers offer clues as to why Trump won
University of Rochester computer scientists were able to shed light on how Trump won the presidential election by using data science to track the millions of Twitter followers who liked or 'unliked' the candidates throughout the campaign.
Finding credibility clues on Twitter
By scanning 66 million tweets linked to nearly 1,400 real-world events, Georgia Institute of Technology researchers have built a language model that identifies words and phrases that lead to strong or weak perceived levels of credibility on Twitter.
New public tool uses Twitter posts to gain insights about marijuana use
Journalists, researchers, policymakers, and the public looking to gain new insights about the use of marijuana can now turn to CannabisConvo.
More are positive about HPV vaccine on Twitter than not, Drexel study finds
A Drexel University study into sentiments toward the HPV vaccine on Twitter found that significantly more tweets post positive sentiments toward vaccines, such as the value of prevention and protection, than not.
Tweeting #plasticsurgery -- plastic surgeons urged to engage and educate on twitter
Twitter has become an important resource for people seeking information about plastic surgery.
What Twitter behavior accompanies mental health crises?
A new study published today in the Journal of the American Medical Informatics Association indicates that there were two specific types of heightened Twitter discussions in 2014 related to mental health: expected increases in response to planned behavioral health events and unexpected increases in response to unanticipated events.

Related Twitter Reading:

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Digital Manipulation
Technology has reshaped our lives in amazing ways. But at what cost? This hour, TED speakers reveal how what we see, read, believe — even how we vote — can be manipulated by the technology we use. Guests include journalist Carole Cadwalladr, consumer advocate Finn Myrstad, writer and marketing professor Scott Galloway, behavioral designer Nir Eyal, and computer graphics researcher Doug Roble.
Now Playing: Science for the People

#529 Do You Really Want to Find Out Who's Your Daddy?
At least some of you by now have probably spit into a tube and mailed it off to find out who your closest relatives are, where you might be from, and what terrible diseases might await you. But what exactly did you find out? And what did you give away? In this live panel at Awesome Con we bring in science writer Tina Saey to talk about all her DNA testing, and bioethicist Debra Mathews, to determine whether Tina should have done it at all. Related links: What FamilyTreeDNA sharing genetic data with police means for you Crime solvers embraced...