Nav: Home

Tweets better than Google Trends at forecasting TV program ratings

August 01, 2016

CATONSVILLE, MD, AUGUST 1, 2016 - How well does the emotional and instantaneous content in tweets perform relative to the more deliberate searches recorded in Google Trends in forecasting future TV ratings? In a massive big data analysis using data from Twitter, Google Trends and other widely used websites for entertainment information, a forthcoming article in the INFORMS journal Marketing Science finds that mining Twitter content is significantly more effective than Google Trends in its ability to predict future TV ratings.

In a business world where the number of episodes and advertising rates are determined by the expected viewership of shows, the science of forecasting views is more important than ever. The research conducted by Professor Xiao Liu of New York University and Professors Param Vir Singh and Kannan Srinivasan of Carnegie Mellon University compared the content of more than 1.8 billion tweets versus 113 million Google searches of about 30 U.S. TV shows and regular season NFL games during the 2008-2012 seasons. The authors found that tweets significantly outperform Google searches at predicting future views. Online reviews at IMDB, as well as page views of Wikipedia or Huffington Post also did not efficiently forecast views.

The authors identified some interesting differences in audience interactions with the different websites. Tweets peaked during the show, Google searches peaked after the show, and views of Wikipedia and Huffington Post gradually increased for several days after the show. These results suggest that Twitter captures more of the emotions generated during the show, while the other sites capture more of the information about the show. Professor Kannan Srinivasan conjectured, "It is perhaps the detailed emotional content in the tweets that we are able to extract through our algorithms that plausibly makes Twitter mining such fertile ground for viewership forecasting."

The authors noted that their analysis used state-of-the-art machine learning techniques to mine the text content in tweets. "Merely classifying tweet sentiment as positive and negative is not enough for good forecasting," said Professor Liu. "We developed an approach where the machine learning algorithm would automatically analyze the content of the data to identify relevant features that would be useful for predicting ratings and then automatically classify tweets based on these features."

On the scope of 1.8 billion tweets, Professor Singh explained, "Our automated algorithm ensured the discovery of all relevant tweet characteristics, without human preconceptions, and we exploited the latest in scalable and distributed computing technologies for our analysis."

The authors cautioned that their conclusion about Twitter's superiority in forecasting TV ratings should not be generalized to other settings. Professor Liu noted that "while the emotions captured in Twitter may be more useful for predicting TV ratings, Google Search might be better at forecasting the flu, as information search may be more important here than recording emotion."

With nearly 12,000 members from across the globe, INFORMS is the leading international association for professionals in operations research and analytics. More information about INFORMS is available at or @informs.

Institute for Operations Research and the Management Sciences

Related Twitter Articles:

New algorithm can distinguish cyberbullies from normal Twitter users with 90% accuracy
A team of researchers, including faculty at Binghamton University, have developed machine learning algorithms which can successfully identify bullies and aggressors on Twitter with 90 percent accuracy.
BU researchers use Twitter and AI to see who is hitting the gym
A new study led by Boston University School of Public Health (BUSPH) researchers and published in BMJ Open Sport & Exercise Medicine used machine learning to find and comb through exercise-related tweets from across the United States, unpacking regional and gender differences in exercise types and intensity levels.
New application can detect Twitter bots in any language
Thanks to fruitful collaboration between language scholars and machine learning specialists, a new application developed by researchers at the University of Eastern Finland and Linnaeus University in Sweden can detect Twitter bots independent of the language used.
The whisper room: Moderates on Twitter are losing their voice
MU researcher finds that partisan users form highly partisan social networks on Twitter, moderate users -- or those less politically engaged -- continue to avoid politics, potentially creating an important void on social media.
Study: With Twitter, race of the messenger matters
University of Kansas journalism researchers showed real tweets about the NFL anthem protests to a group of millennials.
More Twitter News and Twitter Current Events

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Erasing The Stigma
Many of us either cope with mental illness or know someone who does. But we still have a hard time talking about it. This hour, TED speakers explore ways to push past — and even erase — the stigma. Guests include musician and comedian Jordan Raskopoulos, neuroscientist and psychiatrist Thomas Insel, psychiatrist Dixon Chibanda, anxiety and depression researcher Olivia Remes, and entrepreneur Sangu Delle.
Now Playing: Science for the People

#537 Science Journalism, Hold the Hype
Everyone's seen a piece of science getting over-exaggerated in the media. Most people would be quick to blame journalists and big media for getting in wrong. In many cases, you'd be right. But there's other sources of hype in science journalism. and one of them can be found in the humble, and little-known press release. We're talking with Chris Chambers about doing science about science journalism, and where the hype creeps in. Related links: The association between exaggeration in health related science news and academic press releases: retrospective observational study Claims of causality in health news: a randomised trial This...