Nav: Home

Photos in social media reveal socio-cultural value of landscapes

October 31, 2018

Every day, users upload millions of photos on platforms, such as Flickr, Instagram or Facebook. A study of researchers of Karlsruhe Institute of Technology (KIT) now shows that these photos can be used to assess the social importance of certain landscapes. For this purpose, they developed a new image analysis method based on artificial intelligence. The results might be of particular importance for landscape management and presentation. The results are published in the journal Ecological Indicators (doi: 10.1016/j.ecolind.2018.08035)

Functioning ecosystems are of crucial importance to humans: they supply major resources, such as food, water or fuel. But they also play a cultural role as resorts, holiday destinations or esthetic photo motifs. "The many photos published by people on online platforms reveal that landscapes have an enormous cultural importance," says Dr. Heera Lee of KIT's Institute of Meteorology and Climate Research in Garmisch-Partenkirchen. In her opinion, this has to be considered in sustainable development and landscape planning. Consequently, Lee and her team have developed a method for landscape planners to quickly and reliably use photos in social media to draw conclusions with respect to the socio-cultural importance of landscapes.

Her study "Mapping cultural ecosystem services 2.0 - Potential and shortcomings from unlabeled crowd-sourced images" covers the region of the Mulde basin in Saxony as an example. "Here, the Ore Mountains attract people, who want to go hiking, mountain biking or do winter sports," Lee says. The amount of photos posted by visitors on different platforms is accordingly high. For her study, Lee and her team collected photos that were posted on Flickr from January 01, 2005 to December 31, 2016. During this period, 725 different persons uploaded about 13,000 photos of the region on the online platform.

The evaluation of the photos reflects in high detail how tourists and the local population use the area of the Mulde basin for leisure activities or for enjoying nature. Now, landscape planners can identify the "hotspots" and better understand the socio-cultural importance of certain areas. On this basis, they can limit access to endangered areas or create offers and facilities to support their activities.

Image Evaluation with the Help of Machine Learning and Artificial Intelligence

To obtain reliable and relevant statements with respect to the socio-cultural use of landscapes, Lee and her team developed a new method that also considers the contents of the photo: "We did not only want to know where and when the photos were taken but mainly what was photographed. This was the only way to identify cultural hotspots in the region studied."

The researchers obtained information on the photos from the tags given by the users at the time of publication. They show where a photo was taken and what can be seen on it. However, the researchers had to cope with two challenges: the quality of the tags given by the users and the duration of evaluation. Although Flickr suggests tags for photos and videos, they are not used by all users. As 2500 of these photos studied had no tags at all and 590 had only one single tag, the team of researchers decided to use automatic tags from an image recognition algorithm based on deep convolutional neural networks through a cloud computing platform, Clarifai. This algorithm allocated 20 tags to each photo. In total, 2317 different tags were applied to about 13,000 photos.

"We then assumed that similar photos contained similar tags. If the similar tags co-occurred on multiple photos, we considered this as an indicator of the photos belonging together," Lee says. With the help of social network analyses, the researchers divided the tags into nine thematic clusters and assigned the photos to one or several of these clusters. Close-up views of flowers or butterflies were assigned to the cluster "Existence," as they showed objects existing in the areas studied. Lee and her team then checked the accuracy of the method by means of a manual evaluation: about 20% of tags had been assigned wrongly. The researchers, however, expect that reliability of assignment will be improved significantly by the further development of artificial intelligence. In addition, Lee and her team compared the results with empirical studies of the cultural use of agricultural areas with similar results.

The method developed also accelerates evaluation. Allocation of the tags to the nearly 13,000 photos took about three hours. For comparison: manually, a person is able to tag about 140 photos per hour. "With this method, we were able to reliably and quickly classify and allocate photos from social media," Lee says. The method can also be transferred to other regions of which photos have been published on the Internet. The European Union and the Federal Ministry of Education and Research of Germany funded Heera Lee's research with two projects, namely OPERAs, and CONNECT of BiodivERsA 2011, respectively.
Original Publication

Heera Lee, Bumsuk Seo, Thomas Koellner, Sven Lautenbach: "Mapping cultural ecosystem services 2.0 - Potential and shortcomings from unlabeled crowd sourced images"; in: Ecological Indicators

Accessible at:

Detailed figure caption: with the help of artificial intelligence, climate researchers of KIT evaluated photos on the Flickr online platform and drew conclusions with respect to the cultural use of the area of the Mulde river system in Saxony. The tag network shows the tags allocated to the photos by an image recognition algorithm. The size of the node reflects the frequency of the tags, the colors represent different thematic clusters. (Graphics: Heera Lee, KIT)

More about the KIT Climate and Environment Center:

Further materials:

Publication in Ecological Indicators:

Being „The Research University in the Helmholtz Association", KIT creates and imparts knowledge for the society and the environment. It is the objective to make significant contributions to the global challenges in the fields of energy, mobility and information. For this, about 9,300 employees cooperate in a broad range of disciplines in natural sciences, engineering sciences, economics, and the humanities and social sciences. KIT prepares its 25,500 students for responsible tasks in society, industry, and science by offering research-based study programs. Innovation efforts at KIT build a bridge between important scientific findings and their application for the benefit of society, economic prosperity, and the preservation of our natural basis of life.

Karlsruher Institut für Technologie (KIT)

Related Social Media Articles:

Teens must 'get smart' about social media
New research indicates that social media is leading young adolescent girls and boys down a worrying path towards developing body image issues and eating disorder behaviours - even though they are smartphone savvy.
Social media use and disordered eating in young adolescents
New research published in the International Journal of Eating Disorders suggests that social media, particularly platforms with a strong focus on image posting and viewing, is associated with disordered eating in young adolescents.
STD crowd-diagnosis requests on social media
Online postings seeking information on sexually transmitted diseases (STDs) on the social media website Reddit were analyzed to see how often requests were made for a crowd-diagnosis and whether the requested diagnosis was for a second opinion after seeing a health care professional.
Cynical social media voices can erode trust in news media
Amid rising concerns about low public trust in mainstream media institutions, a Rutgers study found that real-life and online social interactions can strongly influence a person's trust in newspaper, TV and online journalism -- but when it comes to online interactions, cynical views are the most influential.
Social media use by adolescents linked to internalizing behaviors
A new study from researchers at the Johns Hopkins Bloomberg School of Public Health found that adolescents who spend more than three hours a day on social media are more likely to report high levels of internalizing behaviors compared to adolescents who do not use social media at all.
Social media stress can lead to social media addiction
Social network users risk becoming more and more addicted to social media platforms even as they experience stress from their use.
Many post on social media under the influence of drugs -- and regret it
Posting on social media, texting, and appearing in photos while high is prevalent among people who use drugs--and many regret these behaviors, according to a study by the Center for Drug Use and HIV/HCV Research (CDUHR) at NYU College of Global Public Health.
'Fake news,' diminishing media trust and the role of social media
Exploring the perception of the 'fake news' phenomenon is critical to combating the ongoing global erosion of trust in the media according to a study co-authored by a University of Houston researcher.
How gender inequality is reproduced on social media
Researchers from Higher School of Economics analyzed 62 million public posts on the most popular Russian social networking site VK and found that both men and women mention sons more often than daughters.
Social media privacy is in the hands of a few friends
New research has revealed that people's behavior is predictable from the social media data of as few as eight or nine of their friends.
More Social Media News and Social Media Current Events

Top Science Podcasts

We have hand picked the top science podcasts of 2019.
Now Playing: TED Radio Hour

In & Out Of Love
We think of love as a mysterious, unknowable force. Something that happens to us. But what if we could control it? This hour, TED speakers on whether we can decide to fall in — and out of — love. Guests include writer Mandy Len Catron, biological anthropologist Helen Fisher, musician Dessa, One Love CEO Katie Hood, and psychologist Guy Winch.
Now Playing: Science for the People

#542 Climate Doomsday
Have you heard? Climate change. We did it. And it's bad. It's going to be worse. We are already suffering the effects of it in many ways. How should we TALK about the dangers we are facing, though? Should we get people good and scared? Or give them hope? Or both? Host Bethany Brookshire talks with David Wallace-Wells and Sheril Kirschenbaum to find out. This episode is hosted by Bethany Brookshire, science writer from Science News. Related links: Why Climate Disasters Might Not Boost Public Engagement on Climate Change on The New York Times by Andrew Revkin The other kind...
Now Playing: Radiolab

An Announcement from Radiolab