Nav: Home

Finding a needle in the ocean

January 20, 2017

Big data is being used in a broad range of applications from targeting customers and improving sports performance to operating self-driving cars and decoding DNA.

But what exactly is big data?

"Although big data has become a hot topic during the past few years, its meaning is not really clear," says the University of Delaware's Xiang-Gen Xia.

Xia, the Charles Black Evans Professor in UD's Department of Electrical and Computer Engineering, recently shared his thoughts on the topic in a brief "Perspectives" paper published in the January 2017 issue of IEEE Signal Processing Magazine.

Xia's main goal in writing the piece, "Small Data, Mid Data, and Big Data Versus Algebra, Analysis, and Topology," was to draw attention to the need for new mathematical tools to deal with big data.

"Computers have enabled us to collect and process tremendous amounts of data, but there is still no systematic science to deal with it," Xia says. "People are using existing mathematical methods, but for big data problems, we need something different and what we need will vary with the application. Big data is about more than just numbers."

Xia hopes to spark conversation among the scientific communities that are working in this area, including mathematics, signal processing, and computer science.

In the paper, he points out that big data wasn't created when it was named.

"Big data has existed for a long time, as massive groups of fish move in the ocean, massive groups of birds fly in the sky, and/or a massive number of people on the ground travel around the world," he writes.

"Today, massive bits are transmitted through both wired and wireless channels called the internet. The key is how to get some indices, trends, or patterns from these massive data and/or how to find a needle in the ocean."
-end-


University of Delaware

Related Big Data Articles:

Discrimination, lack of diversity, & societal risks of data mining highlighted in big data
A special issue of Big Data presents a series of insightful articles that focus on Big Data and Social and Technical Trade-Offs.
'Charliecloud' simplifies Big Data supercomputing
At Los Alamos National Laboratory, home to more than 100 supercomputers since the dawn of the computing era, elegance and simplicity of programming are highly valued but not always achieved.
Advances in bayesian methods for big data
Big Data has imposed great challenges for machine learning. Bayesian methods provide a profound framework for characterizing the intrinsic uncertainty and performing probabilistic inference and decision-making.
Compiling big data in a human-centric way
When a group of researchers in the Undiagnosed Disease Network at Baylor College of Medicine realized they were spending days combing through databases searching for information regarding gene variants, they decided to do something about it.
Story of silver birch from genomic big data
Researchers at University of Helsinki, Finland and University at Buffalo, USA have analyzed the evolutionary history of silver birch using big data from the genomes of 150 birches.
Night lights, big data
Researchers from the Harvard John A. Paulson School of Engineering and Applied Sciences (SEAS) and the Environmental Defense Fund (EDF) have developed an online tool that incorporates 21 years of night-time lights data to understand and compare changes in human activities in countries around the world.
Big data approach to predict protein structure
Nothing works without proteins in the body, they are the molecular all-rounders in our cells.
Is your big data messy? We're making an app for that
Vizier, software under development by a University at Buffalo-led research team, aims to proactively catch big data errors.
Big data for the universe
Astronomers at Lomonosov Moscow State University in cooperation with their French colleagues and with the help of citizen scientists have released 'The Reference Catalog of galaxy SEDs,' which contains value-added information about 800,000 galaxies.
Using Big Data to understand immune system responses
An enzyme found in many bacteria, including the bacterium that gives us strep throat, has given mankind a cheap and effective tool with which to edit our own genes.

Related Big Data Reading:

Best Science Podcasts 2019

We have hand picked the best science podcasts for 2019. Sit back and enjoy new science podcasts updated daily from your favorite science news services and scientists.
Now Playing: TED Radio Hour

Moving Forward
When the life you've built slips out of your grasp, you're often told it's best to move on. But is that true? Instead of forgetting the past, TED speakers describe how we can move forward with it. Guests include writers Nora McInerny and Suleika Jaouad, and human rights advocate Lindy Lou Isonhood.
Now Playing: Science for the People

#527 Honey I CRISPR'd the Kids
This week we're coming to you from Awesome Con in Washington, D.C. There, host Bethany Brookshire led a panel of three amazing guests to talk about the promise and perils of CRISPR, and what happens now that CRISPR babies have (maybe?) been born. Featuring science writer Tina Saey, molecular biologist Anne Simon, and bioethicist Alan Regenberg. A Nobel Prize winner argues banning CRISPR babies won’t work Geneticists push for a 5-year global ban on gene-edited babies A CRISPR spin-off causes unintended typos in DNA News of the first gene-edited babies ignited a firestorm The researcher who created CRISPR twins defends...