Nav: Home

Approximating a kernel of truth

March 10, 2020

By using an approximate rather than explicit "kernel" function to extract relationships in very large data sets, KAUST researchers have been able to dramatically accelerate the speed of machine learning. The approach promises to greatly improve the speed of artificial intelligence (AI) in the era of big data.

When AI is exposed to a large unknown data set, it needs to analyze the data and develop a model or function that describes the relationships in the set. The calculation of this function, or kernel, is a computationally intensive task that increases in complexity cubically (to the power of three) with the size of the data set. In the era of big data and increasing reliance on AI for analysis, this presents a real problem where kernel selection can become impractically time consuming.

With the supervision of Xin Gao, Lizhong Ding and his colleagues have been working on methods to speed up kernel selection using statistics.

"The computational complexity of accurate kernel selection is usually cubic with the number of samples," says Ding. "This kind of cubic scaling is prohibitive for big data. We have instead proposed an approximation approach for kernel selection, which significantly improves the efficiency of kernel selection without sacrificing predictive performance."

The true or accurate kernel provides a verbatim description of relationships in the data set. What the researchers found is that statistics can be used to derive an approximate kernel that is almost as good as the accurate version, but can be computed many times faster, scaling linearly, rather than cubically, with the size of the data set.

To develop the approach, the team had to construct specifically designed kernel matrices, or mathematical arrays, that could be computed quickly. They also had to establish the rules and theoretical bounds for selection of the approximate kernel that would still guarantee learning performance.

"The main challenge was that we needed to design new algorithms satisfying these two points at the same time," says Ding.

Combining a process of error estimation and mathematical approximation, the researchers were able to prove that their approximate kernel remains consistent with the accurate kernel and then demonstrated its performance in real examples.

"We have shown that approximate methods, such as our computing framework, provide sufficient accuracy for solving a kernel-based learning method, without the impractical computational burden of accurate methods," says Ding. "This provides an effective and efficient solution for problems in data mining and bioinformatics that require scalability."

King Abdullah University of Science & Technology (KAUST)

Related Relationships Articles:

Gorilla relationships limited in large groups
Mountain gorillas that live in oversized groups may have to limit the number of strong social relationships they form, new research suggests.
Electronic surveillance in couple relationships
Impaired intimacy, satisfaction, and infidelity in a romantic relationship can fuel Interpersonal Electronic Surveillance (IES).
'Feeling obligated' can impact relationships during social distancing
In a time where many are practicing 'social distancing' from the outside world, people are relying on their immediate social circles more than usual.
We can make predictions about relationships - but is this necessary?
'Predictions as to the longevity of a relationship are definitely possible,' says Dr Christine Finn from the University of Jena.
Disruptions of salesperson-customer relationships. Is that always bad?
Implications from sales relationship disruptions are intricate and can be revitalizing.
Do open relationships really work?
Open relationships typically describe couples in which the partners have agreed on sexual activity with someone other than their primary romantic partner, while maintaining the couple bond.
The 7 types of sugar daddy relationships
University of Colorado Denver researcher looks inside 48 sugar daddy relationships to better understand the different types of dynamics, break down the typical stereotype(s) and better understand how these relationships work in the United States.
Positive relationships boost self-esteem, and vice versa
Does having close friends boost your self-esteem, or does having high self-esteem influence the quality of your friendships?
Strong family relationships may help with asthma outcomes for children
Positive family relationships might help youth to maintain good asthma management behaviors even in the face of difficult neighborhood conditions, according to a new Northwestern University study.
In romantic relationships, people do indeed have a 'type'
Researchers at the University of Toronto show that people do indeed have a 'type' when it comes to dating, and that despite best intentions to date outside that type -- for example, after a bad relationship -- some will gravitate to similar partners.
More Relationships News and Relationships Current Events

Trending Science News

Current Coronavirus (COVID-19) News

Top Science Podcasts

We have hand picked the top science podcasts of 2020.
Now Playing: TED Radio Hour

Listen Again: The Power Of Spaces
How do spaces shape the human experience? In what ways do our rooms, homes, and buildings give us meaning and purpose? This hour, TED speakers explore the power of the spaces we make and inhabit. Guests include architect Michael Murphy, musician David Byrne, artist Es Devlin, and architect Siamak Hariri.
Now Playing: Science for the People

#576 Science Communication in Creative Places
When you think of science communication, you might think of TED talks or museum talks or video talks, or... people giving lectures. It's a lot of people talking. But there's more to sci comm than that. This week host Bethany Brookshire talks to three people who have looked at science communication in places you might not expect it. We'll speak with Mauna Dasari, a graduate student at Notre Dame, about making mammals into a March Madness match. We'll talk with Sarah Garner, director of the Pathologists Assistant Program at Tulane University School of Medicine, who takes pathology instruction out of...
Now Playing: Radiolab

What If?
There's plenty of speculation about what Donald Trump might do in the wake of the election. Would he dispute the results if he loses? Would he simply refuse to leave office, or even try to use the military to maintain control? Last summer, Rosa Brooks got together a team of experts and political operatives from both sides of the aisle to ask a slightly different question. Rather than arguing about whether he'd do those things, they dug into what exactly would happen if he did. Part war game part choose your own adventure, Rosa's Transition Integrity Project doesn't give us any predictions, and it isn't a referendum on Trump. Instead, it's a deeply illuminating stress test on our laws, our institutions, and on the commitment to democracy written into the constitution. This episode was reported by Bethel Habte, with help from Tracie Hunte, and produced by Bethel Habte. Jeremy Bloom provided original music. Support Radiolab by becoming a member today at     You can read The Transition Integrity Project's report here.