Graphics cards farm to help in search of new physics at LHCb

June 16, 2020

For the first time, data from LHCb, a major physics experiment, will be processed on a farm of GPUs. This solution is not only much cheaper, but it will help decrease the cluster size and process data at speeds up to 40 Tbit/s. The research paper has been published in Computing and Software for Big Science.

An interdisciplinary task force of researchers from one of the biggest international collaborations in high energy physics LHC beauty at CERN has suggested a novel way to process enormous dataflow from the particle detector. The team consists of researchers from leading European and US universities. The Russian part of the team was represented by HSE and Yandex School of data analysis. The main goal of the proposal is to provide the collaboration with a robust, efficient and flexible solution that could deal with increased data flow expected during the upcoming data taking period. This solution is not only much cheaper, but it will help decrease the cluster size and process data at speeds up to 40 Tbit/s.

The LHC and LHCb in particular were created for the purpose of searching for 'new physics', something beyond the Standard Model. While the research has achieved moderate success, hopes of finding completely new particles, such as WIMPs, have failed. Many physicists believe that in order to achieve new results, statistics on particle collision at the LHC should be increased considerably. But this not only requires new accelerating equipment - upgrades are currently underway and due to be completed by 2021-2022 - but also brand-new systems to process particle collision data. To detect the events on LHCb as correctly registered, the reconstructed track must match the one modelled by the algorithm. If there is no match, the data are excluded. About 70% of all collisions in the LHC are excluded this way, which means that serious calculation capacities are required for this preliminary analysis.

A group of researchers, including Andrey Ustyuzhanin, Nikita Kazeev, Mikhail Belous and Sergei Popov from HSE University, presented a new paper with an algorithm of a 'farm' of GPUs as a first high-level trigger (HLT1) for event registration and detection on the LHCb detector. The concept has been named Allen, after Frances Allen, a researcher in computational system theory and the first woman to have received the Turing Award.

Unlike previous triggers, the new system transfers data from CPUs to GPUs. These may include both professional solutions (such as Tesla GPUs, the most advanced on the market) and ordinary 'gamer' GPUs by NVIDIA or AMD. Thanks to this, the Allen trigger does not depend on one specific equipment vendor, which makes it easier to create and reduces costs. With the highest-performance systems, the trigger can process data at up to 40 Tbit/s.

In a standard scheme, information on all events goes from the detector to a zero-level (L0) trigger, which consists of programmable chips (FPGA). They perform selection at the basic level. In the new scheme, there will be no L0 trigger. The data immediately go to the 'farm', where each of the 300 GPUs simultaneously processes millions of events per second.

After initial event registration and detection, only the selected data with valuable physical information go to ordinary x86 processors of second-level triggers (HLT2). This means that the main computational load related to event classification happens at the 'farm' by means of GPUs exceptionally.

This framework will help solve the event analysis and selection tasks more effectively: GPUs are initially created as a multi-channel system with multiple cores. And while CPUs are geared towards consecutive information processing, GPUs are used for massive simultaneous calculations. In addition, they have a more specific and limited set of tasks, which adds to performance.

According to Denis Derkach, head of the LHCb team at HSE University, thanks to the decision not to use CPUs, the new 'farm' is well suited for future LHCb data taking. In addition, Allen will cost significantly less than a similar system on CPUs. It will also be simpler than the previous event registration systems at accelerators.

The long-term benefit of the new approach is particularly important. Equipment for many physics experiments is currently being upgraded all around the world. And virtually every such upgrade leads to a growing flow of processed information. Previously, experiments did not use systems based on GPUs exceptionally. But the advantages of Allen - a simpler architecture and lower cost - are so obvious that this approach will undoubtedly take the lead beyond the LHCb experiment.

National Research University Higher School of Economics

Related Physics Articles from Brightsurf:

Helium, a little atom for big physics
Helium is the simplest multi-body atom. Its energy levels can be calculated with extremely high precision only relying on a few fundamental physical constants and the quantum electrodynamics (QED) theory.

Hyperbolic metamaterials exhibit 2T physics
According to Igor Smolyaninov of the University of Maryland, ''One of the more unusual applications of metamaterials was a theoretical proposal to construct a physical system that would exhibit two-time physics behavior on small scales.''

Challenges and opportunities for women in physics
Women in the United States hold fewer than 25% of bachelor's degrees, 20% of doctoral degrees and 19% of faculty positions in physics.

Indeterminist physics for an open world
Classical physics is characterized by the equations describing the world.

Leptons help in tracking new physics
Electrons with 'colleagues' -- other leptons - are one of many products of collisions observed in the LHCb experiment at the Large Hadron Collider.

Has physics ever been deterministic?
Researchers from the Austrian Academy of Sciences, the University of Vienna and the University of Geneva, have proposed a new interpretation of classical physics without real numbers.

Twisted physics
A new study in the journal Nature shows that superconductivity in bilayer graphene can be turned on or off with a small voltage change, increasing its usefulness for electronic devices.

Physics vs. asthma
A research team from the MIPT Center for Molecular Mechanisms of Aging and Age-Related Diseases has collaborated with colleagues from the U.S., Canada, France, and Germany to determine the spatial structure of the CysLT1 receptor.

2D topological physics from shaking a 1D wire
Published in Physical Review X, this new study propose a realistic scheme to observe a 'cold-atomic quantum Hall effect.'

Helping physics teachers who don't know physics
A shortage of high school physics teachers has led to teachers with little-to-no training taking over physics classrooms, reports show.

Read More: Physics News and Physics Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to