Science Current Events | Science News | Brightsurf.com
 
Email a Friend Send to a friend
Printer Friendly Print What to do with 15 million gigabytes of data

What to do with 15 million gigabytes of data

November 03, 2008

When it is fully up and running, the four massive detectors on the new Large Hadron Collider (LHC) at the CERN particle-physics lab near Geneva are expected to produce up to 15 million gigabytes, aka 15 petabytes, of data every year. Andreas Hirstius, manager of CERN Openlab and the CERN School of Computing, explains in November's Physics World how computer scientists have risen to the challenge of dealing with this unprecedented volume of data.

When CERN staff first considered how they might deal with the large volume of data that the huge collider would produce when its two beams of protons collide, in the mid-1990s, a single gigabyte of disk space still cost a few hundred dollars and CERN's total external connectivity was equivalent to just one of today's broadband connections.




It quickly became clear that computing power at CERN, even taking Moore's Law into account, would be significantly less than that required to analyse LHC data. The solution, it transpired during the 1990s, was to turn to "high-throughput computing" where the focus is not on shifting data as quickly as possible from A to B but rather from shifting as much information as possible between those two points.

High-performance computing is ideal for particle physics because the data produced in the millions of proton-proton collisions are all independent of one another - and can therefore be handled independently. So, rather than using a massive all-in-one mainframe supercomputer to analyse the results, the data can be sent to separate computers, all connected via a network.

From here sprung the LHC Grid. The Grid, which was officially inaugurated last month, is a tiered structure centred on CERN (Tier-0), which is connected by superfast fibre links to 11 Tier-1 centres at places like the Rutherford Appleton Laboratory (RAL) in the UK and Fermilab in the US. More than one CD's worth of data (about 700 MB) can be sent down these fibres to each of the Tier-1 centres every second.

Tier 1 centres then feed down to another 250 regional Tier-2 centres that are in turn accessed by individual researchers through university computer clusters and desktops and laptops (Tier-3).

As Andreas Hirstius writes, "The LHC challenge presented to CERN's computer scientists was as big as the challenges to its engineers and physicists. The computer scientists managed to develop a computing infrastructure that can handle huge amounts of data, thereby fulfilling all of the physicists' requirements and in some cases even going beyond them."

Institute of Physics



Related CERN Current Events and CERN News Articles CERN Current Events and CERN News RSS CERN Current Events and CERN News RSS
Physicists seek to keep next-gen colliders in 1 piece
Controlling huge electromagnetic forces that have the potential to destroy the next generation of particle accelerators is the subject of a new paper by a University of Manchester physicist.

Ytterbium's Broken Symmetry
Ytterbium was discovered in 1878, but until it recently became useful in atomic clocks, the soft metal rarely made the news. Now ytterbium has a new claim to scientific fame.

Intense heat killed the Universe's would-be galaxies, researchers say
Our Milky Way galaxy only survived because it was already immersed in a large clump of dark matter which trapped gases inside it.

A nimbus rises in the world of cloud computing
Cloud computing is a hot topic in the technology world these days. Even if you're not a tech-phile, chances are if you've watched a lot of television or skimmed a business magazine, you've heard someone talking about cloud computing as the way of the future.

Argonne cloud computing helps scientists run high energy physics experiments
A novel system is enabling high energy physicists at CERN in Switzerland, to make production runs that integrate their existing pool of distributed computers with dynamic resources in "science clouds."

MSU scientists help lead teams in detection of fundamental component of matter
Michigan State University scientists and colleagues around the world took a step closer to understanding the universe with the discovery of a fundamental building block of nature.

Precision measurement of W boson mass portends stricter limits for Higgs particle
Scientists of the DZero collaboration at the Department of Energy's Fermi National Accelerator Laboratory have achieved the world's most precise measurement of the mass of the W boson by a single experiment. Combined with other measurements, the reduced uncertainty of the W boson mass will lead to stricter bounds on the mass of the elusive Higgs boson.

Secrets behind high temperature superconductors revealed
Scientists from Queen Mary, University of London and the University of Fribourg (Switzerland) have found evidence that magnetism is involved in the mechanism behind high temperature superconductivity.

Physicists create BlackMax to search for dimensions in space at the Large Hadron Collider
A team of theoretical and experimental physicists, with participants from Case Western Reserve University, have designed a new black hole simulator called BlackMax to search for evidence that extra dimensions might exist in the universe.

World's biggest computing grid launched
The world's largest computing grid is ready to tackle mankind's biggest data challenge from the earth's most powerful accelerator. Today, three weeks after the first particle beams were injected into the Large Hadron Collider (LHC), the Worldwide LHC Computing Grid combines the power of more than 140 computer centers from 33 countries to analyze and manage more than 15 million gigabytes of LHC data every year.
More CERN Current Events and CERN News Articles
Prestigious Discoveries at CERN

Prestigious Discoveries at CERN
by Roger Cashmore (Editor), Luciano Maiani (Editor), Jean-Pierre Revol (Editor)

The discoveries of neutral currents and of the W and Z bosons marked a watershed in the history of CERN. They established the validity of the electroweak theory and convinced the physicists of the importance of renormalizable non-Abelian gauge theories of the fundamental interactions. The articles collected in this book have been written by distinguished physicists who contributed in a crucial way to these developments. The book is a historical account of those discoveries and of the construction and the testing of the standard model. It also reports on the future of particle physics and provides an updated status report on the LHC and its detectors being currently built at CERN. The book addresses readers interested in particle physics including the educated public.



60 Minutes - The Collider (September 28, 2008)

60 Minutes - The Collider (September 28, 2008)

Under the meadows and mountains outside Geneva, 9,000 physicists from all over the world are taking part in one of the biggest, most ambitious scientific collaborations in history. It's called the large hadron collider, a massive scientific instrument that took 20 years to create and cost $8 billion. Steve Kroft descends into the heart of the collider to find out what we hope to learn when atoms smash into each other.

This product is manufactured on demand using DVD-R recordable media. Amazon.com's standard return policy will apply.

LEP - The Lord of the Collider Rings at CERN 1980-2000: The Making, Operation and Legacy of the World's Largest Scientific Instrument

LEP - The Lord of the Collider Rings at CERN 1980-2000: The Making, Operation and Legacy of the World's Largest Scientific Instrument
by Herwig Schopper (Author), Rolf-Dieter Heuer (Foreword)

Housed by a 4 m diameter tunnel of 27 km circumference, with huge underground labs and numerous surface facilities, and set up with a precision of 0.1 mm per kilometer, the Large Electron-Positron Collider (LEP) was not only the largest but also one of the most sophisticated scientific research instruments ever created by Man. Located at CERN, near Geneva, LEP was built during the years 1983 - 1989, was operational until 2000, and corroborated the standard model of particle physics through continuous high precision measurements.

The Author, director-general of CERN during the crucial period of the construction of LEP, recounts vividly the convoluted decision-making and technical implementation processes - the tunnel alone being a highly challenging geo- and civil engineering...

Non Fiction

Non Fiction
Duo Infernale Cern (Primary Contributor)



  Cern Concert
by Al Blatter



The Quantum Frontier: The Large Hadron Collider

The Quantum Frontier: The Large Hadron Collider
by Don Lincoln (Author)

The highest-energy particle accelerator ever built, the Large Hadron Collider runs under the border between France and Switzerland. It leapt into action on September 10, 2008, amid unprecedented global press coverage and widespread fears that its energy would create tiny black holes that could destroy the earth.

By smashing together particles smaller than atoms, the LHC recreates the conditions hypothesized to have existed just moments after the big bang. Physicists expect it to aid our understanding of how the universe came into being and to show us much about the standard model of particle physics -- even possibly proving the existence of the mysterious Higgs boson. In exploring what the collider does and what it might find, Don Lincoln explains what the LHC is likely to teach...

The Blithedale Romance

The Blithedale Romance
by Old Classics



Collider: The Search for the World's Smallest Particles

Collider: The Search for the World's Smallest Particles
by Paul Halpern (Author)

"Paul Halpern is a gifted writer who brings science and scientists alive. This is a wonderful introduction to the world of high-energy physics, where gigantic machines and tiny particles meet."
—Kenneth Ford, retired director of the American Institute of Physics and author of The Quantum World: Quantum Physics for Everyone

"Professor Paul Halpern takes the reader on a stimulating odyssey on topics ranging from particle physics and dark matter to unexplored dimensions of space. The masterful Halpern likens the physicist's quest to the excavation of archaeologists who seek to uncover 'new treasures' as they unearth wondrous gems that lay hidden all around us. Buy this book and feed your mind!"
—Dr. Cliff Pickover, author of Archimedes to Hawking and The Math Book...

Cernunnos Vase, Goddess Porcelain Sculpture Vase original hand made ceramic

Cernunnos Vase, Goddess Porcelain Sculpture Vase original hand made ceramic
by Hawkdancing Studio

Cernunnos Venus unique design vase is both a beautiful portrait in three dimensions and a functional vase. Hand made original is hand formed with slab method, and sculpted in relief for a three dimentional appearance. Image carries over to inside back wall of vessel, completing the illusion and making a pocket for fresh flowers, arrangement, or a small plant. Place in front of a mirror and you see the back side, the same image done in black with white incised lines in the reflection! Seen at national artfairs, this art goddess sculptural vase can be yours without leaving home! Title: "Cernunnos" A goddess figure perches on the head of Cernunnos, the Celtic horned god of the woods.

Non Fiction (Original)

Non Fiction (Original)
Cern (Primary Contributor)



© 2009 BrightSurf.com