What to do with 15 million gigabytes of dataNovember 03, 2008When it is fully up and running, the four massive detectors on the new Large Hadron Collider (LHC) at the CERN particle-physics lab near Geneva are expected to produce up to 15 million gigabytes, aka 15 petabytes, of data every year. Andreas Hirstius, manager of CERN Openlab and the CERN School of Computing, explains in November's Physics World how computer scientists have risen to the challenge of dealing with this unprecedented volume of data. When CERN staff first considered how they might deal with the large volume of data that the huge collider would produce when its two beams of protons collide, in the mid-1990s, a single gigabyte of disk space still cost a few hundred dollars and CERN's total external connectivity was equivalent to just one of today's broadband connections. It quickly became clear that computing power at CERN, even taking Moore's Law into account, would be significantly less than that required to analyse LHC data. The solution, it transpired during the 1990s, was to turn to "high-throughput computing" where the focus is not on shifting data as quickly as possible from A to B but rather from shifting as much information as possible between those two points. High-performance computing is ideal for particle physics because the data produced in the millions of proton-proton collisions are all independent of one another - and can therefore be handled independently. So, rather than using a massive all-in-one mainframe supercomputer to analyse the results, the data can be sent to separate computers, all connected via a network. From here sprung the LHC Grid. The Grid, which was officially inaugurated last month, is a tiered structure centred on CERN (Tier-0), which is connected by superfast fibre links to 11 Tier-1 centres at places like the Rutherford Appleton Laboratory (RAL) in the UK and Fermilab in the US. More than one CD's worth of data (about 700 MB) can be sent down these fibres to each of the Tier-1 centres every second. Tier 1 centres then feed down to another 250 regional Tier-2 centres that are in turn accessed by individual researchers through university computer clusters and desktops and laptops (Tier-3). As Andreas Hirstius writes, "The LHC challenge presented to CERN's computer scientists was as big as the challenges to its engineers and physicists. The computer scientists managed to develop a computing infrastructure that can handle huge amounts of data, thereby fulfilling all of the physicists' requirements and in some cases even going beyond them." Institute of Physics |
|||||||||||||||||||||
| Related CERN Current Events and CERN News Articles Physicists seek to keep next-gen colliders in 1 piece Controlling huge electromagnetic forces that have the potential to destroy the next generation of particle accelerators is the subject of a new paper by a University of Manchester physicist. Ytterbium's Broken Symmetry Ytterbium was discovered in 1878, but until it recently became useful in atomic clocks, the soft metal rarely made the news. Now ytterbium has a new claim to scientific fame. Intense heat killed the Universe's would-be galaxies, researchers say Our Milky Way galaxy only survived because it was already immersed in a large clump of dark matter which trapped gases inside it. A nimbus rises in the world of cloud computing Cloud computing is a hot topic in the technology world these days. Even if you're not a tech-phile, chances are if you've watched a lot of television or skimmed a business magazine, you've heard someone talking about cloud computing as the way of the future. Argonne cloud computing helps scientists run high energy physics experiments A novel system is enabling high energy physicists at CERN in Switzerland, to make production runs that integrate their existing pool of distributed computers with dynamic resources in "science clouds." MSU scientists help lead teams in detection of fundamental component of matter Michigan State University scientists and colleagues around the world took a step closer to understanding the universe with the discovery of a fundamental building block of nature. Precision measurement of W boson mass portends stricter limits for Higgs particle Scientists of the DZero collaboration at the Department of Energy's Fermi National Accelerator Laboratory have achieved the world's most precise measurement of the mass of the W boson by a single experiment. Combined with other measurements, the reduced uncertainty of the W boson mass will lead to stricter bounds on the mass of the elusive Higgs boson. Secrets behind high temperature superconductors revealed Scientists from Queen Mary, University of London and the University of Fribourg (Switzerland) have found evidence that magnetism is involved in the mechanism behind high temperature superconductivity. Physicists create BlackMax to search for dimensions in space at the Large Hadron Collider A team of theoretical and experimental physicists, with participants from Case Western Reserve University, have designed a new black hole simulator called BlackMax to search for evidence that extra dimensions might exist in the universe. World's biggest computing grid launched The world's largest computing grid is ready to tackle mankind's biggest data challenge from the earth's most powerful accelerator. Today, three weeks after the first particle beams were injected into the Large Hadron Collider (LHC), the Worldwide LHC Computing Grid combines the power of more than 140 computer centers from 33 countries to analyze and manage more than 15 million gigabytes of LHC data every year. More CERN Current Events and CERN News Articles |
|||||||||||||||||||||
|
|||||||||||||||||||||
|
|||||||||||||||||||||