Oak Ridge supercomputer is the world's fastest for science

November 18, 2008

A Cray XT high-performance computing system at the Department of Energy's (DOE) Oak Ridge National Laboratory is the world's fastest supercomputer for science. The annual ranking of the world's top 500 computers (www.top500.org) will be released Tuesday in Austin at an annual international supercomputing conference.

The Cray XT, called Jaguar, has a peak performance of 1.64 petaflops, (quadrillion floating point operations, or calculations) per second, incorporating a 1.382 petaflops XT5 and a 266 teraflops XT4 systems. Each component of the Jaguar system is separately ranked second and eighth on the current list of Top500 supercomputers in the world.

"This accomplishment is the culmination of our vision to regain leadership in high performance computing and harness its potential for scientific investigation," said Undersecretary for Science Raymond L. Orbach. "I am especially gratified because we make this machine available to the entire scientific community through an open and transparent process that has resulted in spectacular scientific results ranging from the human brain to the global climate to the origins of the Universe."

Oak Ridge National Laboratory Director Thom Mason said the real value of the new machine will be measured by the scientific breakthroughs that will now be possible.

"We are proud to be home to the world's most powerful computer dedicated to open science, but we are more excited about the ability of Oak Ridge and the Department of Energy to take a leading role in finding solutions to scientific challenges such as new energy sources and climate change," Mason said.

In June, a DOE supercomputer named Roadrunner at Los Alamos National Laboratory was the first to break the petascale barrier. Built with advanced IBM Cell processors, Roadrunner helps ensure the reliability of America's nuclear weapons stockpile.

Beginning as a 26-teraflop system in 2005, Oak Ridge embarked upon a three-year series of aggressive upgrades designed to make their machine the world's most powerful computing system. The Cray XT was upgraded to 119 teraflops in 2006 and 263 teraflops in 2007. In 2008, with approximately 182,000 AMD Opteron processing cores, the new 1.64-petaflop system is more than 60 times larger than its original predecessor.

Thomas Zacharia, the laboratory's associate director for Computing and Computational Sciences, says petascale machines like Jaguar help advance critical scientific application areas by enabling researchers to get answers faster and explore complex, dynamic systems. In a matter of few days, Jaguar has already run scientific applications ranging from materials to combustion on the entire system, sustaining petaflops performance on multiple applications. A calculation that once took months can now be done in minutes. A 2008 report from the DOE Office of Science, America's largest funder of basic physical science programs at universities and government laboratories, said six of the top ten recent scientific advancements in computational science used Jaguar to provide unprecedented insight into supernovas, combustion, fusion, superconductivity, dark matter, and mathematics.

The DOE's Office of Science makes Jaguar available to scientists in academia, industry, and government to tackle the world's most complicated projects. Through the agency's Innovative and Novel Computational Impact on Theory and Experiment program, which allocates the supercomputer's resources through a peer-reviewed proposal system, researchers were allocated more than 140 million processor hours to 30 projects.

To date the computer simulations on Jaguar have focused largely on addressing new forms of energy and understanding the impact on climate resulting from energy use. For example, INCITE projects have simulated enzymatic breakdown of cellulose to make production of biofuels commercially viable as well as coal gasification processes to help industry design near-zero-emission plants. Combustion scientists have studied how fuel burns-important for fuel-efficient, low-emission engines. Computer models have helped physicists use radio waves to heat and control ionized fuel in a fusion reactor. Similarly, engineers have designed materials to recover energy escaping from vehicle tailpipes. Simulation insights have enabled biologists to design new drugs to thwart Alzheimer's fibrils and engineer the workings of cellular ion channels to detoxify industrial wastes.

Jaguar's superlative speed is matched by substantial memory that allows scientists to solve complex problems, sizeable disk space for storing massive amounts of data, and unmatched speed to read and write files. High-speed Internet connections enable users from around the world to access the machine, and high-end visualization helps them make sense of the avalanche of data Jaguar generates.

Twice a year, the TOP500 list ranks powerful computing systems on their speed in running a benchmark program called HPL, for High-Performance Linpack. In June of 2007, Jaguar solved the largest HPL challenge ever-a matrix problem with nearly 5 trillion elements. The achievement highlights Jaguar's skill in balancing processor speed and system memory.

Oak Ridge National Laboratory is managed by UT-Battelle for the U.S. Department of Energy.

Jaguar at a glance: • Cray XT • Top500 rank: 2 + 8 • 1.64-petaflops peak theoretical performance • 1.059 + 0.205-petaflops actual performance on HPL benchmark program • 182,000 processing cores • AMD quad-core OpteronTM 2.3 gigahertz processors • InfiniBand network • Cray SeaStar network interface and router • 362 terabytes of memory • 578 terabytes per second of memory bandwidth • 284 gigabytes per second of input/output bandwidth • 10-gigabyte-per-second connections to ESnet and Internet 2 networks • High-Performance Storage System scales to store increasing amounts of simulation data • Spider, a 10-petabyte Lustre-based shared file system, connects to every system in the ORNL computing complex • disk subsystem transfers data at greater than 200 gigabytes per second

Oak Ridge National Laboratory

---

---

	Computer Architecture: From Microprocessors to Supercomputers (Oxford Series in Electrical and Computer Engineering) by Behrooz Parhami (Author) Computer Architecture: From Microprocessors to Supercomputers provides a comprehensive introduction to this thriving and exciting field. Emphasizing both underlying theory and actual designs, the book covers a wide array of topics and links computer architecture to other subfields of computing. The material is presented in lecture-sized chapters that make it easy for students to understand the relationships between various topics and to see the "big picture." The short chapters also allow instructors to order topics in the course as they like. The text is divided into seven parts, each containing four chapters. Part I provides context and reviews prerequisite topics including digital computer technology and computer system performance. Part II discusses instruction-set...
	The Supermen: The Story of Seymour Cray and the Technical Wizards Behind the Supercomputer by Charles J. Murray (Author) The SUPERMEN "After a rare speech at the National Center for Atmospheric Research in Boulder, Colorado, in 1976, programmers in the audience had suddenly fallen silent when Cray offered to answer questions. He stood there for several minutes, waiting for their queries, but none came. When he left, the head of NCAR's computing division chided the programmers. 'Why didn't someone raise a hand?' After a tense moment, one programmer replied, 'How do you talk to God?'" -from The SUPERMEN The Story of Seymour Cray and the Technical Wizards behind the Supercomputer "They were building revolutionary, not evolutionary, machines. . . . They were blazing a trail-molding science into a product. . . . The freedom to create was extraordinary." -from The Supermen In 1951, a...
	Understanding Supercomputing by Scientific American (Author), editors at Scientific American (Author) In this book you'll discover what constitutes a 'supercomputer', how the supercomputers of today function, how you can make your own computer into a super machine - through networking - and what tomorrow holds in store for computer usage in terms of hardware, software and everyday applications.
	The Whale and the Supercomputer: On the Northern Front of Climate Change by Charles Wohlforth (Author) Scientists and natives wrestle with our changing climate in the land where it has hit first --and hardest A traditional Eskimo whale-hunting party races to shore near Barrow, Alaska-their comrades trapped on a floe drifting out to sea-as ice that should be solid this time of year gives way. Elsewhere, a team of scientists transverses the tundra, sleeping in tents, surviving on frozen chocolate, and measuring the snow every ten kilometers in a quest to understand the effects of albedo, the snow's reflective ability to cool the earth beneath it. Climate change isn't an abstraction in the far North. It is a reality that has already dramatically altered daily life, especially that of the native peoples who still live largely off the land and sea. Because nature shows her...
	SUPERCOMPUTER #39 (Choose Your Own Adventure) by Edward Packard (Author)
	A Scientist's and Engineer's Guide to Workstations and Supercomputers: Coping with Unix, RISC, Vectors, and Programming by Rubin H. Landau (Author), Paul J. Fink (Author), Paul J. Landau (Author), Rubin H. Fink (Author) A scientist’s and engineer’s guide to Workstations and Supercomputers Crack the Unix code and put its power to work for you. If you’re seeking such clear-cut guidance, your search will end with the first Unix survival manual designed specifically for practicing scientists and engineers like you. Avoiding the narrower concerns and complicated jargon of computer science, this guide shows you how to master the complexities of accomplishing computer projects—from start to finish—predominantly under a Unix operating system. With the help of clarifying examples and tutorials, you’ll learn how to write and organize files and programs as well as run, debug, and visualize the results of scientific programs on workstations and supercomputers. At the same time, you’ll discover how to...
	Peer-to-Peer Computing: Building Supercomputers with Web Technologies (Computer Communications and Networks) by Alfred Wai-Sing Loo (Author) Communications of ACM Internet Research IEEE Transactions on Parallel and Distributed Systems Parallel Computing IEEE Transactions on Computers ACM Transactions on Computer Systems
	Optimizing Supercompilers for Supercomputers (Research Monographs in Parallel and Distributed Computing) by Michael Wolfe (Author) Effective use of a supercomputer requires users to have a good algorithm and to express this algorithm in an appropriate language, and requires compilers to generate efficient code. This book investigates several problems facing compiler design for supercomputers, including building efficient and comprehensive data dependence graphs, recurrence relations, the management of compiler temporary variables, and WHILE loops. The book first proposes an efficient means of representing the flow of data in a program by labeling the arcs in a data dependence graph with "direction vectors" to show how the flow of data corresponds to the loop structure of the program. These data dependence direction vectors are then used in several high level compiler loop optimizations:...
	Parallel Processing for Supercomputers and Artificial Intelligence (Mcgraw-Hill Series in Supercomputing and Parallel Processing) by Kai Hwang (Author), Doug Degroot (Editor)
	The Supercomputer Era by Sidney Karin (Author), Norris Parker Smith (Author)