 |
|
SDSC Launches User-Settable Supercomputer Reservations
September 06, 2007Supercomputers keep growing ever faster, racing along at the blazing speed of nearly one petaflops - 10 to the fifteenth, or one thousand trillion calculations per second - equivalent to around 250 thousand of today's laptops. In contrast, the experience of a computational scientist can be anything but fast -- waiting hours or days in a queue for a job to run and yield precious results needed for further steps. The unpredictably of queues can impede the course of research, slowing progress with unexpected periods of waiting.
To address this problem, the San Diego Supercomputer Center (SDSC) at UC San Diego has released version 1.0 of a new User Portal, featuring an innovative user-settable reservation system that gives researchers more control over when their jobs will run on the center's supercomputers. The service, not previously offered in high performance computing centers, is debuting on SDSC's DataStar and TeraGrid Cluster systems.
"We've had a lot of feedback in user surveys asking for faster turnaround time," said Anke Kamrath, director of User Services at SDSC. "While we couldn't eliminate the queue, especially on popular machines like DataStar, we realized that a service that lets users themselves schedule 'windows' of reserved time would let them complete jobs more reliably and get more done."
The reservation system can make computing more efficient in various situations. For example, a user with a large allocation may start a full machine job that will run for a day, only to find a minor problem causes it to quickly fail. Instead of being able to simply fix the problem and restart, the user is faced with going to the end of the queue and again waiting hours or days for the job to run. With SDSC's new User Portal, this user can now easily set a reservation for a full-machine job, ensuring that they can complete the job in a timely way, even if minor problems occur.
Another research group may be debugging a new code. To do this they need to run many short jobs in succession, working as a team to troubleshoot the results of each run, and then trying again. But each time they want to restart the code, they have to sit in the queue, potentially wasting many hours as the group awaits the results of each run. Using the reservations feature in the portal, the researchers can now schedule several hours of machine time for multiple debugging runs, making efficient use of the team's time.
Other researchers may need to be sure they run in conjunction with a scheduled event such as observing time on an electron microscope or other instrument. Efforts are also underway to use this capability to support the co-scheduling of jobs to run across TeraGrid-wide systems.
"SDSC's User Portal offers a clean interface that shields users from the complexity of the underlying service," said Diana Diehl, who leads SDSC's Documentation and Portals group. "Just like an airline reservation system makes intricate arrangements in a few minutes for travelers at their computers, SDSC's reservation system carries out complicated tasks to arrange the supercomputer reservation, making sure that it follows policies, doesn't disrupt jobs currently in the queue, interfaces with the user's account, and allows time for preventive maintenance."
While users have always been able to reserve time manually, the process can be slow and cumbersome. SDSC's new user-settable system democratizes access to reliable computing, letting any user log in with either their TeraGrid or SDSC account and easily reserve time themselves. Rather than carving up the machine among various pre-selected users, this approach allows users to reserve up to full machine runs, encouraging use of the power of the full supercomputer to advance science into new realms.
The new user-settable system has been carefully designed to provide reservations that are in balance with existing jobs in the queue, and reservations carry a premium cost over jobs run without a reservation.
Based on GridSphere, the portal offers a Web interface to accomplish tasks such as running jobs and moving data that would ordinarily require complex command-line scripts. In the future, more features will be added to the User Portal through portlets such as accessing the SDSC Storage Resource Broker (SRB) data management system, the HPSS archival tape storage system, and visualization tools.
"It was an enormous task to create such a complex system," said Kamrath. "It required teamwork among groups from Documentation to Production Systems across the center, and couldn't have been done without SDSC's large pool of expertise in a number of areas."
The large team required to create the SDSC User Portal and user-settable reservation system includes, in management and development, Anke Karmrath, Diana Diehl, Patricia Kovach, Nancy Wilkins-Diehr, as well as Fariba Fana, Mona Wong, Ken Yoshimoto, Martin Margo, Andy Sanderson, J.D. Bottorf, Bill Link, Doug Weimer, Mahidhar Tatineni, Eva Hocks, Leo Carson, Tiffany Duffield, Krishna Muriki, and Alex Wu; in testing, Subha Sivagnanam, Leon Hu, Cuong Phan, Nicole Wolter, Kyle Rollin, Ella Xiong, Jet Antonio, and Shanil Daya.
University of California, San Diego
The reservation system can make computing more efficient in various situations. For example, a user with a large allocation may start a full machine job that will run for a day, only to find a minor problem causes it to quickly fail. Instead of being able to simply fix the problem and restart, the user is faced with going to the end of the queue and again waiting hours or days for the job to run. With SDSC's new User Portal, this user can now easily set a reservation for a full-machine job, ensuring that they can complete the job in a timely way, even if minor problems occur.
Another research group may be debugging a new code. To do this they need to run many short jobs in succession, working as a team to troubleshoot the results of each run, and then trying again. But each time they want to restart the code, they have to sit in the queue, potentially wasting many hours as the group awaits the results of each run. Using the reservations feature in the portal, the researchers can now schedule several hours of machine time for multiple debugging runs, making efficient use of the team's time.
Other researchers may need to be sure they run in conjunction with a scheduled event such as observing time on an electron microscope or other instrument. Efforts are also underway to use this capability to support the co-scheduling of jobs to run across TeraGrid-wide systems.
"SDSC's User Portal offers a clean interface that shields users from the complexity of the underlying service," said Diana Diehl, who leads SDSC's Documentation and Portals group. "Just like an airline reservation system makes intricate arrangements in a few minutes for travelers at their computers, SDSC's reservation system carries out complicated tasks to arrange the supercomputer reservation, making sure that it follows policies, doesn't disrupt jobs currently in the queue, interfaces with the user's account, and allows time for preventive maintenance."
While users have always been able to reserve time manually, the process can be slow and cumbersome. SDSC's new user-settable system democratizes access to reliable computing, letting any user log in with either their TeraGrid or SDSC account and easily reserve time themselves. Rather than carving up the machine among various pre-selected users, this approach allows users to reserve up to full machine runs, encouraging use of the power of the full supercomputer to advance science into new realms.
The new user-settable system has been carefully designed to provide reservations that are in balance with existing jobs in the queue, and reservations carry a premium cost over jobs run without a reservation.
Based on GridSphere, the portal offers a Web interface to accomplish tasks such as running jobs and moving data that would ordinarily require complex command-line scripts. In the future, more features will be added to the User Portal through portlets such as accessing the SDSC Storage Resource Broker (SRB) data management system, the HPSS archival tape storage system, and visualization tools.
"It was an enormous task to create such a complex system," said Kamrath. "It required teamwork among groups from Documentation to Production Systems across the center, and couldn't have been done without SDSC's large pool of expertise in a number of areas."
The large team required to create the SDSC User Portal and user-settable reservation system includes, in management and development, Anke Karmrath, Diana Diehl, Patricia Kovach, Nancy Wilkins-Diehr, as well as Fariba Fana, Mona Wong, Ken Yoshimoto, Martin Margo, Andy Sanderson, J.D. Bottorf, Bill Link, Doug Weimer, Mahidhar Tatineni, Eva Hocks, Leo Carson, Tiffany Duffield, Krishna Muriki, and Alex Wu; in testing, Subha Sivagnanam, Leon Hu, Cuong Phan, Nicole Wolter, Kyle Rollin, Ella Xiong, Jet Antonio, and Shanil Daya.
University of California, San Diego
Supercomputer Current Events and Supercomputer News RSSOak Ridge supercomputer is the world's fastest for science
A Cray XT high-performance computing system at the Department of Energy's (DOE) Oak Ridge National Laboratory is the world's fastest supercomputer for science.
Computer model improves ultrasound image
Doctors use diagnostic sonography or ultrasound to visualise organs and other internal structures of the human body.
What to do with 15 million gigabytes of data
When it is fully up and running, the four massive detectors on the new Large Hadron Collider (LHC) at the CERN particle-physics lab near Geneva are expected to produce up to 15 million gigabytes, aka 15 petabytes, of data every year
Supercomputer provides massive computational boost to biomedical research at TGen
In less time than the blink of an eye, the Translational Genomics Research Institute's new supercomputer at Arizona State University can do operations equal to every dollar in the recent Wall Street bailout.
NASA Supercomputer Shows How Dust Rings Point to Exo-Earths
Supercomputer simulations of dusty disks around sunlike stars show that planets nearly as small as Mars can create patterns that future telescopes may be able to detect. The research points to a new avenue in the search for habitable planets.
Future Risk of Hurricanes: The Role of Climate Change
Researchers are homing in on the hurricane-prone Gulf of Mexico and Caribbean Sea to assess the likely changes, between now and the middle of the century, in the frequency, intensity, and tracks of these powerful storms. Initial results are expected early next year.
Immigrant Sun: Our star could be far from where it started in Milky Way
A long-standing scientific belief holds that stars tend to hang out in the same general part of a galaxy where they originally formed. Some astrophysicists have recently questioned whether that is true, and now new simulations show that, at least in galaxies similar to our own Milky Way, stars such as the sun can migrate great distances.
Moving Quarks Help Solve Proton Spin Puzzle
New theory work at the U.S. Department of Energy's Thomas Jefferson National Accelerator Facility has shown that more than half of the spin of the proton is the result of the movement of its building blocks: quarks.
Strange molecule in the sky cleans acid rain, scientists discover
Researchers have discovered an unusual molecule that is essential to the atmosphere's ability to break down pollutants, especially the compounds that cause acid rain.
Study shows clumps and streams of dark matter in inner regions of the Milky Way
Using one of the most powerful supercomputers in the world to simulate the halo of dark matter that envelopes our galaxy, researchers found dense clumps and streams of the mysterious stuff lurking in the inner regions of the halo, in the same neighborhood as our solar system.
More Supercomputer Current Events and Supercomputer News Articles
 | The Whale and the Supercomputer: On the Northern Front of Climate Change by Charles Wohlforth Scientists and natives wrestle with our changing climate in the land where it has hit first--and hardestA traditional Eskimo whale-hunting party races to shore near Barrow, Alaska-their comrades trapped on a floe drifting out to sea-as ice that should be solid this time of year gives way. Elsewhere, a team of scientists transverses the tundra, sleeping in tents, surviving on frozen chocolate, and... |
 | Computer Architecture: From Microprocessors to Supercomputers (Oxford Series in Electrical and Computer Engineering) by Behrooz Parhami Computer Architecture: From Microprocessors to Supercomputers provides a comprehensive introduction to this thriving and exciting field. Emphasizing both underlying theory and actual designs, the book covers a wide array of topics and links computer architecture to other subfields of computing. The material is presented in lecture-sized chapters that make it easy for students to understand the... |
 | The Supermen: The Story of Seymour Cray and the Technical Wizards Behind the Supercomputer by Charles J. Murray The SUPERMEN "After a rare speech at the National Center for Atmospheric Research in Boulder, Colorado, in 1976, programmers in the audience had suddenly fallen silent when Cray offered to answer questions. He stood there for several minutes, waiting for their queries, but none came. When he left, the head of NCAR's computing division chided the programmers. 'Why didn't someone raise a... |
| The Illiac IV: The First Supercomputer by R. Michael Hord | |
| Supercomputers: Charting the Future of Cybernetics (Science and Technology in Focus) by Charlene W. Billings, Sean M. Grady Some computers are so fast and powerful that they are known as "supercomputers." The next generation of these computers will be able to complete more than one trillion operations per second. We need computers that are powerful enough to access, process, and apply the world's store of information, which is doubling approximately every five years. Supercomputers, a totally revised and expanded... | |
 | Scientific Computing on Supercomputers III |
| A Guidebook to Fortran on Supercomputers by John M. Levesque, Joel W. Williamson | |
 | A Scientist's and Engineer's Guide to Workstations and Supercomputers: Coping with Unix, RISC, Vectors, and Programming by Rubin H. Landau, Paul J. Fink, Paul J. Landau, Rubin H. Fink A scientist’s and engineer’s guide to Workstations and Supercomputers Crack the Unix code and put its power to work for you. If you’re seeking such clear-cut guidance, your search will end with the first Unix survival manual designed specifically for practicing scientists and engineers like you. Avoiding the narrower concerns and complicated jargon of computer science, this guide shows you... |
| Fast, Faster, Fastest: The Story of Supercomputers (World of Computers) by David J. Darling Describes the present and future uses of the most powerful computers designed, some of which can perform more than 500 million calculations per... | |
| Scientific Computing on Supercomputers |
| © 2008 BrightSurf.com |