Researchers to help exterminate bugs in spreadsheets, web

May 05, 2004

ARLINGTON, Va.-An error in a spreadsheet or Web page calculation sounds harmless enough, unless you're the person whose retirement funds, credit history or medical treatment rely on decisions based on that calculation. A six-campus team of computer scientists led by Margaret Burnett at Oregon State University is working to help exterminate the bugs that infest the spreadsheets and other "programs" created by millions of computer users.

You may not think of yourself as a programmer, but that's just what you are if you've ever created a simple Web application that grabs data, such as current weather conditions, from another site, entered a formula in a spreadsheet or automated a repetitive task in your e-mail client or word processor. Experts estimate the number of these so-called "end-user programmers" to reach 55 million by 2005, and the same experts suggest that nearly half of the programs created by these end users have nontrivial bugs.

"For end-user programmers, software engineering isn't their job and it shouldn't be," said Burnett, a professor of computer science and director of the End Users Shaping Effective Software (EUSES) project. "Programming is a means to an end. They consider themselves successful when they've won new business through their Web site or completed a budget analysis. The problem, in part, is motivating them and focusing their attention on their programming errors amid other matters."

In addition to Oregon State, EUSES involves researchers from Carnegie Mellon University, Drexel University, Pennsylvania State University, the University of Nebraska, Lincoln, and Cambridge University. The project is supported by a five- year, $2.6 million Information Technology Research award from the National Science Foundation.

Some of the first results from EUSES were recently presented at CHI 2004 in Vienna, Austria. In their CHI 2004 paper, Burnett and colleagues at Oregon State described a study of how best to tell spreadsheet programmers they may have created some buggy code. The Oregon State team compared immediate interruptions (such as pop-up error messages that demand immediate attention) with "negotiated" interruptions (similar to a word processor underlining a misspelled word).

By every measure, the negotiated interruptions were superior. The spreadsheet users learned more about the tools they were using, caught and corrected more errors and had a better idea of how well they had done. "We learned: Stay out of their way, give them hints to explore and they'll get more done," Burnett said.

In a separate paper, EUSES collaborators Andrew Ko and Brad Myers of Carnegie Mellon University described a novel environment that allows programmers to zero in on bugs by asking questions about "why did" or "why didn't" something happen. The new debugging interface helped programmers find bugs eight times faster and make 40 percent more progress in the programming task.

"It's an incredible scandal that the tools used today for debugging are the same ones available in the 1940s," said Myers. "It's time that new tools made their way into all programming environments so end-user and professional programmers won't have to suffer the way we still suffer now." Myers's work is also supported by a separate $1.2 million NSF award to provide better tools for developing and debugging programs.

The two papers are part of the EUSES effort to develop new techniques and tools for debugging and testing, as well as to apply more behind-the-scenes intelligence for coaching programmers along the way. The work to create more effective tools also includes projects led by Martin Erwig and Gregg Rothermel of Oregon State, Sebastian Elbaum at Nebraska and Mary Shaw of Carnegie Mellon. These projects reason behind the scenes about the program itself, the data being processed and the edits the user makes to the program to keep potential errors out and to help the user track down the sources of errors that may already be present.

Another aspect of EUSES involves efforts to get inside end- user programmers' heads and understand the best ways to help them. Mary Beth Rosson of Penn State, Susan Wiedenbeck of Drexel University, Curtis Cook of Oregon State and Alan Blackwell of Cambridge University are leading efforts to observe end-user programmers in their natural habitats, watching as they debug simple web applications, surveying their attitudes and concerns and learning why people choose to use (or not use) the tools available to them.

"Our first principle in EUSES is 'Do no harm'-no matter what fancy features we add, we don't want to get in the way," Burnett said. "For experienced users, though, we want to encourage good testing habits and support quality control. The system will know about software engineering techniques and help the user monitor the dependability of what they've programmed. We want to provide the user with a willing collaborator in the system."

A third track in EUSES, led by Maggie Niess and Ellen Ford of Oregon State, focuses on education. With participation from K-12 teachers, Niess and Ford are developing summer workshops for both teachers and students with follow-up in the classroom. This work is being done in partnership with Saturday Academy, directed by Ford. Saturday Academy is a non-profit cooperative that provides intensive, hands-on, after-school study opportunities in science and technology for middle- and high-school youth in both urban and rural Oregon communities. Besides considering education as a testbed for EUSES concepts, Niess and Ford are developing changes to how technology is taught, so that quality control is part of the learning process, not an afterthought.

The general concepts behind EUSES may also eventually find their way to almost any programming-like activity, such as programming a VCR, digital thermostat or home security system. Rather than risk making an error, many people skip that sort of programming altogether. According to Burnett, EUSES may uncover reasons for this avoidance and lead to systems that encourage people to safely take that leap.
NSF Program Officer: Sol Greenspan, 703-292-8910,

Project Director: Margaret Burnett, Oregon State University, 541-737-2539,
Brad Myers, Carnegie Mellon University, 412-268-5150,
Contact information for all EUSES principal investigators is at

EUSES project:

The National Science Foundation is an independent federal agency that supports fundamental research and education across all fields of science and engineering, with an annual budget of nearly $5.58 billion. National Science Foundation funds reach all 50 states through grants to nearly 2,000 universities and institutions. Each year, NSF receives about 40,000 competitive requests for funding, and makes about 11,000 new funding awards. The National Science Foundation also awards over $200 million in professional and service contracts yearly.

Receive official National Science Foundation news electronically through the e-mail delivery system, NSFnews. To subscribe, send an e-mail message to join- In the body of the message, type "subscribe nsfnews" and then type your name. (Ex.: "subscribe nsfnews John Smith")

Useful National Science Foundation Web Sites:
NSF Home Page:
News Highlights:
Science Statistics:
Awards Searches:

National Science Foundation

Related Quality Control Articles from Brightsurf:

Reliable quality-control of graphene and other 2D materials is routinely possible
Scientists at Ames Laboratory have discovered and confirmed a method which could serve as an easy but reliable way to test the quality of graphene and other 2D materials.

Quality control mechanism closes the protein production 'on-ramps'
Recent work revealed a newfound quality control system in the protein production assembly line with possible implications for understanding neurogenerative disease.

RNA quality control system goes awry in frontotemporal lobar degeneration
Researchers from Osaka University have uncovered that the RNA exosome is critical for the degradation of defective repeat RNA derived from C9orf72 repeat expansions in patients with C9orf72-associated frontotemporal lobar degeneration and amyotrophic lateral sclerosis.

Control of anthropogenic atmospheric emissions can improve water quality in seas
A new HKU research highlighted the importance of reducing fossil fuel combustion not only to curb the trend of global warming, but also to improve the quality of China's coastal waters.

Healthcare innovators focus on 'quality as a business strategy' -- update from Journal of Healthcare Quality
Despite two decades of effort -- targeting care processes, outcomes, and most recently the value of care - progress has been slow in closing the gap between quality and cost in the US healthcare system.

New software tool fosters quality control of genome-scale models of metabolism
The lack of common standards and problems with reproducing and verifying existing datasets are widespread in the biotech community.

Failure of mitochondrial quality control causes heart disease
Mutations in the gene that encodes a protein called ANT cause a variety of conditions, such as heart disease, but the underlying mechanism of how these mutations trigger disease has been unclear.

Quality control in immune communication: Chaperones detect immature signaling molecules
The cells of our immune system constantly communicate with one another by exchanging complex protein molecules.

Quality control in cells
A protective protein that detects newly-made incomplete protein chains in higher cells is found to have a relative in bacteria.

Food quality control made faster and easier
Scientists at the Technical University of Munich (TUM) and the Leibniz-Institute for Food Systems Biology have developed a new methodology for the simultaneous analysis of odorants and tastants.

Read More: Quality Control News and Quality Control Current Events is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to