Evaluating science

November 11, 2015

KNOXVILLE--What works in science and what doesn't and how do we know? As the academic community faces greater scrutiny from external funders as to how and why research or education programs work, the need for external evaluation has never been more apparent.

The National Institute for Mathematical and Biological Synthesis (NIMBioS) is now offering a suite of evaluative services to aide scientific research and education efforts. The newly formed NIMBioS Evaluation Services was established to provide independent, rigorous and transparent formative and summative evaluations of both research and educational programs in the STEM (science, technology, engineering and mathematics) sector, particularly programs that are interdisciplinary.

"Rigorous evaluation of new approaches in the training of the current and the next-generation of academic students is critical for advancement of student learning in science, technology, and mathematics, and for guiding how to promote interdisciplinarity across these fields," said NIMBioS Director Colleen Jonsson.

NIMBioS uses a systems-based model of evaluation, which considers the organization as a whole, assessing the quality and significance of outcomes while still examining the inputs and processes leading to outcomes. NIMBioS also incorporates new research methods, such as bibliometrics to analyze publication output, network analysis to examine cross-disciplinary collaborations, and mapping of scientific output, among other methods.

Pamela Bishop, an adjunct professor in evaluation, statistics and measurement at the University of Tennessee, Knoxville, leads the NIMBioS evaluation team, which also includes graduate research assistant Lakmal Walpitage and database specialist Ana Richters. A postdoctoral fellowship in evaluation services has also been created.

The team has already undertaken several projects, including landing a $299,990 grant from the National Science Foundation to develop a new tool to assess student learning in mathematics.

Bishop has been evaluating NIMBioS activities since the institute was established in 2008, which has included more than 150 systematic evaluations. Evaluation of NIMBioS' activities has evolved from formative evaluation of the institute's practices to incorporate how the institute itself has affected interdisciplinary science. One longitudinal study, published in the journal Research Evaluation, determined that during the years in which faculty were affiliated with NIMBioS, they were more likely to collaborate with colleagues and with other institutions, and more likely to form international collaborations. Another study--this one of undergraduate participants in summer research at NIMBioS--found gains in their understanding of interdisciplinary research collaboration.

Projects that NIMBioS Evaluation Services is currently collaborating on include one with BioQUEST Curriculum Consortium and the National Association of Biology Teachers to enhance biology faculty collaboration and leadership at community colleges and another project called QUBES ("Supporting Faculty in Quantitative Undergraduate Biology Education and Synthesis") that provides resources for teaching undergraduate quantitative biology.

"We are trying new approaches based on our experience and research, and we need to be able to assess the effectiveness of these approaches," said BioQUEST Executive Director Kristin Jenkins. "It's not enough to say, 'Participants enjoyed it and we think they were transformed.' We also want to be able to strengthen our program by better understanding what works and for whom."
For more information about NIMBioS Evaluation Services, visit http://www.nimbios.org/evaluation/

The National Institute for Mathematical and Biological Synthesis is an NSF-supported center that brings together researchers from around the world to collaborate across disciplinary boundaries to investigate solutions to basic and applied problems in the life sciences.

CONTACT: Pamela Bishop, NIMBioS, +1-865-974-9348, pambishop@nimbios.org
Catherine Crawley, NIMBioS, +1-865-974-9350, ccrawley@nimbios.org

National Institute for Mathematical and Biological Synthesis (NIMBioS)

Related Mathematics Articles from Brightsurf:

A new method for boosting the learning of mathematics
How can mathematics learning in primary school be facilitated? UNIGE has developed an intervention to promote the learning of math in school.

Could mathematics help to better treat cancer?
Impaired information processing may prevent cells from perceiving their environment correctly; they then start acting in an uncontrolled way and this can lead to the development of cancer.

People can see beauty in complex mathematics, study shows
Ordinary people see beauty in complex mathematical arguments in the same way they can appreciate a beautiful landscape painting or a piano sonata.

Improving geothermal HVAC systems with mathematics
Sustainable heating, ventilation, and air conditioning systems, such as those that harness low-enthalpy geothermal energy, are needed to reduce collective energy use and mitigate the continued effects of a warming climate.

How the power of mathematics can help assess lung function
Researchers at the University of Southampton have developed a new computational way of analyzing X-ray images of lungs, which could herald a breakthrough in the diagnosis and assessment of chronic obstructive pulmonary disease (COPD) and other lung diseases.

Mathematics pushes innovation in 4-D printing
New mathematical results will provide a potential breakthrough in the design and the fabrication of the next generation of morphable materials.

More democracy through mathematics
For democratic elections to be fair, voting districts must have similar sizes.

How to color a lizard: From biology to mathematics
Skin color patterns in animals arise from microscopic interactions among colored cells that obey equations discovered by Alan Turing.

US educators awarded for exemplary teaching in mathematics
Janet Heine Barnett, Caren Diefenderfer, and Tevian Dray were named the 2017 Deborah and Franklin Tepper Haimo Award winners by the Mathematical Association of America (MAA) for their teaching effectiveness and influence beyond their institutions.

Authors of year's best books in mathematics honored
Prizes for the year's best books in mathematics were awarded to Ian Stewart and Tim Chartier by the Mathematical Association of America (MAA) on Jan.

Read More: Mathematics News and Mathematics Current Events
Brightsurf.com is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com.