Dartmouth researchers develop computational tool to untangle complex data

December 17, 2008

HANOVER, NH - A group of Dartmouth researchers have developed a mathematical tool that can be used to unscramble the underlying structure of time-dependent, interrelated, complex data, like the votes of legislators over their careers, second-by-second activity of the stock market, or levels of oxygenated blood flow in the brain.

The researchers named their tool the Partition Decoupling Method, and their study is published in this week's online issue of the Proceedings of the National Academy of Sciences. The authors are Gregory Leibon, Scott Pauls, and Daniel Rockmore with Dartmouth's Department of Mathematics, and Robert Savell from Dartmouth's Thayer School of Engineering.

"With respect to the equities market we created a map that illustrated a generalized notion of sector and industry, as well as the interactions between them, reflecting the different levels of capital flow, among and between companies, industries, sectors, and so forth," says Rockmore, the John G. Kemeny Parents Professor of Mathematics and a professor of computer science. "In fact, it is this idea of flow, be it capital, oxygenated blood, or political orientation, that we are capturing."

Capturing patterns in this so-called 'flow' is important to understand the subtle interdependencies among the different components of a complex system. The researchers use the mathematics of a subject called spectral analysis, which is often used to model heat flow on different kinds of geometric surfaces, to analyze the network of correlations. This is combined with statistical learning tools to produce the Partition Decoupling Method (PDM). The PDM discovers regions where the flow circulates more than would be expected at random, collapsing these regions and then creating new networks of sectors as well as residual networks. The result effectively zooms in to obtain detailed analysis of the interrelations as well as zooms out to view the coarse-scale flow at a distance.

Rockmore explains that the Partition Decoupling Method takes a different approach that other tools designed to tease out how complex systems behave. "The PDM is not strictly hierarchical," says Rockmore. "It instead details the interaction between a number of different elements of the system. PDM places no constraint on interconnectivity."

The researchers applied the PDM to the equities market, a system rich in numerical data, as well a complex web of interdependent markets, industries, and currencies. The PDM proved robust, revealing both known structures and patterns and new structures that came to light with the new analysis.

"We think this tool can be useful, when applied in the financial realm, to portfolio and risk management," says Rockmore. "We expect similar results as it is applied to different complex systems like the brain, or even the collections of brains that are societies."

Dartmouth College

---

---

	Mathematical Tools for Economics by Darrell A. Turkington (Author) Designed to demonstrate the essential mathematical concepts—comprehensively and economically—without re-teaching basic material or laboring over superfluous ideas, this text locates the necessary information in a practical economics context. Utilizing clear exposition and dynamic pedagogical features, Mathematical Tools for Economics provides students with the analytical skills they need to better grasp their field of study. A short introduction to mathematics for students of economics Demonstrates essential mathematical concepts necessary for economic analysis, such as matrix algebra and calculus, simultaneous linear equations, and concrete and discrete time Incorporates applications to econometrics and statistics, and includes computational exercises illustrating the...
	Mathematical Tools for Physics (Dover Books on Physics) by James Nearing (Author), Physics (Author) Having the right answer doesn't guarantee understanding. Encouraging students' development of intuition, this original work begins with a review of basic mathematics and advances to infinite series, complex algebra, differential equations, and Fourier series. Succeeding chapters explore multivariable and vector calculus, partial differential equations, numerical and complex analysis, tensors, complex analysis, and more. 2010 edition.
	Functions, Spaces, and Expansions: Mathematical Tools in Physics and Engineering (Applied and Numerical Harmonic Analysis) by Ole Christensen (Author) This graduate-level textbook is a detailed exposition of key mathematical tools in analysis aimed at students, researchers, and practitioners across science and engineering. Every topic covered has been specifically chosen because it plays a key role outside the field of pure mathematics. Although the treatment of each topic is mathematical in nature, and concrete applications are not delineated, the principles and tools presented are fundamental to exploring the computational aspects of physics and engineering. Readers are expected to have a solid understanding of linear algebra, in Rn and in general vector spaces. Familiarity with the basic concepts of calculus and real analysis, including Riemann integrals and infinite series of real or complex numbers, is also required.
	Mathematical Techniques in Finance: Tools for Incomplete Markets (Second Edition) by Ales Cerný (Author) Originally published in 2003, Mathematical Techniques in Finance has become a standard textbook for master's-level finance courses containing a significant quantitative element while also being suitable for finance PhD students. This fully revised second edition continues to offer a carefully crafted blend of numerical applications and theoretical grounding in economics, finance, and mathematics, and provides plenty of opportunities for students to practice applied mathematics and cutting-edge finance. Ales Cerný mixes tools from calculus, linear algebra, probability theory, numerical mathematics, and programming to analyze in an accessible way some of the most intriguing problems in financial economics. The textbook is the perfect hands-on introduction to asset pricing, optimal...
	Mathematical Tools for Applied Multivariate Analysis by J. Douglas Carroll (Author), Paul E. Green (Author), Anil Chaturvedi (Contributor) This revised edition presents the relevant aspects of transformational geometry, matrix algebra, and calculus to those who may be lacking the necessary mathematical foundations of applied multivariate analysis. It brings up-to-date many definitions of mathematical concepts and their operations. It also clearly defines the relevance of the exercises to concerns within the business community and the social and behavioral sciences. Readers gain a technical background for tackling applications-oriented multivariate texts and receive a geometric perspective for understanding multivariate methods."Mathematical Tools for Applied Multivariate Analysis, Revised Edition illustrates major concepts in matrix algebra, linear structures, and eigenstructures geometrically, numerically, and...
	Limits, Limits Everywhere: The Tools of Mathematical Analysis by David Applebaum (Author) A quantity can be made smaller and smaller without it ever vanishing. This fact has profound consequences for science, technology, and even the way we think about numbers. In this book, we will explore this idea by moving at an easy pace through an account of elementary real analysis and, in particular, will focus on numbers, sequences, and series. Almost all textbooks on introductory analysis assume some background in calculus. This book doesn't and, instead, the emphasis is on the application of analysis to number theory. The book is split into two parts. Part 1 follows a standard university course on analysis and each chapter closes with a set of exercises. Here, numbers, inequalities, convergence of sequences, and infinite series are all covered. Part 2 contains a selection of more...
	Elementary Mathematical and Computational Tools for Electrical and Computer Engineers Using MATLAB, Second Edition by Jamal T. Manassah (Author) Showing how MATLAB® can help solve computational problems in engineering, Elementary Mathematical and Computational Tools for Electrical and Computer Engineers Using MATLAB®, Second Edition explores practical mathematical methods for students, covering numerical techniques of elementary calculus and linear algebra and detailed introductory material on difference equations, complex variables, transformation theory, and probability theory. This integrated approach strengthens students' analytical and computational abilities. Updated to reflect the newest version of MATLAB, this edition features a new layout for enhanced readability. The book covers both linear and nonlinear difference equations, elementary functions, numerical differentiation, integration and ordinary differential...
	Mathematical Tools for One-Dimensional Dynamics (Cambridge Studies in Advanced Mathematics) by Edson de de Faria (Author), Welington de de Melo (Author) Detailing the very latest research, this self-contained book discusses the major mathematical tools necessary for the study of complex dynamics at an advanced level. Complete proofs of some of the major tools are presented; some, such as the Bers-Royden theorem on holomorphic motions, appear for the very first time in book format. Originating with the pioneering works of P. Fatou and G. Julia, the subject of complex dynamics has seen great advances in recent years. This necessary book will appeal to graduate students and researchers working in dynamical systems and related fields. Carefully chosen exercises aid understanding and provide a glimpse of further developments in real and complex one-dimensional dynamics.
	Multimedia Tools for Communicating Mathematics by Springer This book on multimedia tools for communicating mathematics arose from presentations at an international workshop organized by the Centro de Matemática e Aplicacoes Fundamentais at the University of Lisbon, in November 2000, with the collaboration of the Sonderforschungsbereich 288 at the University of Technology in Berlin, and of the Centre for Experimental and Constructive Mathematics at Simon Fraser University in Burnaby, Canada. The MTCM2000 meeting aimed at the scientific methods and algorithms at work inside multimedia tools, and it provided an overview of the range of present multimedia projects, of their limitations and the underlying mathematical problems. This book presents some of the tools and algorithms currently being used to create new ways of making enhanced...
	Understanding Search Engines: Mathematical Modeling and Text Retrieval (Software, Environments, Tools), Second Edition by Michael W. Berry (Author), Murray Browne (Author) The second edition of this text covers many of the key design issues for building search engines, emphasizing the important role that applied mathematics plays in improving information retrieval. Important data structures, algorithms, and software are discussed, as well as user-centered issues such as interfaces, manual indexing, and document preparation.