Journal article
Algorithm for model validation: theory and applications
Proceedings of the National Academy of Sciences - PNAS, Vol.104(16), pp.6562-6567
04/17/2007
Handle:
https://hdl.handle.net/2376/107739
PMCID: PMC1871825
PMID: 17420476
Abstract
Validation is often defined as the process of determining the degree to which a model is an accurate representation of the real world from the perspective of its intended uses. Validation is crucial as industries and governments depend increasingly on predictions by computer models to justify their decisions. We propose to formulate the validation of a given model as an iterative construction process that mimics the often implicit process occurring in the minds of scientists. We offer a formal representation of the progressive build-up of trust in the model. Thus, we replace static claims on the impossibility of validating a given model by a dynamic process of constructive approximation. This approach is better adapted to the fuzzy, coarse-grained nature of validation. Our procedure factors in the degree of redundancy versus novelty of the experiments used for validation as well as the degree to which the model predicts the observations. We illustrate the methodology first with the maturation of quantum mechanics as the arguably best established physics theory and then with several concrete examples drawn from some of our primary scientific interests: a cellular automaton model for earthquakes, a multifractal random walk model for financial time series, an anomalous diffusion model for solar radiation transport in the cloudy atmosphere, and a computational fluid dynamics code for the Richtmyer-Meshkov instability.
Metrics
11 Record Views
Details
- Title
- Algorithm for model validation: theory and applications
- Creators
- D Sornette - Institute of Geophysics and Planetary Physics and Departments of Earth and Space Sciences and Atmospheric and Oceanic Sciences, University of California, Los Angeles, CA 90095, USA. dsornette@ethz.chA B DavisK IdeK R VixieV PisarenkoJ R Kamm
- Publication Details
- Proceedings of the National Academy of Sciences - PNAS, Vol.104(16), pp.6562-6567
- Academic Unit
- Mathematics and Statistics, Department of
- Publisher
- United States
- Identifiers
- 99900546946701842
- Language
- English
- Resource Type
- Journal article