Model application niche analysis: assessing the transferability and generalizability of ecological models

Authors

JESSICA B. MOON, U.S. Environmental Protection Agency, University of Arkansas
THEODORE H. DEWITT, U.S. Environmental Protection Agency
MELISSA N. ERREND, Oregon State University
RANDALL J. F. BRUINS, U.S. Environmental Protection Agency
MARY E. KENTULA, U.S. Environmental Protection Agency
SARAH J. CHAMBERLAIN, The Pennsylvania State University
M. SIOBHAN FENNESSY, Kenyon College
KUSUM J. NAITHANI, University of Arkansas

Document Type

Article

Date of this Version

8-23-2017

Citation

Moon, J. B., T. H. DeWitt, M. N. Errend, R. J. F. Bruins, M. E. Kentula, S. J. Chamberlain, M. S. Fennessy, and K. J. Naithani. 2017. Model application niche analysis: assessing the transferability and generalizability of ecological models. Ecosphere 8(10):e01974. 10.1002/ecs2.1974

Comments

Open access.

Abstract

The use of models by ecologists and environmental managers, to inform environmental management and decision-making, has grown exponentially in the past 50 yr. Due to logistical, economical, and theoretical benefits, model users frequently transfer preexisting models to new sites where data are scarce. Modelers have made significant progress in understanding how to improve model generalizability during model development. However, models are always imperfect representations of systems and are constrained by the contextual frameworks used during their development. Thus, model users need better ways to evaluate the possibility of unintentional misapplication when transferring models to new sites. We propose a method of describing a model’s application niche for use during the model selection process. Using this method, model users synthesize information from databases, past studies, and/or past model transfers to create model performance curves and heat maps. We demonstrated this method using an empirical model developed to predict the ecological condition of plant communities in riverine wetlands of the Appalachian Highland physiographic region, USA. We assessed this model’s transferability and generalizability across (1) riverine wetlands in the contiguous United States, (2) wetland types in the Appalachian Highland physiographic region, and (3) wetland types in the contiguous United States. With this methodology and a discussion of its critical steps, we set the stage for further inquiries into the development of consistent and transparent practices for model selection when transferring a model.