34 Vulnerability multipliers: Discussion
Jacob Bentley; David Chagaris; Marta Coll; Sheila JJ Heymans; Natalia Serpetti; Carl J. Walters; and Villy Christensen
Limitations and future development
It is not enough to estimate vulnerability multipliers and assume those which produce the best statistical hindcast fit are appropriate. Ecological reasoning and hypothesis testing must support statistical inference as it should when balancing Ecopath models[1](Link 2015), estimating primary production anomalies[2] and incorporating environmental drivers.[3] Part of this process should include a critical evaluation of calibration time series, as these, and their associated uncertainty, drive the statistical estimation of vulnerability multipliers. Using data with inherent inconsistencies will lead to variable and potentially biased estimates. Equally important is the lack of missing reference time series. Time series produce constraints, and when estimating vulnerability multipliers for groups without time series the lack of constraints allows the fitting procedure to explore a broad parameter space to let such groups indirectly impact other groups with time series. All of the above, can impact model derived management advice.
As shown in the case studies in the previous chapters (#1, #2), FMSY estimates can change in response to estimated vulnerability multipliers and their impacts on predator consumption rates, albeit with most changes being relatively conservative[4]. With high vulnerability multiplier values, species are more sensitive to changes in F and are therefore capable of recovering faster in the absence of fishing pressure, meaning maximum sustainable yields are achieved at lower fishing pressures (Figure 1a). As predator consumption rates increase with higher vulnerability multiplier values, prey experience higher predation rates, reducing the yield that can be obtained by fishing at FMSY (Figure 1b). Unreliable vulnerability multipliers are not easily apparent when reviewing model hindcast simulations against calibration time series data. Comparing Ecosim FMSY to other estimates, or proxies (e.g., natural mortality), is one approach to assess vulnerability multipliers and has been demonstrated for the ICES key-run models of the North Sea[5] and Irish Sea[6]. Simulating models beyond observations, under alternate fishing or environmental scenarios, can also highlight issues with vulnerability multipliers by exploring group sensitivities and whether simulated responses to change falls outside of what might be considered ecologically reasonable. Future developments should also consider dependencies between vulnerability multipliers, whether correlation exists between vulnerability multipliers, and how this may impact the ability of a search routine to find stable solutions.
Figure 1. Effects of vulnerability multipliers on derived sustainable fishing advice. Estimations of fishing mortality at which MSY is achieved (FMSY). Based on Walters et al., 2005.[7]
For EwE models to be of operational use, it should be possible to explain why estimated vulnerability multipliers are realistic. This could be based on knowledge of species’ ecology, carrying capacity, or natural mortality. We envisage that the future development of Ecosim will encourage users to think more critically when calibrating models by building options to restrict the statistical vulnerability optimisation routine. The objective of this would be to enable users to constrain vulnerability multiplier estimation using a priori knowledge where, importantly, data is available to justify doing so. Increased control over the search for vulnerability multipliers could be used to set upper and lower parameter limits, or limits determined by carrying capacity, and penalise parameter combinations which operate outside of predefined limits.
Such constraints would also have important implications for Ecospace: the spatial-temporal component of EwE. High vulnerability multipliers, and the large increases in predation mortality which they enable, can have disproportionately large impacts in Ecospace when prey are restricted to small areas (as predators are able to deplete them rapidly). Vulnerability multipliers in Ecospace require further consideration given how spatial heterogeneity may impact species physiology, habitat carrying capacity, and predator-prey interaction rates. Spatial considerations are implicit within the vulnerability concept and enable spatial considerations to be integrated indirectly into Ecosim. The necessity for vulnerability multipliers, or at least those in Ecosim which go some way to indirectly recognising spatial heterogeneity, may be negated by the explicit consideration of spatial heterogeneity in Ecospace. Alternate vulnerability multiplier combinations may be needed depending on the priority use of Ecosim or Ecospace and the different mechanistic role vulnerability multipliers may play across the two components.
Recommendations
Calibration methods for EwE are not prescriptive. Any one of the methods included in Figure 2 of the Vulnerability and vulnerability multipliers chapter, or new methods, may be suitable for use if they can be justified. That said, the first case study showed that predator vulnerability multipliers are more likely to re-emerge than predator-prey vulnerability multipliers, and that re-emergence is impacted by data quality. Below we provide best practice recommendations to evaluate the appropriateness of vulnerability multipliers and their impact on model uncertainty:
- Recommendation 1: Limit the number of vulnerability multipliers to be estimated. The most efficient way to limit the number of parameters is to estimate by predator, add individual predator-prey combinations if you have specific arguments for why this is necessary. Avoid estimating vulnerabilities for groups without time series as the lack of constraints can lead to unrealistic estimates.
- Recommendation 2: Explain vulnerability multipliers. Provide justifications for setting initial vulnerability multipliers (or keeping the default). If estimating vulnerability multipliers using a statistical routine, check if they make sense relative to the exploitation and ecology of the predator and the ecology of the predator-prey interaction.
- Recommendation 3: Sense check carrying capacities. Vulnerability multipliers augment the upper limit for predator consumption rates, which dictates how predators respond to changes in mortality rates (e.g., release from fishing pressure or predation) or in prey biomass. It is important to review how predator biomass responds to such changes and critically evaluate whether the changes are plausible and whether the limits of estimates should be constrained (i.e., setting upper and lower limits).
- Recommendation 4: Look beyond goodness of fit when evaluating model performance. Combinations of vulnerability multipliers that achieve the best statistical fit (i.e., SS and AICc) do not necessarily produce the “best” model, if other model outputs, such as indicators, FMSY reference points, and forward projections, are unlikely. Assessment of wider model performance should be undertaken to review vulnerability multipliers.
- Recommendation 5: Perform vulnerability multiplier sensitivity analyses. It is best practice to acknowledge and communicate model uncertainty. Calibrating Ecosim models, and thereby choosing one of multiple approaches to estimate vulnerability multipliers, introduces additional uncertainty into the process. Exploring model performance under alternate calibration approaches tests the sensitivity of model outputs to changes in vulnerability multipliers and identifies which vulnerability multipliers consistently emerge.
“
Media Attributions
- Calibrating Ecosystem Models figure by Jacob Bentley
- From Bentley et al. 2024. Figure 9
- Link, J.S. 2010. Adding Rigor to Ecological Network Models by Evaluating a Set of Pre-balance Diagnostics: A Plea for PREBAL. Ecol. Model. 221:1582-1593. 10.1016/j.ecolmodel.2010.03.012, ↵
- e.g., Serpetti N, Baudron AR, Burrows M, Payne BL, Helaouët P, Fernandes PG, Heymans J (2017) Impact of ocean warming on sustainable fisheries management informs the Ecosystem Approach to Fisheries. Scientific Reports 7:13438 https://doi.org/10.1038/s41598-017-13220-7 ↵
- e.g., Mackinson S. 2014. Combined analyses reveal environmentally driven changes in the North Sea ecosystem and raise questions regarding what makes an ecosystem model’s performance credible? CJFAS. https://doi.org/10.1139/cjfas-2013-0173) ↵
- See Supplemental Figure 3 in Bentley et al. 2024 ↵
- ICES. 2016. Report of the Working Group on Multispecies Assessment Methods (WGSAM), 9–13 November 2015, Woods Hole, USA. ICES CM 2015/SSGEPI:20. 206pp. ↵
- ICES. 2019b. Working group on multispecies assessment methods (WGSAM). ICES Scientific Reports. 1:320. Doi: 10.17895/ices.pub.5758 ↵
- Walters CJ, Christensen V, Martell SJ, Kitchell JF. 2005. Possible ecosystem impacts of applying MSY policies from single-species assessment. ICES Journal of Marine Science 62:558 - 568. https://doi.org/10.1016/j.icesjms.2004.12.005 ↵
