{"id":1060,"date":"2023-09-30T16:49:07","date_gmt":"2023-09-30T20:49:07","guid":{"rendered":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/?post_type=chapter&#038;p=1060"},"modified":"2025-10-30T08:57:30","modified_gmt":"2025-10-30T12:57:30","slug":"management-strategy-evaluation","status":"publish","type":"chapter","link":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/chapter\/management-strategy-evaluation\/","title":{"raw":"Management strategy evaluation","rendered":"Management strategy evaluation"},"content":{"raw":"Management strategy evaluation (MSE) is concerned with evaluating uncertainty about the impact of applying alternative formal rules for varying fisheries over time, given uncertainty about ecosystem dynamics (as represented by key Ecopath and Ecosim parameters) and about biomass states over time due to stock assessment errors. The main tool in EwE for simulating such uncertainties and rules is the \u201cCEFAS MSE plug-in\u201d <em>(Tools &gt; Cefas MSE<\/em>) developed by Mackinson and colleagues.[footnote]Mackinson S, Platts M, Garcia C, Lynam C (2018) Evaluating the fishery and ecological consequences of the proposed North Sea multi- annual plan. PLoS ONE 13(1): e0190015. <a href=\"https:\/\/ doi.org\/10.1371\/journal.pone.0190015\">https:\/\/ doi.org\/10.1371\/journal.pone.0190015<\/a>[\/footnote]\r\n\r\nThe CEFAS plugin provides a way to represent uncertainty by doing multiple simulation scenarios with different parameter values, while comparing various management performance measures across these simulations for alternative harvest management decision rules. The decision rules included in the plug-in were developed in response to questions raised about multi-species management strategies in the ICES (North Sea) management area, but broadly represent harvest management decision rule options for most highly managed areas in the world.\r\n<div class=\"textbox shaded\">The CEFAS MSE works with output control: quotas. There is an older module that also uses quota limits, but with limited ability to limit quotas based on rigid species quota allocations by fleet and simple \"weakest stock\" or \"most profitable\" quota constraints It is possible to use input control with the alternative EwE MSE procedure based on linear programming optimization. See the <a href=\"https:\/\/pressbooks.bccampus.ca\/eweguide\/chapter\/mse-constrained-optimization-of-fishing-effort\/\">MSE Constrained Optimization of Fishing Effort<\/a>\u00a0chapter.<\/div>\r\n<span style=\"text-align: initial;font-size: 14pt\">Management decision rules are represented by several main components:<\/span>\r\n<ol>\r\n \t<li>So-called \u201charvest control rules\u201d (HCRs, see Figure 1) representing desired patterns of variation in total fishing mortality rate for target species as a function of species biomass (comparisons of such HCRs is a central concern in single-species management strategy evaluation).<\/li>\r\n \t<li>Imposition of alternative rules for discarding, e.g. forbidding discarding may effectively cause \u201cweakest stock\u201d management by not allowing fishing fleets to avoid harvest limits by discarding catches of weaker stocks), or allowing highest value management by seeking fleet operations that will maximize total profit despite discarding impacts, or assuming ability of fleets to do \u201cselective fishing\u201d of only valued target species.<\/li>\r\n \t<li>Limits on total fishing effort by fleets and on year-to-year allowable changes in fishing effort.<\/li>\r\n<\/ol>\r\nQuite complex calculations are done at each simulation time step in order to meet (or not) the constraints implied by the single-species HCRs. For details, see the supporting information from Mackinson et al.[footnote]Mackinson et al. (2018) S1 Supporting Information. Technical methods of the uncertainty and MSE routine. <a href=\"https:\/\/doi.org\/10.1371\/journal.pone.0190015.s001\">https:\/\/doi.org\/10.1371\/journal.pone.0190015.s001<\/a>[\/footnote]\r\n\r\n<img class=\"wp-image-3543 size-full aligncenter\" src=\"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-content\/uploads\/sites\/1902\/2023\/09\/Mackinson-et-al-2018-figure-4-e1714686657919.png\" alt=\"\" width=\"800\" height=\"508\" \/>\r\n\r\n<strong>Figure 1. Examples of harvest control rules (HCRs) used for management strategy evaluation.<\/strong> <strong>Type 1 is the \"ICES standard\" advice rule where F declines linearly to zero when biomass is below <em>MSY B<sub>trigger<\/sub><\/em>. Type 2 is \"Precautionary\", easing the rate of reduction in <em>F<\/em> between <em>MSY B<sub>trigger<\/sub><\/em> and <em>B<sub>lim<\/sub><\/em>. Type 3 is the most \"Protective\", applying the most severe reductions in <em>F<\/em>, which declines linearly from <em>F<sub>msy<\/sub><\/em> at <em>MSY B<sub>trigger<\/sub><\/em> to zero at <em>B<sub>lim<\/sub><\/em> . Type 4 is considered the most \"Realistic\", similar to Precautionary, but recognizes that a small level of residual non-target by-catch mortality may remain on a stock at <em>B <\/em>\u2264 <em>B<\/em><sub>lim<\/sub>. From Mackinson et al. (<em>op. cit., <\/em>Figure 4).<\/strong>\r\n\r\nA key part of management strategy evaluation is to determine the effect on management performance of errors in biomass estimates due to random survey variation and to cumulative errors caused by stock assessment procedures. For multispecies models, it is not practical to simulate the complex data gathering and assessment model fitting procedures that are used to obtain biomass estimates for more valuable species. Instead, the plug-in uses an observation by Walters[footnote]Walters C. 2004. Simple representation of the dynamics of biomass error propagation for stock assessment models. CJFAS 61(7):1061-1065. <a href=\"https:\/\/doi.org\/10.1139\/f04-120\">https:\/\/doi.org\/10.1139\/f04-120<\/a>[\/footnote] that errors in biomass estimates from common stock assessment methods (virtual population analysis, statistical catch at age analysis or stock synthesis models) propagate over time in a relatively simple pattern that can be modelled by a statistical filtering equation. The equation predicts that even single large survey errors can cause errors in stock assessments (impacts on estimates from assessments) that propagate over several years so as to possibly have large cumulative impacts on over- and\/or under-harvesting.\r\n\r\n<img class=\"wp-image-3531 size-full alignright\" src=\"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-content\/uploads\/sites\/1902\/2023\/09\/Mackinson-et-al-2018-figure-1-e1714170767821.png\" alt=\"\" width=\"400\" height=\"446\" \/>\r\n\r\n<strong>Figure 2. Flowchart indicating how the CEFAS MSE plug-in first creates a (large) number of possible EwE models (drawn randomly) then continues to the management strategy evaluation (Figure 3). From Mackinson et al. (<em>op. cit.,<\/em> Figure 1)<\/strong>\r\n\r\nThe CEFAS MSE plug-in approach has two stages. First it creates a number of plausible EwE (Ecopath) models by sampling distributions of input parameters (biomass, feeding, production and consumption rates and predator-prey interaction rates) (Figure 2). Next, it simulates the effect of alternative management strategies defined by their HCR and regulatory mechanisms (Figure 3).\r\n\r\nFor guidance of how to use the CEFAS MSE plug-in, most notably see the paper by Mackinson et al. (<em>op. cit.<\/em>), the chapter about the CEFAS MSE in the EwE <a href=\"https:\/\/pressbooks.bccampus.ca\/eweguide\/chapter\/mse\/\">User Guide<\/a> based on the supplementary materials from Mackinson et al. (op. cit.) as well as the <a href=\"https:\/\/pressbooks.bccampus.ca\/ewemodel\/chapter\/tutorial-management-strategy-evaluation-cefas-plug-in\/\">tutorial following this<\/a> (web and pdf versions only).\r\n\r\n<img class=\"alignnone wp-image-3534 size-full\" src=\"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-content\/uploads\/sites\/1902\/2023\/09\/Mackinson-et-al-2018-figure-2-e1714686690219.png\" alt=\"\" width=\"1000\" height=\"929\" \/>\r\n\r\n<strong>Figure 2. Flowchart for evaluation of alternative management strategies. From Mackinson et al. (<em>op. cit.,<\/em> Figure 2).<\/strong>\r\n\r\n&nbsp;","rendered":"<p>Management strategy evaluation (MSE) is concerned with evaluating uncertainty about the impact of applying alternative formal rules for varying fisheries over time, given uncertainty about ecosystem dynamics (as represented by key Ecopath and Ecosim parameters) and about biomass states over time due to stock assessment errors. The main tool in EwE for simulating such uncertainties and rules is the \u201cCEFAS MSE plug-in\u201d <em>(Tools &gt; Cefas MSE<\/em>) developed by Mackinson and colleagues.<a class=\"footnote\" title=\"Mackinson S, Platts M, Garcia C, Lynam C (2018) Evaluating the fishery and ecological consequences of the proposed North Sea multi- annual plan. PLoS ONE 13(1): e0190015. https:\/\/ doi.org\/10.1371\/journal.pone.0190015\" id=\"return-footnote-1060-1\" href=\"#footnote-1060-1\" aria-label=\"Footnote 1\"><sup class=\"footnote\">[1]<\/sup><\/a><\/p>\n<p>The CEFAS plugin provides a way to represent uncertainty by doing multiple simulation scenarios with different parameter values, while comparing various management performance measures across these simulations for alternative harvest management decision rules. The decision rules included in the plug-in were developed in response to questions raised about multi-species management strategies in the ICES (North Sea) management area, but broadly represent harvest management decision rule options for most highly managed areas in the world.<\/p>\n<div class=\"textbox shaded\">The CEFAS MSE works with output control: quotas. There is an older module that also uses quota limits, but with limited ability to limit quotas based on rigid species quota allocations by fleet and simple &#8220;weakest stock&#8221; or &#8220;most profitable&#8221; quota constraints It is possible to use input control with the alternative EwE MSE procedure based on linear programming optimization. See the <a href=\"https:\/\/pressbooks.bccampus.ca\/eweguide\/chapter\/mse-constrained-optimization-of-fishing-effort\/\">MSE Constrained Optimization of Fishing Effort<\/a>\u00a0chapter.<\/div>\n<p><span style=\"text-align: initial;font-size: 14pt\">Management decision rules are represented by several main components:<\/span><\/p>\n<ol>\n<li>So-called \u201charvest control rules\u201d (HCRs, see Figure 1) representing desired patterns of variation in total fishing mortality rate for target species as a function of species biomass (comparisons of such HCRs is a central concern in single-species management strategy evaluation).<\/li>\n<li>Imposition of alternative rules for discarding, e.g. forbidding discarding may effectively cause \u201cweakest stock\u201d management by not allowing fishing fleets to avoid harvest limits by discarding catches of weaker stocks), or allowing highest value management by seeking fleet operations that will maximize total profit despite discarding impacts, or assuming ability of fleets to do \u201cselective fishing\u201d of only valued target species.<\/li>\n<li>Limits on total fishing effort by fleets and on year-to-year allowable changes in fishing effort.<\/li>\n<\/ol>\n<p>Quite complex calculations are done at each simulation time step in order to meet (or not) the constraints implied by the single-species HCRs. For details, see the supporting information from Mackinson et al.<a class=\"footnote\" title=\"Mackinson et al. (2018) S1 Supporting Information. Technical methods of the uncertainty and MSE routine. https:\/\/doi.org\/10.1371\/journal.pone.0190015.s001\" id=\"return-footnote-1060-2\" href=\"#footnote-1060-2\" aria-label=\"Footnote 2\"><sup class=\"footnote\">[2]<\/sup><\/a><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-3543 size-full aligncenter\" src=\"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-content\/uploads\/sites\/1902\/2023\/09\/Mackinson-et-al-2018-figure-4-e1714686657919.png\" alt=\"\" width=\"800\" height=\"508\" \/><\/p>\n<p><strong>Figure 1. Examples of harvest control rules (HCRs) used for management strategy evaluation.<\/strong> <strong>Type 1 is the &#8220;ICES standard&#8221; advice rule where F declines linearly to zero when biomass is below <em>MSY B<sub>trigger<\/sub><\/em>. Type 2 is &#8220;Precautionary&#8221;, easing the rate of reduction in <em>F<\/em> between <em>MSY B<sub>trigger<\/sub><\/em> and <em>B<sub>lim<\/sub><\/em>. Type 3 is the most &#8220;Protective&#8221;, applying the most severe reductions in <em>F<\/em>, which declines linearly from <em>F<sub>msy<\/sub><\/em> at <em>MSY B<sub>trigger<\/sub><\/em> to zero at <em>B<sub>lim<\/sub><\/em> . Type 4 is considered the most &#8220;Realistic&#8221;, similar to Precautionary, but recognizes that a small level of residual non-target by-catch mortality may remain on a stock at <em>B <\/em>\u2264 <em>B<\/em><sub>lim<\/sub>. From Mackinson et al. (<em>op. cit., <\/em>Figure 4).<\/strong><\/p>\n<p>A key part of management strategy evaluation is to determine the effect on management performance of errors in biomass estimates due to random survey variation and to cumulative errors caused by stock assessment procedures. For multispecies models, it is not practical to simulate the complex data gathering and assessment model fitting procedures that are used to obtain biomass estimates for more valuable species. Instead, the plug-in uses an observation by Walters<a class=\"footnote\" title=\"Walters C. 2004. Simple representation of the dynamics of biomass error propagation for stock assessment models. CJFAS 61(7):1061-1065. https:\/\/doi.org\/10.1139\/f04-120\" id=\"return-footnote-1060-3\" href=\"#footnote-1060-3\" aria-label=\"Footnote 3\"><sup class=\"footnote\">[3]<\/sup><\/a> that errors in biomass estimates from common stock assessment methods (virtual population analysis, statistical catch at age analysis or stock synthesis models) propagate over time in a relatively simple pattern that can be modelled by a statistical filtering equation. The equation predicts that even single large survey errors can cause errors in stock assessments (impacts on estimates from assessments) that propagate over several years so as to possibly have large cumulative impacts on over- and\/or under-harvesting.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-3531 size-full alignright\" src=\"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-content\/uploads\/sites\/1902\/2023\/09\/Mackinson-et-al-2018-figure-1-e1714170767821.png\" alt=\"\" width=\"400\" height=\"446\" \/><\/p>\n<p><strong>Figure 2. Flowchart indicating how the CEFAS MSE plug-in first creates a (large) number of possible EwE models (drawn randomly) then continues to the management strategy evaluation (Figure 3). From Mackinson et al. (<em>op. cit.,<\/em> Figure 1)<\/strong><\/p>\n<p>The CEFAS MSE plug-in approach has two stages. First it creates a number of plausible EwE (Ecopath) models by sampling distributions of input parameters (biomass, feeding, production and consumption rates and predator-prey interaction rates) (Figure 2). Next, it simulates the effect of alternative management strategies defined by their HCR and regulatory mechanisms (Figure 3).<\/p>\n<p>For guidance of how to use the CEFAS MSE plug-in, most notably see the paper by Mackinson et al. (<em>op. cit.<\/em>), the chapter about the CEFAS MSE in the EwE <a href=\"https:\/\/pressbooks.bccampus.ca\/eweguide\/chapter\/mse\/\">User Guide<\/a> based on the supplementary materials from Mackinson et al. (op. cit.) as well as the <a href=\"https:\/\/pressbooks.bccampus.ca\/ewemodel\/chapter\/tutorial-management-strategy-evaluation-cefas-plug-in\/\">tutorial following this<\/a> (web and pdf versions only).<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-3534 size-full\" src=\"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-content\/uploads\/sites\/1902\/2023\/09\/Mackinson-et-al-2018-figure-2-e1714686690219.png\" alt=\"\" width=\"1000\" height=\"929\" \/><\/p>\n<p><strong>Figure 2. Flowchart for evaluation of alternative management strategies. From Mackinson et al. (<em>op. cit.,<\/em> Figure 2).<\/strong><\/p>\n<p>&nbsp;<\/p>\n<hr class=\"before-footnotes clear\" \/><div class=\"footnotes\"><ol><li id=\"footnote-1060-1\">Mackinson S, Platts M, Garcia C, Lynam C (2018) Evaluating the fishery and ecological consequences of the proposed North Sea multi- annual plan. PLoS ONE 13(1): e0190015. <a href=\"https:\/\/ doi.org\/10.1371\/journal.pone.0190015\">https:\/\/ doi.org\/10.1371\/journal.pone.0190015<\/a> <a href=\"#return-footnote-1060-1\" class=\"return-footnote\" aria-label=\"Return to footnote 1\">&crarr;<\/a><\/li><li id=\"footnote-1060-2\">Mackinson et al. (2018) S1 Supporting Information. Technical methods of the uncertainty and MSE routine. <a href=\"https:\/\/doi.org\/10.1371\/journal.pone.0190015.s001\">https:\/\/doi.org\/10.1371\/journal.pone.0190015.s001<\/a> <a href=\"#return-footnote-1060-2\" class=\"return-footnote\" aria-label=\"Return to footnote 2\">&crarr;<\/a><\/li><li id=\"footnote-1060-3\">Walters C. 2004. Simple representation of the dynamics of biomass error propagation for stock assessment models. CJFAS 61(7):1061-1065. <a href=\"https:\/\/doi.org\/10.1139\/f04-120\">https:\/\/doi.org\/10.1139\/f04-120<\/a> <a href=\"#return-footnote-1060-3\" class=\"return-footnote\" aria-label=\"Return to footnote 3\">&crarr;<\/a><\/li><\/ol><\/div>","protected":false},"author":1909,"menu_order":3,"template":"","meta":{"pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"class_list":["post-1060","chapter","type-chapter","status-publish","hentry"],"part":1088,"_links":{"self":[{"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/pressbooks\/v2\/chapters\/1060","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/wp\/v2\/users\/1909"}],"version-history":[{"count":19,"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/pressbooks\/v2\/chapters\/1060\/revisions"}],"predecessor-version":[{"id":3647,"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/pressbooks\/v2\/chapters\/1060\/revisions\/3647"}],"part":[{"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/pressbooks\/v2\/parts\/1088"}],"metadata":[{"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/pressbooks\/v2\/chapters\/1060\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/wp\/v2\/media?parent=1060"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/pressbooks\/v2\/chapter-type?post=1060"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/wp\/v2\/contributor?post=1060"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/wp\/v2\/license?post=1060"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}