{"id":399,"date":"2023-08-09T15:56:59","date_gmt":"2023-08-09T19:56:59","guid":{"rendered":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/chapter\/question\/"},"modified":"2025-10-30T08:56:12","modified_gmt":"2025-10-30T12:56:12","slug":"question","status":"publish","type":"chapter","link":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/chapter\/question\/","title":{"raw":"Your research question?","rendered":"Your research question?"},"content":{"raw":"
\r\n
\r\n\r\nThe simplest model that can address your research question is the best model\r\n\r\n<\/div>\r\nSo you want to build an ecosystem model. It should be very capable, it should be able to address any policy, management, environmental, population dynamic or ecological question about the resources in your ecosystem. If so, it has to be complex, it has to be end-to-end, include everything important from nutrients over whales to how society works. Right?\r\n\r\nNo, that thinking leads to Frankenstein models, models that take on a life of their own where no-one really knows why they behave the way they do. Instead the rule is: the simplest model that can address a given question is the best model to use. Best, because it's the model with most predictive power[footnote]Walters, C.J. 1986. Adaptive Management of Renewable Resources. MacMillan<\/a>[\/footnote].\r\n\r\n<\/div>\r\n\"The\r\n\r\nFigure 1. Uncertainty about a policy parameters U (as expressed through its variance [latex]\\sigma _U^2[\/latex] is likely to be minimized at an intermediate complexity.[footnote]Modified from Walters. 1986. op. cit.[\/footnote]).\u00a0<\/strong>\r\n\r\nThat rule also holds for working with EwE. Don't spend years building a complex ecosystem model in order to address any question that may arise. Instead, close doors as you move ahead, build something simpler, as simple as you can get away with \u2013 you can always add details and see if it makes a difference. Make new doors when and where needed. The model building process is a continuum you may never finish, recognize that and focus your effort. Make it a simple as you can in order to address the one thing that should be your guiding star: What is your research question?\r\n
\r\n
\r\n\r\nDescriptive or predictive model? If descriptive you want to be inclusive, if predictive, be selective. See\u00a0Defining the ecosystem<\/a>.\r\n\r\n<\/div>\r\n<\/div>\r\nKeeping it simple has several advantages, faster development and run times are just part of the picture. Equally as important is that keeping it as simple as possible makes it much more realistic to develop alternative models to address the research question that guides the work. It also makes it easier for you, the modeller to grasp what your model is doing and why.\r\n
\r\n
\r\n\r\nModels are not like religion\r\n\u2013 you can have more than one\r\n\u2013 and you shouldn't believe them\r\n\r\n<\/div>\r\n<\/div>\r\nProponents of this principle have long advocated the use of Minimum Realistic Models[footnote]D. S. Butterworth, \u00c9. E. Plag\u00e1nyi. 2004. A brief introduction to some approaches to multispecies\/ecosystem modelling in the context of their possible application in the management of South African fisheries, African Journal of Marine Science<\/a>, 26:1, 53-61[\/footnote] and Models of Intermediate Complexity for Ecosystem assessments[footnote]Plag\u00e1nyi, \u00c9., Punt, A., Hillary, R., Morello, E., Thebaud, O., Hutton, T., Pillans, R., Thorson, J., Fulton, E.A., Smith, A.D.T., Smith, F., Bayliss, P., Haywood, M., Lyne, V., Rothlisberg, P. 2014. Multi-species fisheries management and conservation: tactical applications using models of intermediate complexity. Fish Fisheries 15:1-22. https:\/\/doi.org\/10.1111\/j.1467-2979.2012.00488.x<\/a>[\/footnote], and this is indeed an approach that can go hand-in-hand with EwE model development and application.\r\n\r\nPart of this is that models are not like religion, you can have more than one (and you shouldn't believe them). So, if you find that a model can answer your question, should you believe the answer? \u00a0No, evaluate how robust your findings are, don't take them at face value. Examine your model and explore what it takes to make the answer go away. That doesn't mean they are always wrong, but if you keep your model relatively simple, you can use alternative model formulation to explore the same or different questions. Consider and test if there are alternative hypotheses (and with it model formulations) that may be used to address the questions that drive your research.\r\n
\r\n
\r\n\r\nIf you are thinking of a management intervention, and you can't make it work in a simple model, what's the chance it may work in reality?\r\n\r\nKeith Sainsbury\r\n\r\n<\/div>\r\n<\/div>\r\nConsider where we would be with climate change, if the IPCC<\/a> had decided years ago to build one-model-that-rules-them-all to evaluate the mechanisms and impacts of climate change. We would still be arguing if what we are experiencing is climate change or natural variations. The approach that IPCC have taken by using an ensemble model approach represents the best way forward. IPBES<\/a> has picked it up, and are using an ensemble approach to evaluate among other the impact of climate on fisheries and marine ecosystem through the Fish-MIP<\/a> model intercomparison approach \u2013 of which EwE models are an integral part.\r\n\r\nThere may be an apparent conflict between keeping it as simple as possible and using an ensemble approach of perhaps more complex models, but that conflict is indeed only apparent.[footnote]J. Elder. Chapter 16 - The apparent paradox of complexity in ensemble modeling R. Nisbet, G. Miner, K. Yale (Eds.), Handbook of Statistical Analysis and Data Mining Applications (Second edition), Academic Press, Boston (2018), pp. 705-718, https:\/\/doi.org\/10.1016\/B978-0-12-416632-5.00016-5<\/a>[\/footnote]\r\n
\r\n
\r\n\r\nHolden et al.[footnote]Holden, M. H., Plag\u00e1nyi, E. E., Fulton, E. A., Campbell, A. B., Janes, R., Lovett, R. A., Wickens, M., Adams, M. P., Botelho, L. L., Dichmont, C. M., Erm, P., Helmstedt, K. J., Heneghan, R. F., Mendiolar, M., Richardson, A. J., Rogers, J. G. D., Saunders, K., & Timms, L. (2024). Cost\u2013benefit analysis of ecosystem modeling to support fisheries management. Journal of Fish Biology, 1\u20138. https:\/\/doi.org\/10.1111\/jfb.15741<\/a>[\/footnote] provides a cost-benefit analysis of ecosystem modelling to support fisheries management. As part of this they evaluate not just benefit but model costs as well for models ranging from single-species models to complex ecosystem models. They found that costs varied by two orders of magnitude with cost increasing with model complexity. There are trade-offs and no \"correct\" way or \"best\" model. What matters is what is needed to answer the research\/policy questions. That has to be defined from the very onset.\r\n\r\n<\/div>\r\n<\/div>","rendered":"
\n
\n

The simplest model that can address your research question is the best model<\/p>\n<\/div>\n

So you want to build an ecosystem model. It should be very capable, it should be able to address any policy, management, environmental, population dynamic or ecological question about the resources in your ecosystem. If so, it has to be complex, it has to be end-to-end, include everything important from nutrients over whales to how society works. Right?<\/p>\n

No, that thinking leads to Frankenstein models, models that take on a life of their own where no-one really knows why they behave the way they do. Instead the rule is: the simplest model that can address a given question is the best model to use. Best, because it’s the model with most predictive power[1]<\/sup><\/a>.<\/p>\n<\/div>\n

\"The<\/p>\n

Figure 1. Uncertainty about a policy parameters U (as expressed through its variance [latex]\\sigma _U^2[\/latex] is likely to be minimized at an intermediate complexity.[2]<\/sup><\/a>).\u00a0<\/strong><\/p>\n

That rule also holds for working with EwE. Don’t spend years building a complex ecosystem model in order to address any question that may arise. Instead, close doors as you move ahead, build something simpler, as simple as you can get away with \u2013 you can always add details and see if it makes a difference. Make new doors when and where needed. The model building process is a continuum you may never finish, recognize that and focus your effort. Make it a simple as you can in order to address the one thing that should be your guiding star: What is your research question?<\/p>\n

\n
\n

Descriptive or predictive model? If descriptive you want to be inclusive, if predictive, be selective. See\u00a0Defining the ecosystem<\/a>.<\/p>\n<\/div>\n<\/div>\n

Keeping it simple has several advantages, faster development and run times are just part of the picture. Equally as important is that keeping it as simple as possible makes it much more realistic to develop alternative models to address the research question that guides the work. It also makes it easier for you, the modeller to grasp what your model is doing and why.<\/p>\n

\n
\n

Models are not like religion
\n\u2013 you can have more than one
\n\u2013 and you shouldn’t believe them<\/p>\n<\/div>\n<\/div>\n

Proponents of this principle have long advocated the use of Minimum Realistic Models[3]<\/sup><\/a> and Models of Intermediate Complexity for Ecosystem assessments[4]<\/sup><\/a>, and this is indeed an approach that can go hand-in-hand with EwE model development and application.<\/p>\n

Part of this is that models are not like religion, you can have more than one (and you shouldn’t believe them). So, if you find that a model can answer your question, should you believe the answer? \u00a0No, evaluate how robust your findings are, don’t take them at face value. Examine your model and explore what it takes to make the answer go away. That doesn’t mean they are always wrong, but if you keep your model relatively simple, you can use alternative model formulation to explore the same or different questions. Consider and test if there are alternative hypotheses (and with it model formulations) that may be used to address the questions that drive your research.<\/p>\n

\n
\n

If you are thinking of a management intervention, and you can’t make it work in a simple model, what’s the chance it may work in reality?<\/p>\n

Keith Sainsbury<\/p>\n<\/div>\n<\/div>\n

Consider where we would be with climate change, if the IPCC<\/a> had decided years ago to build one-model-that-rules-them-all to evaluate the mechanisms and impacts of climate change. We would still be arguing if what we are experiencing is climate change or natural variations. The approach that IPCC have taken by using an ensemble model approach represents the best way forward. IPBES<\/a> has picked it up, and are using an ensemble approach to evaluate among other the impact of climate on fisheries and marine ecosystem through the Fish-MIP<\/a> model intercomparison approach \u2013 of which EwE models are an integral part.<\/p>\n

There may be an apparent conflict between keeping it as simple as possible and using an ensemble approach of perhaps more complex models, but that conflict is indeed only apparent.[5]<\/sup><\/a><\/p>\n

\n
\n

Holden et al.[6]<\/sup><\/a> provides a cost-benefit analysis of ecosystem modelling to support fisheries management. As part of this they evaluate not just benefit but model costs as well for models ranging from single-species models to complex ecosystem models. They found that costs varied by two orders of magnitude with cost increasing with model complexity. There are trade-offs and no “correct” way or “best” model. What matters is what is needed to answer the research\/policy questions. That has to be defined from the very onset.<\/p>\n<\/div>\n<\/div>\n

  1. Walters, C.J. 1986. Adaptive Management of Renewable Resources. MacMillan<\/a> ↵<\/a><\/li>
  2. Modified from Walters. 1986. op. cit. ↵<\/a><\/li>
  3. D. S. Butterworth, \u00c9. E. Plag\u00e1nyi. 2004. A brief introduction to some approaches to multispecies\/ecosystem modelling in the context of their possible application in the management of South African fisheries, African Journal of Marine Science<\/a>, 26:1, 53-61 ↵<\/a><\/li>
  4. Plag\u00e1nyi, \u00c9., Punt, A., Hillary, R., Morello, E., Thebaud, O., Hutton, T., Pillans, R., Thorson, J., Fulton, E.A., Smith, A.D.T., Smith, F., Bayliss, P., Haywood, M., Lyne, V., Rothlisberg, P. 2014. Multi-species fisheries management and conservation: tactical applications using models of intermediate complexity. Fish Fisheries 15:1-22. https:\/\/doi.org\/10.1111\/j.1467-2979.2012.00488.x<\/a> ↵<\/a><\/li>
  5. J. Elder. Chapter 16 - The apparent paradox of complexity in ensemble modeling R. Nisbet, G. Miner, K. Yale (Eds.), Handbook of Statistical Analysis and Data Mining Applications (Second edition), Academic Press, Boston (2018), pp. 705-718, https:\/\/doi.org\/10.1016\/B978-0-12-416632-5.00016-5<\/a> ↵<\/a><\/li>
  6. Holden, M. H., Plag\u00e1nyi, E. E., Fulton, E. A., Campbell, A. B., Janes, R., Lovett, R. A., Wickens, M., Adams, M. P., Botelho, L. L., Dichmont, C. M., Erm, P., Helmstedt, K. J., Heneghan, R. F., Mendiolar, M., Richardson, A. J., Rogers, J. G. D., Saunders, K., & Timms, L. (2024). Cost\u2013benefit analysis of ecosystem modeling to support fisheries management. Journal of Fish Biology, 1\u20138. https:\/\/doi.org\/10.1111\/jfb.15741<\/a> ↵<\/a><\/li><\/ol><\/div>","protected":false},"author":1909,"menu_order":6,"template":"","meta":{"pb_show_title":"on","pb_short_title":"","pb_subtitle":"","pb_authors":[],"pb_section_license":""},"chapter-type":[],"contributor":[],"license":[],"class_list":["post-399","chapter","type-chapter","status-publish","hentry"],"part":392,"_links":{"self":[{"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/pressbooks\/v2\/chapters\/399","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/pressbooks\/v2\/chapters"}],"about":[{"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/wp\/v2\/types\/chapter"}],"author":[{"embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/wp\/v2\/users\/1909"}],"version-history":[{"count":25,"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/pressbooks\/v2\/chapters\/399\/revisions"}],"predecessor-version":[{"id":4086,"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/pressbooks\/v2\/chapters\/399\/revisions\/4086"}],"part":[{"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/pressbooks\/v2\/parts\/392"}],"metadata":[{"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/pressbooks\/v2\/chapters\/399\/metadata\/"}],"wp:attachment":[{"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/wp\/v2\/media?parent=399"}],"wp:term":[{"taxonomy":"chapter-type","embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/pressbooks\/v2\/chapter-type?post=399"},{"taxonomy":"contributor","embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/wp\/v2\/contributor?post=399"},{"taxonomy":"license","embeddable":true,"href":"https:\/\/pressbooks.bccampus.ca\/ewemodel\/wp-json\/wp\/v2\/license?post=399"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}