Williams, John-Philip (2024) A simulation-based comparison of confidence interval coverage, bias, and variance of alternative spatial biomass estimation methods used for the evaluation of Northern Shrimp biomass. Masters thesis, Concordia University.
Preview |
Text (application/pdf)
2MBWilliams_MSc_S2024.pdf - Accepted Version Available under License Spectrum Terms of Access. |
Abstract
In fisheries management, reliable estimates of population abundance metrics such as standing biomass are crucial for sustainability and balanced decision-making. The OGive MAPping (OGMAP) method, used by the Department of Fisheries and Oceans (DFO) in Newfoundland and Labrador for biomass estimation, addresses non-normally distributed populations but raises concerns about handling spatial data variations. I conducted a simulation-based comparative analysis comparing OGMAP against Generalized Additive Models (GAMs) and STRAtified Programs (STRAP) to answer the following question: “are the uncertainties of the estimates calculated from these different methods reliable?”
Using Northern Shrimp, Pandalus borealis, as a reference, I simulated biomass landscapes, exploring parameters like landscape roughness, sampling intensity, and model settings. The analysis consistently showed OGMAP's failure to capture nominal confidence intervals (CIs) compared to alternatives, regardless of the treatment. OGMAP exhibited tighter intervals, raising concerns about overfitting and its inability to reflect the true landscape biomass. However, halving the automatically optimized bandwidths for OGMAP's probability distribution fields significantly improved its realized coverage.
These findings underscore OGMAP's variability, shedding light on its limitations in decision-making by the Department of Fisheries and Oceans. I stress the pivotal role of reliable estimates in fisheries management. Additionally, I suggest that alternative methods, like GAMs, may offer more dependable forecasts given OGMAP's underperformance. This research prompts a review of the fisheries management framework relying on OGMAP, suggesting potential inadequacies in capturing the true uncertainty associated with spatially distributed stocks.
| Divisions: | Concordia University > Faculty of Arts and Science > Biology |
|---|---|
| Item Type: | Thesis (Masters) |
| Authors: | Williams, John-Philip |
| Institution: | Concordia University |
| Degree Name: | M.A. Sc. |
| Program: | Biology |
| Date: | January 2024 |
| Thesis Supervisor(s): | Pedersen, Eric |
| Keywords: | GAM (Generalized Additive Model) STRAP (Spatial-Temporal Regression and Prediction) Biomass estimation Shrimp populations Fisheries management OGMAP method Spatial modeling Confidence intervals Sustainable exploitation Total Allowable Catch (TAC) Fisheries science Accuracy in estimates Model uncertainty |
| ID Code: | 993390 |
| Deposited By: | John-Philip Williams |
| Deposited On: | 04 Jun 2024 14:29 |
| Last Modified: | 04 Jun 2024 14:29 |
References:
Altman, D. G. (2005). Why we need confidence intervals. World Journal of Surgery, 29(5), 554–556. https://doi.org/10.1007/s00268-005-7911-0Anderson, R. P. (2017). When and how should biotic interactions be considered in models of species niches and distributions? Journal of Biogeography, 44(1), 8–17. https://doi.org/10.1111/jbi.12825
Bavington, D. (2011). Managed Annihilation: An Unnatural History of the Newfoundland Cod Collapse. UBC Press.
Benoît, H. P., & Allard, J. (2020). The dependability of fishery monitoring programs: Harmonising the quality of estimates with the risks to the conservation of aquatic populations. DFO.
Berkson, J. M., Kline, L. L., Orth, D. J., & American Fisheries Society (Eds.). (2002). Incorporating uncertainty into fishery models: Proceedings of the Workshop Incorporating Uncertainty into Fishery Models held at Jekyll Island, Georgia, USA, 28-29 June 1999. American Fisheries Society.
Bishara, A. J., & Hittner, J. B. (2015). Reducing Bias and Error in the Correlation Coefficient Due to Nonnormality. Educational and Psychological Measurement, 75(5), 785–804. https://doi.org/10.1177/0013164414557639
Chadwick, E., Brodie, W., Colbourne, E., Clark, D., Gascon, D., & Hurlbut, T. (2007). History of Annual Multi-Species Trawl Surveys on the Atlantic Coast of Canada. AZMP Bull., 6.
Charles, A. T. (1994). Towards sustainability: The fishery experience. Ecological Economics, 11(3), 201–211. https://doi.org/10.1016/0921-8009(94)90201-1
Charles, A. T. (1998). Living with uncertainty in fisheries: Analytical methods, management priorities and the Canadian groundfishery experience. Fisheries Research, 37(1), 37–50. https://doi.org/10.1016/S0165-7836(98)00125-8
Colbourne, E., Holden, J., Senciall, D., Bailey, W., Snook, S., & Higdon, J. (2016). Physical Oceanographic Conditions on the Newfoundland and Labrador Shelf during 2015.
Dodge, Y. (2003). The Oxford Dictionary of Statistical Terms. Oxford University Press.
Duffy, J. E. (2010). Crustacean Social Evolution. In M. D. Breed & J. Moore (Eds.), Encyclopedia of Animal Behavior (pp. 421–429). Academic Press. https://doi.org/10.1016/B978-0-08-045337-8.00350-8
Evans, G. T., Parsons, D. G., Veitch, P. J., & Orr, D. C. (2000). A Local-influence Method of Estimating Biomass from Trawl Surveys, with Monte Carlo Confidence Intervals. Journal of Northwest Atlantic Fishery Science, 27, 133–138. https://doi.org/10.2960/J.v27.a12
Fisheries and Oceans Canada. (2006). A harvest strategy compliant with the precautionary approach (Can. Sci. Advis. Sec. Sci. Advis. Rep. 2006/023). https://waves-vagues.dfo-mpo.gc.ca/library-bibliotheque/322464.pdf
Fisheries and Oceans Canada. (2017). An assessment of Northern Shrimp (Pandalus borealis) in Shrimp Fishing Areas 4-6 in 2017 (Can. Sci. Advis. Sec. Sci. Advis. Rep. 2018/018).
Fisheries and Oceans Canada. (2018). Northern shrimp and striped shrimp – Shrimp fishing areas 0, 1, 4-7, the Eastern and Western Assessment Zones and North Atlantic Fisheries Organization (NAFO) Division 3M (Integrated Fisheries Management Plans 2018). https://www.dfo-mpo.gc.ca/fisheries-peches/ifmp-gmp/shrimp-crevette/shrimp-crevette-2018-002-eng.html
Fisheries and Oceans Canada. (2019). An Assessment of Northern Shrimp (Pandalus borealis) in Shrimp Fishing Areas 4-6 in 2019 (Can. Sci. Advis. Sec. Sci. Advis. Rep. 2021/010).
Fisheries and Oceans Canada. (2023). Assessment of Northern Shrimp (Pandalus borealis) in Shrimp Fishing Areas 4-6 in 2021 (Can. Sci. Advis. Sec. Sci. Advis. Rep. 2023/038).
Fournier, A., Fussell, D., & Carpenter, L. (1982). Computer rendering of stochastic models. Communications of the ACM, 25(6), 371–384. https://doi.org/10.1145/358523.358553
Geoffrey Evans. (Unpublished). Ogive mapping.
Hansen, N., & Ostermeier, A. (1996). Adapting arbitrary normal mutation distributions in evolution strategies: The covariance matrix adaptation. 312–317. https://doi.org/10.1109/ICEC.1996.542381
Hastie, T., & Tibshirani, R. (1986). Generalized Additive Models. Statistical Science, 1(3), 297–310. https://doi.org/10.1214/ss/1177013604
Healey, B., McKenzie, C. H., & Boyd, S. (2019). Proceedings of the Regional Peer Review for the Assessment of Northern Shrimp in Shrimp Fishing Areas (SFAs) 4, 5 and 6.
Hilborn, R. (1987). Living with Uncertainty in Resource Management. North American Journal of Fisheries Management, 7(1), 1–5. https://doi.org/10.1577/1548-8659(1987)7<1:LWUIRM>2.0.CO;2
Hua, C., Zhu, Q., Shi, Y., & Liu, Y. (2019). Comparative analysis of CPUE standardization of Chinese Pacific saury (Cololabis saira) fishery based on GLM and GAM. Acta Oceanologica Sinica, 38(10), 100–110. https://doi.org/10.1007/s13131-019-1486-3
Hutchings, J. A., & Rangeley, R. W. (2011). Correlates of recovery for Canadian Atlantic cod (Gadus morhua). Canadian Journal of Zoology, 89(5), 386–400. https://doi.org/10.1139/z11-022
Jacques Allard & Hugues P. Benoît. (2019). Unified framework for the statistical assessment of fishery monitoring programs. DFO.
Kilduff, P., Carmichael, J., Latour, R., & Berger, T. L. (2009). Guide to Fisheries Science and Stock Assessments. Atlantic States Marine Fisheries Commission, 74.
Lilly, G. R., Parsons, D. G., & Kulka, D. W. (2000). Was the Increase in Shrimp Biomass on the Northeast Newfoundland Shelf a Consequence of a Release in Predation Pressure from Cod? Journal of Northwest Atlantic Fishery Science, 27, 45–61. https://doi.org/10.2960/J.v27.a5
Lucet, V., & Pedersen, E. J. (2023). The sspm R package for spatially-explicit surplus production population models. Journal of Open Source Software, 8(86), 4724. https://doi.org/10.21105/joss.04724
Magnusson, A., & Hilborn, R. (2007). What makes fisheries data informative? Fish and Fisheries, 8(4), 337–358. https://doi.org/10.1111/j.1467-2979.2007.00258.x
Mangel, M., & Clark, C. W. (1983). Uncertainty, search, and information in fisheries. ICES Journal of Marine Science, 41(1), 93–103. https://doi.org/10.1093/icesjms/41.1.93
Martinet, V., Peña-Torres, J., De Lara, M., & Ramírez C., H. (2016). Risk and Sustainability: Assessing Fishery Management Strategies. Environmental and Resource Economics, 64(4), 683–707. https://doi.org/10.1007/s10640-015-9894-0
Miller, G. S. P. (1986). The definition and rendering of terrain maps. ACM SIGGRAPH Computer Graphics, 20(4), 39–48. https://doi.org/10.1145/15886.15890
Orr, D. C. (2004). OGive MAPping (ogmap) as an Alternative Means of Estimating Indices and Setting TACs. DFO, 20.
Palomares, M. L. D., Froese, R., Derrick, B., Meeuwig, J. J., Nöel, S.-L., Tsui, G., Woroniak, J., Zeller, D., & Pauly, D. (2020). Fishery biomass trends of exploited fish populations in marine ecoregions, climatic zones and ocean basins. Estuarine, Coastal and Shelf Science, 243, 106896. https://doi.org/10.1016/j.ecss.2020.106896
Patterson, K., Cook, R., Darby, C., Gavaris, S., Kell, L., Lewy, P., Mesnil, B., Punt, A., Restrepo, V., Skagen, D. W., & Stefánsson, G. (2001). Estimating uncertainty in fish stock assessment and forecasting. Fish and Fisheries, 2(2), 125–157. https://doi.org/10.1046/j.1467-2960.2001.00042.x
Pedersen, E. J., Koen-Alonso, M., & Tunney, T. D. (2020). Detecting regime shifts in communities using estimated rates of change. ICES Journal of Marine Science, 77(4), 1546–1555. https://doi.org/10.1093/icesjms/fsaa056
Pedersen, E. J., Skanes, K., Corre, N. L., Alonso, M. K., & Baker, K. D. (2022). A New Spatial Ecosystem-Based Surplus Production Model for Northern Shrimp in Shrimp Fishing Areas 4 to 6. DFO.
Potts, S. E., & Rose, K. A. (2018). Evaluation of GLM and GAM for estimating population indices from fishery independent surveys. Fisheries Research, 208, 167–178. https://doi.org/10.1016/j.fishres.2018.07.016
Privitera-Johnson, K. M., & Punt, A. E. (2020a). A review of approaches to quantifying uncertainty in fisheries stock assessments. Fisheries Research, 226, 105503. https://doi.org/10.1016/j.fishres.2020.105503
Privitera-Johnson, K. M., & Punt, A. E. (2020b). Leveraging scientific uncertainty in fisheries management for estimating among-assessment variation in overfishing limits. ICES Journal of Marine Science, 77(2), 515–526. https://doi.org/10.1093/icesjms/fsz237
Pycma. (2023). [Python]. CMA-ES. https://github.com/CMA-ES/pycma (Original work published 2016)
R Core Team. (2021). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing. https://www.R-project.org/
Rigby, R. A., & Stasinopoulos, D. M. (2005). Generalized Additive Models for Location, Scale and Shape. Journal of the Royal Statistical Society Series C: Applied Statistics, 54(3), 507–554. https://doi.org/10.1111/j.1467-9876.2005.00510.x
Ruckelshaus, M., Doney, S. C., Galindo, H. M., Barry, J. P., Chan, F., Duffy, J. E., English, C. A., Gaines, S. D., Grebmeier, J. M., Hollowed, A. B., Knowlton, N., Polovina, J., Rabalais, N. N., Sydeman, W. J., & Talley, L. D. (2013). Securing ocean benefits for society in the face of climate change. Marine Policy, 40, 154–159. https://doi.org/10.1016/j.marpol.2013.01.009
S. J. Smith & G. D. Somerton. (1981). STRAP : A User-Oriented Computer Analysis System for Groundfish Research Trawl Survey Data. DFO.
Saura, S., & Martínez-Millán, J. (2000). Landscape patterns simulation with a modified random clusters method. Landscape Ecology, 15(7), 661–678. https://doi.org/10.1023/A:1008107902848
Schrank, W. E. (2007). Is there any hope for fisheries management? Marine Policy, 31(3), 299–307. https://doi.org/10.1016/j.marpol.2006.09.001
Sciaini, M., Fritsch, M., Scherer, C., & Simpkins, C. E. (2018). NLMR and landscapetools: An integrated environment for simulating and modifying neutral landscape models in R. Methods in Ecology and Evolution, 9(11), 2240–2248. https://doi.org/10.1111/2041-210X.13076
Sethi, G., Costello, C., Fisher, A., Hanemann, M., & Karp, L. (2005). Fishery management under multiple uncertainty. Journal of Environmental Economics and Management, 50(2), 300–318. https://doi.org/10.1016/j.jeem.2004.11.005
Shertzer, K. W., & Prager, M. H. (2007). Delay in fishery management: Diminished yield, longer rebuilding, and increased probability of stock collapse1. ICES Journal of Marine Science, 64(1), 149–159. https://doi.org/10.1093/icesjms/fsl005
Shono, H. (2008). Application of the Tweedie distribution to zero-catch data in CPUE analysis. Fisheries Research, 93(1), 154–162. https://doi.org/10.1016/j.fishres.2008.03.006
Skanes, K., & Evans, G. (2005). Testing OGMAP as a Tool for Estimating Biomass and Abundance of Northern Shrimp (p. 3).
Smith, M. T., & Addison, J. T. (2003). Methods for stock assessment of crustacean fisheries. Fisheries Research, 65(1), 231–256. https://doi.org/10.1016/j.fishres.2003.09.017
Szuwalski, C. S., & Hollowed, A. B. (2016). Climate change and non-stationary population processes in fisheries management. ICES Journal of Marine Science, 73(5), 1297–1305. https://doi.org/10.1093/icesjms/fsv229
Vallecillo, D., Gauthier‐Clerc, M., Guillemain, M., Vittecoq, M., Vandewalle, P., Roche, B., & Champagnon, J. (2021). Reliability of animal counts and implications for the interpretation of trends. Ecology and Evolution, 11(5), 2249–2260. https://doi.org/10.1002/ece3.7191
Verma, J. T. (2019). Cod Collapse: The Rise and Fall of Newfoundland’s Saltwater Cowboys. Nimbus Publishing Limited.
Wackerly, D., Mendenhall, W., & Scheaffer, R. L. (2014). Mathematical Statistics with Applications. Cengage Learning.
Walters, C., & Maguire, J.-J. (1996). Lessons for stock assessment from the northern cod collapse. Reviews in Fish Biology and Fisheries, 6(2). https://doi.org/10.1007/BF00182340
Wood. (2003). Thin Plate Regression Splines. Journal of the Royal Statistical Society Series B: Statistical Methodology, 65(1), 95–114. https://doi.org/10.1111/1467-9868.00374
Wood. (2006). Low-rank scale-invariant tensor product smooths for generalized additive mixed models. Biometrics, 62(4), 1025–1036. https://doi.org/10.1111/j.1541-0420.2006.00574.x
Wood. (2015). Core Statistics. Cambridge University Press. https://doi.org/10.1017/CBO9781107741973
Wood. (2017). Generalized Additive Models: An Introduction with R, Second Edition. CRC Press.
Wood. (2023). mgcv: Mixed GAM Computation Vehicle with Automatic Smoothness Estimation (1.9-0) [Computer software]. https://cran.r-project.org/web/packages/mgcv/index.html
All items in Spectrum are protected by copyright, with all rights reserved. The use of items is governed by Spectrum's terms of access.
Repository Staff Only: item control page
Download Statistics
Download Statistics