ME001
Accelerating Discovery in Marine Imagery with Artificial Intelligence

Session ID#: 257812

Session Description:
Despite the rapid increase in imagery collected in marine environments the time it takes to manually process it for biological, geological, and ecological information remains a major bottleneck in advancing our understanding of these environments. Advances in artificial intelligence (AI), particularly in computer vision and machine learning, have the potential to change how we process imagery and increase our ability to make insights and discoveries via marine imagery. We invite contributions that demonstrate the use of AI techniques—such as object detection, image segmentation, unsupervised classification, and self-supervised learning—for automating the analysis of seafloor imagery, video, and sensor-integrated data. Topics may include, but are not limited to, automated species detection and counting, habitat classification, anomaly detection, mapping and photogrammetry of marine environments, training datasets and annotation strategies, and validation methods. We also welcome presentations that address the limitations, ethical implications, and deployment of AI systems in remote marine settings.

This session aims to foster interdisciplinary collaboration and discuss future directions for AI-enabled exploration and monitoring of marine environments and help identify factors holding back its implementation at large scales. Scientists, data scientists, engineers, and marine managers are encouraged to contribute, those advancing open data, community-driven model development, and field-based validation efforts.

Co-Sponsor(s):
  • Deep Sea Exploration -
  • Ocean Technologies and Observatories -
Index Terms:

1942 Machine learning [INFORMATICS]
4264 Ocean optics [OCEANOGRAPHY: GENERAL]
4813 Ecological prediction [OCEANOGRAPHY: BIOLOGICAL AND CHEMICAL]
4815 Ecosystems, structure, dynamics, and modeling [OCEANOGRAPHY: BIOLOGICAL AND CHEMICAL]
Primary Chair:  Katharine Bigham, University of Washington, School of Oceanography, Seattle, United States
Co-chairs:  Caroline Chin, National Institute of Water and Atmospheric Research, Wellington, New Zealand, Chloe Game, University of Bergen, Department of Informatics, Bergen, Norway and Nils Piechaud, Institute of Marine Research Bergen, Bergen, Norway
 
A Deep Dive into Humpback Whale (Megaptera novaeangliae) Connections in French Polynesia Using AI-based matching from Photo-Identification (2034506)
Alisha Andrews1, Renee Albertson2, MariAnna Hinojosa1 and Michael Poole3, (1)Oregon State University, Corvallis, United States, (2)Oregon State University, Fish and Wildlife, Corvallis, United States, (3)Marine Mammal Research Project French Polynesia, Moorea, French Polynesia
 
A deep learning-based model for the automatic identification of mesopelagic organisms from in-trawl cameras (2042300)
Taraneh Westergerling1,2, Vaneeda Allken2, Webjørn Melle2, Anne Salvanes1,3 and Shale Pettit Rosen4, (1)University of Bergen, Bergen, Norway, (2)Institute of Marine Research, Bergen, Norway, (3)Bjerknes Center for Climate Research, Bergen, Norway, (4)SINTEF Ocean, Trondheim, Norway
 
AI Model Transferability in Marine Benthic Imagery: From Training Site to New Ecosystems (2039093)
David Moffat, Plymouth Marine Laboratory, Environmental Intelligence Group, Plymouth, United Kingdom, Giulia La Bianca, Plymouth University, Plymouth, United Kingdom, Amelia Bridges, University of Plymouth, Plymouth, United Kingdom, Jaime Davies, University of Gibraltar, Gibraltar, Gibraltar and Kerry Howell, Plymouth Marine Laboratory, Plymouth, United Kingdom
 
An Open-Source Tool for Reproducible Image Preprocessing for AI Applications in Ecological Research (2044127)
Tobias Ferreira1, Loic Van Audenhaege2, Mojtaba Masoudi3, Jennfier M Durden4, Colin Sauze5 and Eric Orenstein3, (1)National Oceanography Center, Liverpool, United Kingdom, (2)National Oceanography Centre Southampton, Southampton, United Kingdom, (3)National Oceanography Centre, Southampton, United Kingdom, (4)National Oceanography Center, Southampton, United Kingdom, (5)National Oceanography Center, Soton, Southampton, United Kingdom
 
Are foundation models sufficient for plankton recognition? An evaluation of DINOv2 for FlowCam and IFCB imagery. (2048856)
Mihailo Azhar1, Kaisa Kraft2, Lumi Haraguchi2 and Hans Henrik Jakobsen3, (1)Aarhus University, Aarhus C, Denmark, (2)Finnish Environment Institute, Helsinki, Finland, (3)Aarhus University, Ecoscience, Roskilde, Denmark
 
Assisting human annotation of marine images with foundation models (2039922)
Kevin Barnard1, Eric Orenstein2, Benjamin Woodward3, Lonny Lundsten4, Brian Schlining1 and Kakani Katija1, (1)Monterey Bay Aquarium Research Institute, Moss Landing, United States, (2)National Oceanography Centre, Southampton, United Kingdom, (3)CVision AI, Medford, United States, (4)Monterey Bay Aquarium Research Institute, Moss Landing, CA, United States
 
Automating Benthic Biodiversity Mapping with Species Distribution Models and Computer Vision (2039611)
Harold Horsley1, Morten Omholt Alver1, Ingrid Ellingsen2 and AMBIOS Project, (1)Norwegian University of Science and Technology, Trondheim, Norway, (2)SINTEF Ocean, Trondheim, Norway
 
Automating Fish Detection and Counting in Trawl Surveys with Deep Learning (2037756)
Vaneeda Allken1, Ketil Malde1, Shale Pettit Rosen2, Jørgen Høyer1, Taraneh Westergerling3 and Nils Olav Handegard1, (1)Institute of Marine Research, Bergen, Norway, (2)SINTEF Ocean, Trondheim, Norway, (3)University of Bergen, Bergen, Norway
 
Breaking Barriers in Automated Image Analysis: A Case Study of Deep-Sea Biotopes. (2034047)
Chloe Game, University of Bergen, Department of Informatics, Bergen, Norway, Nils Piechaud, Institute of Marine Research Bergen, Bergen, Norway and Kerry Howell, Plymouth Marine Laboratory, Plymouth, United Kingdom
 
Convolutional Neural Networks and Multi-Modal Data Integration for Phytoplankton Taxonomy. (2017127)
Phyllis Amamoo1, George Wiafe2, Fiifi Baidoo3, Enoch Kofi Amoako1, Natalie Kokroko1, Darlington Akogo4, Peter Kojo Quashie1 and Benjamin Osei Botwe1, (1)University of Ghana, Accra, Ghana, (2)Edenway Foundation, Geo-Africa Incubation-Accelerator, Apam, Ghana, (3)Cloudport, Accra, Ghana, (4)minoHealth AI Labs, Accra, Ghana
 
CORAL-AI Artificial Intelligence for Highly Diverse Coralligenous Functional Analyses (2040535)
Pere Amer Sureda1, Yanis Zentner2, Cristina Linares3, Pol Capdevila3 and Daniel Gómez-Gras2, (1)UNITED STATES, (2)University of Barcelona, Department of Evolutionary Biology, Ecology and Environmental Sciences, Barcelona, Spain, (3)University of Barcelona, Evolutionary Biology, Ecology and Environmental Sciences, Barcelona, Spain
 
Deep Learning Based Survey of New Zealand Cryptic Scallops (2044982)
Tim Rensen1, Richard Green1, James Williams2, Mel Underwood2, Richie Hughes2 and Oliver Batchelor1, (1)University of Canterbury, Computer Science, Christchurch, New Zealand, (2)National Institute of Water and Atmospheric Research, Wellington, New Zealand
 
Deep learning model detection of seabirds from an uncrewed surface vehicle camera reveals effects of offshore wind farms (2035644)
Ross Rutherford, Joshua Lawrence and Paul Fernandes, Heriot-Watt University, Lyell Centre, Edinburgh, United Kingdom
 
Exploring the seabed one species at a time – automated assessment of priority marine features (2028154)
Emma Poliakova1, Matthew Toberman2, Louis Clift1 and Jon Chamberlain1, (1)University of Essex, Colchester, United Kingdom, (2)Tritonia Scientific, Dunbeg, United Kingdom
 
FathomVerse ID: A new, community-driven underwater animal identification app (2041877)
Emily Clark1, Kakani Katija1, Joost Daniels1, Kevin Barnard1, Giovanna Sainz1, Ellemieke Berings2 and &RANJ Serious Games Development Team, (1)Monterey Bay Aquarium Research Institute, Moss Landing, United States, (2)&ranj, Rotterdam, Netherlands
 
Integrating autonomous aerial vehicles and machine learning in image-based studies of pinniped populations. (2043438)
Corey Garza1, Michael Espriella2 and Stuart Negus1, (1)University of Washington, School of Aquatic and Fishery Sciences, Seattle, United States, (2)Washington Department of Fish and Wildlife, Seattle, United States
 
KAMERA: Enhancing Aerial Surveys of Ice-associated Seals in Arctic Environments (2048066)
Adam Romlein1, Benjamin X Hou2, Yuval Boss3, Cynthia L Christman3, Stacie Koslovsky2, Erin Moreland2, Jason Parham1 and Anthony Hoogs1, (1)Kitware, Clifton Park, United States, (2)NOAA NMFS AFSC MML, Seattle, United States, (3)CICOES, University of Washington, Seattle, United States
 
KLP: Kelp Location Profiling Using Segmentation of Aerial Drone Imagery for Assessing Percent Kelp-Canopy Coverage (2021918)
Tim Sananikone, Duane Russell Edgington, Danelle E Cline and Steven H D Haddock, Monterey Bay Aquarium Research Institute, Moss Landing, United States
 
Long-Term Ecological Patterns in Communities from Automated Species Detection at a Vent in the Mothra Hydrothermal Field, NE Pacific (2022058)
Ada Carter and Katharine Bigham, University of Washington Seattle Campus, School of Oceanography, Seattle, United States
 
Marine Animal Tracking and Measurement across Multiple Environments (2047644)
Matthew Dawkins, Bryon Lewis, Jon Crall, Mike Nagler and Anthony Hoogs, Kitware, Clifton Park, United States
 
NeRFBerg: Neural Radiance Field Applications for Rendering and Reconstructions of Arctic Sea Ice (2020349)
Russell Shomberg, University of Rhode Island, Narragansett, United States, Isabelle A Rathun, University of Maryland College Park, College Park, United States, Cy E. Keener, University of Maryland, Art Department, College Park, Maryland, United States, Lars Henrik Smedsrud, Geophysical Institute, University of Bergen and Bjerknes Centre for Climate Research, Bergen, Norway, Christopher Metzler, University of Maryland College Park, Department of Computer Science, College Park, United States and Ignatius Rigor, Polar Science Center, Applied Physics Lab, University of Washington, Seattle, Washington, United States
 
North Sea 3D: AI-enabled biomass estimation from offshore energy infrastructure imagery (2015587)
Joseph Marlow, John Halpin and Thomas Wilding, Scottish Association for Marine Science, Oban, United Kingdom
 
Scaling Marine Biodiversity Dataset Curation with AI and Human-In-the-Loop Review (2011763)
Laura Chrobak, Brian Schlining, Kevin Barnard, Carlos Rueda, Giovanna Sainz, Joost Daniels and Kakani Katija, Monterey Bay Aquarium Research Institute, Moss Landing, United States
 
Simultaneous, automated classification of abundant marine snow particles and rare zooplankton from imagery (2039316)
Fernanda Lecaros1, Colleen Durkin1, Danelle E Cline2 and Crissy Huffard3, (1)Monterey Bay Aquarium Research Institute, Moss Landing, United States, (2)MBARI, Moss Landing, CA, United States, (3)Monterey Bay Aquarium Research Institute, Moss Landing, CA, United States
 
ThresherID: Transformer-Based Contrastive Learning for Unsupervised Shark Re-Identification (2035348)
Ms. Armina Jawali, De La Salle University, College of Computer Science, Manila, Philippines and Jazzie Jao, De La Salle University, Manila, Philippines
 
Understanding the Current State of Southern Ocean Benthic Ecosystems Using Computer Vision (1872966)
Cameron Trotter1, Huw Griffiths1, Tasnuva Ming Khan2 and Rowan Whittle1, (1)NERC British Antarctic Survey, Cambridge, United Kingdom, (2)University of Cambridge, Cambridge, United Kingdom
 
Unveiling Diel Vertical Migration Patterns in Siphonophores with ML-Assisted Analysis of Long-Range AUV Video (2029569)
Marc Allentoft-Larsen1, Paul Roberts2, Kevin Barnard2, Joost Daniels2, Hans Henrik Jakobsen1 and Kakani Katija2, (1)Aarhus University, Ecoscience, Roskilde, Denmark, (2)Monterey Bay Aquarium Research Institute, Moss Landing, United States
 
Visualising Training Dataset Structure with Dimensionality Reduction to Improve Automated Seafloor Fauna Detection (2011818)
Caroline Chin1,2, Ashley Alun Rowden1,2, Alan Tan3, Daniel Leduc2 and Ashley Rowden, (1)Victoria University of Wellington, Wellington, New Zealand, (2)Earth Sciences New Zealand, Wellington, New Zealand, (3)Earth Sciences New Zealand, Auckland, New Zealand
 
Zero-shot Marine Organism Detection and Ecological Interpretation Using Vision-Language Models with RAG (2013402)
Ryo Matsumoto1, Daisuke Matsuoka1, Shinataro Kawahara1 and Koetsu Kon2, (1)Japan Agency for Marine-Earth Science and Technology, Yokohama-shi, Kanagawa, Japan, (2)Tokyo University of Marine Science and Technology, Tokyo, Japan