{"id":1453,"date":"2020-06-01T08:23:09","date_gmt":"2020-06-01T12:23:09","guid":{"rendered":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/?p=1453"},"modified":"2023-07-28T12:21:01","modified_gmt":"2023-07-28T16:21:01","slug":"can-computers-accurately-identify-fish-by-species","status":"publish","type":"post","link":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/","title":{"rendered":"Can Computers Accurately Identify Fish by Species?"},"content":{"rendered":"\n

Research suggests that state-of-the-art modeling is the key to the automated identification of fish.<\/strong><\/p>\n\n\n\n

Research Need<\/strong><\/h3>\n\n\n\n

Fisheries managers need to correctly count and identify fish by species to estimate fish abundance and monitor ecosystem health. Traditionally, scientists have relied on lethal sampling practices to gather this information. However, whenever possible, scientists are increasingly relying on underwater video-based fish monitoring to observe and document fish populations.<\/p>\n\n\n\n

Sounds perfect, right? But what\u2019s the catch with this type of technique?<\/p>\n\n\n\n

The challenge is that fish identification through video typically requires the use of skilled human video reviewers. Attempts to use only computers have produced widely mixed results. But what if researchers could develop an algorithm that would allow computers alone to identify fish by species from video footage?<\/p>\n\n\n\n

What Did They Study?<\/strong><\/h3>\n\n\n\n

Scientists collected underwater stereo-video footage from other researchers leading fish-trap sampling programs in the marine waters of Western Australia. They obtained footage for 16 different marine species from native shallow waters and habitats (kelp, seagrass, sand, and coral reefs).<\/p>\n\n\n\n

Whereas most previous automated fish identification systems used only the images to develop a computer algorithm, researchers in this study also incorporated many of the unique features of each fish species \u2014 such as body shape, color, and shading \u2014 into the process. Then, by using many different layers of data and decision steps, researchers developed and evaluated a \u201cdeep-learning neural network.\u201d<\/p>\n\n\n\n

What Did They Find?<\/strong><\/h3>\n\n\n\n

This method was accurate 89% to 94% for fish species examined in typical underwater imagery. The higher range of classification accuracy is competitive with how well human experts identify fish by species.<\/p>\n\n\n\n

This research indicates that further development of computer-based, automated fish identification classification systems from underwater imagery is warranted, and that these systems can be feasible and cost-effective alternatives to identification by humans.<\/p>\n\n\n\n

What\u2019s Next?<\/strong><\/h3>\n\n\n\n

The authors admit that fish observed in underwater videos outside of these tests will likely be recorded under a wide range of resolutions, swimming orientations (e.g., towards the camera), speeds, and background clutter (like other fish) \u2014 criteria that will make classification success more challenging. However, this study provides important progress on a path to further advance this field of study.<\/p>\n\n\n\n

Reading<\/strong><\/h3>\n\n\n\n

Siddiqui, S. A., Salman, A., Malik, M. I., Shafait, F., Mian, A., Shortis, M. R., and Harvey, E. S. 2018. Automatic fish species classification in underwater videos: exploiting pre-trained deep neural network models to compensate for limited labelled data<\/a>. ICES Journal of Marine Science<\/em>, 75: 374\u2013389.doi:10.1093\/icesjms\/fsx109<\/p>\n\n\n\n

Funding provided in part by the Australian Research Council<\/em>.<\/p>\n\n\n\n

Summary compiled by Scott Baker<\/em>
Lead photo by Emma Hickerson, NOAA FGBNMS Research Coordinator<\/em><\/p>\n\n\n\n

The text from Hook, Line & Science<\/em> is available to reprint and republish, but only in its entirety and with this attribution: Hook, Line & Science<\/em>, courtesy of Scott Baker and Sara Mirabilio, North Carolina Sea Grant. HookLineScience.com<\/em><\/p>\n\n\n\n

Sign up for the Hook, Line & Science<\/em> newsletter here<\/a>.<\/strong><\/h3>\n","protected":false},"excerpt":{"rendered":"

Research suggests that state-of-the-art modeling is the key to the automated identification of fish.<\/p>\n","protected":false},"author":89,"featured_media":1465,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"ncst_custom_author":"","ncst_show_custom_author":false,"ncst_dynamicHeaderBlockName":"","ncst_dynamicHeaderData":"","ncst_content_audit_freq":"","ncst_content_audit_date":"","ncst_content_audit_display":false,"ncst_backToTopFlag":"","footnotes":""},"categories":[13,536,15,16],"tags":[],"class_list":["post-1453","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-angler","category-fisheries-management","category-fishing","category-research"],"displayCategory":null,"acf":[],"yoast_head":"\nCan Computers Accurately Identify Fish by Species? - Hook, Line and Science<\/title>\n<meta name=\"description\" content=\"Research suggests that state-of-the-art modeling is the key to the automated identification of fish.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Can Computers Accurately Identify Fish by Species?\" \/>\n<meta property=\"og:description\" content=\"Research suggests that state-of-the-art modeling is the key to the automated identification of fish.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/\" \/>\n<meta property=\"og:site_name\" content=\"Hook, Line and Science\" \/>\n<meta property=\"article:published_time\" content=\"2020-06-01T12:23:09+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-07-28T16:21:01+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-content\/uploads\/sites\/14\/2020\/06\/HLS-fish-ID-1-1024x638.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"638\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Staff\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:title\" content=\"Can Computers Accurately Identify Fish by Species?\" \/>\n<meta name=\"twitter:description\" content=\"Research suggests that state-of-the-art modeling is the key to the automated identification of fish.\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-content\/uploads\/sites\/14\/2020\/06\/HLS-fish-ID-1.jpg\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Staff\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/\",\"url\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/\",\"name\":\"Can Computers Accurately Identify Fish by Species? - Hook, Line and Science\",\"isPartOf\":{\"@id\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-content\/uploads\/sites\/14\/2020\/06\/HLS-fish-ID-1.jpg\",\"datePublished\":\"2020-06-01T12:23:09+00:00\",\"dateModified\":\"2023-07-28T16:21:01+00:00\",\"author\":{\"@id\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/#\/schema\/person\/5d1852d1cac0b3869a8a4eadea737f3d\"},\"description\":\"Research suggests that state-of-the-art modeling is the key to the automated identification of fish.\",\"breadcrumb\":{\"@id\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/#primaryimage\",\"url\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-content\/uploads\/sites\/14\/2020\/06\/HLS-fish-ID-1.jpg\",\"contentUrl\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-content\/uploads\/sites\/14\/2020\/06\/HLS-fish-ID-1.jpg\",\"width\":1789,\"height\":1115},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Can Computers Accurately Identify Fish by Species?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/#website\",\"url\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/\",\"name\":\"Hook, Line and Science\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/#\/schema\/person\/5d1852d1cac0b3869a8a4eadea737f3d\",\"name\":\"Staff\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/f131c2520257763418dbfbe3e2b4d5d372fc616eb92c3839340b243bf85a42c6?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/f131c2520257763418dbfbe3e2b4d5d372fc616eb92c3839340b243bf85a42c6?s=96&d=mm&r=g\",\"caption\":\"Staff\"},\"url\":\"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/author\/staff\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Can Computers Accurately Identify Fish by Species? - Hook, Line and Science","description":"Research suggests that state-of-the-art modeling is the key to the automated identification of fish.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/","og_locale":"en_US","og_type":"article","og_title":"Can Computers Accurately Identify Fish by Species?","og_description":"Research suggests that state-of-the-art modeling is the key to the automated identification of fish.","og_url":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/","og_site_name":"Hook, Line and Science","article_published_time":"2020-06-01T12:23:09+00:00","article_modified_time":"2023-07-28T16:21:01+00:00","og_image":[{"width":1024,"height":638,"url":"http:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-content\/uploads\/sites\/14\/2020\/06\/HLS-fish-ID-1-1024x638.jpg","type":"image\/jpeg"}],"author":"Staff","twitter_card":"summary_large_image","twitter_title":"Can Computers Accurately Identify Fish by Species?","twitter_description":"Research suggests that state-of-the-art modeling is the key to the automated identification of fish.","twitter_image":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-content\/uploads\/sites\/14\/2020\/06\/HLS-fish-ID-1.jpg","twitter_misc":{"Written by":"Staff","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/","url":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/","name":"Can Computers Accurately Identify Fish by Species? - Hook, Line and Science","isPartOf":{"@id":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/#website"},"primaryImageOfPage":{"@id":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/#primaryimage"},"image":{"@id":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/#primaryimage"},"thumbnailUrl":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-content\/uploads\/sites\/14\/2020\/06\/HLS-fish-ID-1.jpg","datePublished":"2020-06-01T12:23:09+00:00","dateModified":"2023-07-28T16:21:01+00:00","author":{"@id":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/#\/schema\/person\/5d1852d1cac0b3869a8a4eadea737f3d"},"description":"Research suggests that state-of-the-art modeling is the key to the automated identification of fish.","breadcrumb":{"@id":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/#primaryimage","url":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-content\/uploads\/sites\/14\/2020\/06\/HLS-fish-ID-1.jpg","contentUrl":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-content\/uploads\/sites\/14\/2020\/06\/HLS-fish-ID-1.jpg","width":1789,"height":1115},{"@type":"BreadcrumbList","@id":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/can-computers-accurately-identify-fish-by-species\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/"},{"@type":"ListItem","position":2,"name":"Can Computers Accurately Identify Fish by Species?"}]},{"@type":"WebSite","@id":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/#website","url":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/","name":"Hook, Line and Science","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/#\/schema\/person\/5d1852d1cac0b3869a8a4eadea737f3d","name":"Staff","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/f131c2520257763418dbfbe3e2b4d5d372fc616eb92c3839340b243bf85a42c6?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/f131c2520257763418dbfbe3e2b4d5d372fc616eb92c3839340b243bf85a42c6?s=96&d=mm&r=g","caption":"Staff"},"url":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/author\/staff\/"}]}},"_links":{"self":[{"href":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-json\/wp\/v2\/posts\/1453","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-json\/wp\/v2\/users\/89"}],"replies":[{"embeddable":true,"href":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-json\/wp\/v2\/comments?post=1453"}],"version-history":[{"count":1,"href":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-json\/wp\/v2\/posts\/1453\/revisions"}],"predecessor-version":[{"id":3616,"href":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-json\/wp\/v2\/posts\/1453\/revisions\/3616"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-json\/wp\/v2\/media\/1465"}],"wp:attachment":[{"href":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-json\/wp\/v2\/media?parent=1453"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-json\/wp\/v2\/categories?post=1453"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ncseagrant.ncsu.edu\/hooklinescience\/wp-json\/wp\/v2\/tags?post=1453"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}