Identifying the species of harvested tuna and billfish using deep convolutional neural networks

Abstract Fish catch species provide essential information for marine resource management. Some international organizations demand fishing vessels to report the species statistics of fish catch. Conventionally, the statistics are recorded manually by observers or fishermen. The accuracy of these statistics is, however, questionable due to the possibility of underreporting or misreporting. This paper proposes to automatically identify the species of common tuna and billfish using machine vision. The species include albacore (Thunnus alalunga), bigeye tuna (Thunnus obesus), yellowfin tuna (Thunnus albacares), blue marlin (Makaira nigricans), Indo-pacific sailfish (Istiophorus platypterus), and swordfish (Xiphias gladius). In this approach, the images of fish catch are acquired on the decks of fishing vessels. Deep convolutional neural network models are then developed to identify the species from the images. The proposed approach achieves an accuracy of at least 96.24%.