Open AccessArticle
DiffusionFR: Species Recognition of Fish in Blurry Scenarios via Diffusion and Attention
by
Guoying Wang
Guoying Wang 1,†,
Bing Shi
Bing Shi 1,†,
Xiaomei Yi
Xiaomei Yi 1,
Peng Wu
Peng Wu 1
,
Linjun Kong
Linjun Kong 2,* and
Lufeng Mo
Lufeng Mo 1,3,*
1
College of Mathematics and Computer Science, Zhejiang A&F University, Hangzhou 311300, China
2
Office of Information Technology, Zhejiang University of Finance & Economics, Hangzhou 310018, China
3
Information and Education Technology Center, Zhejiang A&F University, Hangzhou 311300, China
*
Authors to whom correspondence should be addressed.
†
These authors contributed equally to this work.
Submission received: 10 January 2024
/
Revised: 25 January 2024
/
Accepted: 1 February 2024
/
Published: 2 February 2024
Simple Summary
Blurry scenarios often affect the clarity of fish images, posing significant challenges to deep learning models in terms of the accurate recognition of fish species. A method based on deep learning with a diffusion model and an attention mechanism, DiffusionFR, is proposed herein to improve the accuracy of fish species recognition in blurry scenarios caused by light reflections and water ripple noise. Using a self-constructed dataset, BlurryFish, extensive experiments were conducted and the results showed that the proposed two-stage diffusion network model can restore the clarity of blurry fish images to some extent and the proposed learnable attention module is effective in improving the accuracy of fish species recognition.
Abstract
Blurry scenarios, such as light reflections and water ripples, often affect the clarity and signal-to-noise ratio of fish images, posing significant challenges for traditional deep learning models in accurately recognizing fish species. Firstly, deep learning models rely on a large amount of labeled data. However, it is often difficult to label data in blurry scenarios. Secondly, existing deep learning models need to be more effective for the processing of bad, blurry, and otherwise inadequate images, which is an essential reason for their low recognition rate. A method based on the diffusion model and attention mechanism for fish image recognition in blurry scenarios, DiffusionFR, is proposed to solve these problems and improve the performance of species recognition of fish images in blurry scenarios. This paper presents the selection and application of this correcting technique. In the method, DiffusionFR, a two-stage diffusion network model, TSD, is designed to deblur bad, blurry, and otherwise inadequate fish scene pictures to restore clarity, and a learnable attention module, LAM, is intended to improve the accuracy of fish recognition. In addition, a new dataset of fish images in blurry scenarios, BlurryFish, was constructed and used to validate the effectiveness of DiffusionFR, combining bad, blurry, and otherwise inadequate images from the publicly available dataset Fish4Knowledge. The experimental results demonstrate that DiffusionFR achieves outstanding performance on various datasets. On the original dataset, DiffusionFR achieved the highest training accuracy of 97.55%, as well as a Top-1 accuracy test score of 92.02% and a Top-5 accuracy test score of 95.17%. Furthermore, on nine datasets with light reflection noise, the mean values of training accuracy reached a peak at 96.50%, while the mean values of the Top-1 accuracy test and Top-5 accuracy test were at their highest at 90.96% and 94.12%, respectively. Similarly, on three datasets with water ripple noise, the mean values of training accuracy reached a peak at 95.00%, while the mean values of the Top-1 accuracy test and Top-5 accuracy test were at their highest at 89.54% and 92.73%, respectively. These results demonstrate that the method showcases superior accuracy and enhanced robustness in handling original datasets and datasets with light reflection and water ripple noise.
Share and Cite
MDPI and ACS Style
Wang, G.; Shi, B.; Yi, X.; Wu, P.; Kong, L.; Mo, L.
DiffusionFR: Species Recognition of Fish in Blurry Scenarios via Diffusion and Attention. Animals 2024, 14, 499.
https://doi.org/10.3390/ani14030499
AMA Style
Wang G, Shi B, Yi X, Wu P, Kong L, Mo L.
DiffusionFR: Species Recognition of Fish in Blurry Scenarios via Diffusion and Attention. Animals. 2024; 14(3):499.
https://doi.org/10.3390/ani14030499
Chicago/Turabian Style
Wang, Guoying, Bing Shi, Xiaomei Yi, Peng Wu, Linjun Kong, and Lufeng Mo.
2024. "DiffusionFR: Species Recognition of Fish in Blurry Scenarios via Diffusion and Attention" Animals 14, no. 3: 499.
https://doi.org/10.3390/ani14030499
APA Style
Wang, G., Shi, B., Yi, X., Wu, P., Kong, L., & Mo, L.
(2024). DiffusionFR: Species Recognition of Fish in Blurry Scenarios via Diffusion and Attention. Animals, 14(3), 499.
https://doi.org/10.3390/ani14030499
Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details
here.
Article Metrics
Article Access Statistics
For more information on the journal statistics, click
here.
Multiple requests from the same IP address are counted as one view.