Classification of Robust and Rotten Apples by Deep Learning Algorithm

Kiyas Kayaalp; Sedat Metlek

doi:10.35377/saucis.03.02.717452

Araştırma Makalesi

Yıl 2020, Cilt: 3 Sayı: 2, 112 - 120, 28.08.2020

Kiyas Kayaalp Sedat Metlek

https://doi.org/10.35377/saucis.03.02.717452

Cited By: 8

Öz

Kaynakça

H. Kurt, Ş. Ö. Keşkek, T. Çil, and A. Canataroğlu, “Meme kanserli hastalarda tamamlayıcı/alternatif tedavi kullanımı,” Türk Onkol. Derg., vol. 28, no. 1, pp. 10–15, 2013.
C. A. Perussello, Z. Zhang, A. Marzocchella, and B. K. Tiwari, “Valorization of apple pomace by extraction of valuable compounds,” Compr. Rev. Food Sci. Food Saf., vol. 16, no. 5, pp. 776–796, 2017.
O. Cömert, M. Hekim, and K. Adem, “Faster R-CNN Kullanarak Elmalarda Çürük Tespiti,” Uluslararası Mühendislik Araştırma ve Geliştirme Derg., vol. 11, no. 1, pp. 335–341.
V. Leemans, H. Magein, and M.-F. Destain, “On-line fruit grading according to their external quality using machine vision,” Biosyst. Eng., vol. 83, no. 4, pp. 397–404, 2002.
M. M. Sofu, O. Er, M. C. Kayacan, and B. Cetişli, “Elmaların görüntü işleme yöntemi ile sınıflandırılması ve leke tespiti,” Gıda Teknol. Elektron. Derg., vol. 8, no. 1, pp. 12–25, 2013.
Y. Lu and R. Lu, “Detection of surface and subsurface defects of apples using structured-illumination reflectance imaging with machine learning algorithms,” Trans. ASABE, vol. 61, no. 6, pp. 1831–1842, 2018.
R. Siddiqi, “Automated apple defect detection using state-of-the-art object detection techniques,” SN Appl. Sci., vol. 1, no. 11, p. 1345, 2019.
Y. Yu, S. A. Velastin, and F. Yin, “Automatic grading of apples based on multi-features and weighted K-means clustering algorithm,” Inf. Process. Agric., 2019.
O. Kleynen, V. Leemans, and M.-F. Destain, “Development of a multi-spectral vision system for the detection of defects on apples,” Journal of Food Engineering, vol. 69, no. 1, pp. 41–49, 2005.
B. Zhang et al., “Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: A review,” Food Res. Int., vol. 62, pp. 326–343, 2014.
S. Cubero, W. S. Lee, N. Aleixos, F. Albert, and J. Blasco, “Automated systems based on machine vision for inspecting citrus fruits from the field to postharvest—a review,” Food Bioprocess Technol., vol. 9, no. 10, pp. 1623–1639, 2016.
A. Folch-Fortuny, J. M. Prats-Montalbán, S. Cubero, J. Blasco, and A. Ferrer, “VIS/NIR hyperspectral imaging and N-way PLS-DA models for detection of decay lesions in citrus fruits,” Chemom. Intell. Lab. Syst., vol. 156, pp. 241–248, 2016.
X. Zhu and G. Li, “Rapid detection and visualization of slight bruise on apples using hyperspectral imaging,” Int. J. Food Prop., vol. 22, no. 1, pp. 1709–1719, 2019.
Z. Du, X. Zeng, X. Li, X. Ding, J. Cao, and W. Jiang, “Recent advances in imaging techniques for bruise detection in fruits and vegetables,” Trends Food Sci. Technol., 2020.
X. Zeng, Y. Miao, S. Ubaid, X. Gao, and S. Zhuang, “Detection and classification of bruises of pears based on thermal images,” Postharvest Biol. Technol., vol. 161, p. 111090, 2020.
M. Zhang, Y. Jiang, C. Li, and F. Yang, “Fully convolutional networks for blueberry bruising and calyx segmentation using hyperspectral transmittance imaging,” Biosyst. Eng., vol. 192, pp. 159–175, 2020.
Y. LeCun et al., “Backpropagation applied to handwritten zip code recognition,” Neural Comput., vol. 1, no. 4, pp. 541–551, 1989.
R. P. Lippmann, “Review of neural networks for speech recognition,” Neural Comput., vol. 1, no. 1, pp. 1–38, 1989.
B. Yuan, “Efficient hardware architecture of softmax layer in deep neural network,” in 2016 29th IEEE International System-on-Chip Conference (SOCC), 2016, pp. 323–326.
A. Kamilaris and F. X. Prenafeta-Boldú, “Deep learning in agriculture: A survey,” Comput. Electron. Agric., vol. 147, pp. 70–90, 2018.
J. Wan et al., “Deep learning for content-based image retrieval: A comprehensive study,” in Proceedings of the 22nd ACM international conference on Multimedia, 2014, pp. 157–166.
M. I. Razzak, S. Naz, and A. Zaib, “Deep learning for medical image processing: Overview, challenges and the future,” in Classification in BioApps, Springer, 2018, pp. 323–350.
C. Tian, Y. Xu, L. Fei, and K. Yan, “Deep Learning for Image Denoising: A Survey,” Int. Conf. Genet. Evol. Comput., pp. 563–572, 2018.
V. Leemans and M.-F. Destain, “A real-time grading method of apples based on features extracted from defects,” J. Food Eng., vol. 61, no. 1, pp. 83–89, 2004.
J. Xing and J. De Baerdemaeker, “Bruise detection on ‘Jonagold’apples using hyperspectral imaging,” Postharvest Biol. Technol., vol. 37, no. 2, pp. 152–162, 2005.
D. Unay and B. Gosselin, “Automatic defect segmentation of ‘Jonagold’apples on multi-spectral images: A comparative study,” Postharvest Biol. Technol., vol. 42, no. 3, pp. 271–279, 2006.
D. Unay, B. Gosselin, O. Kleynen, V. Leemans, M.-F. Destain, and O. Debeir, “Automatic grading of Bi-colored apples by multispectral machine vision,” Comput. Electron. Agric., vol. 75, no. 1, pp. 204–212, 2011.
S. H. Mohana and C. J. Prabhakar, “Stem-calyx recognition of an apple using shape descriptors,” arXiv Prepr. arXiv1501.01083, 2015.
S. R. Dubey and A. S. Jalal, “Apple disease classification using color, texture and shape features from images,” Signal, Image Video Process., vol. 10, no. 5, pp. 819–826, 2016.
Y. Lu and R. Lu, “Histogram-based automatic thresholding for bruise detection of apples by structured-illumination reflectance imaging,” Biosyst. Eng., vol. 160, pp. 30–41, 2017.
S. Zhang, X. Wu, S. Zhang, Q. Cheng, and Z. Tan, “An effective method to inspect and classify the bruising degree of apples based on the optical properties,” Postharvest Biol. Technol., vol. 127, pp. 44–52, 2017.
“Gömülü kamera sistemleri”, [Online]. https://www.matrix-vision.com/smart-cam-compact-application-camera.html [Erişim tarihi: 21.05.2020.]

Classification of Robust and Rotten Apples by Deep Learning Algorithm

Yıl 2020, Cilt: 3 Sayı: 2, 112 - 120, 28.08.2020

Kiyas Kayaalp Sedat Metlek

https://doi.org/10.35377/saucis.03.02.717452

Cited By: 8

Öz

In the study, it is aimed to classify the apples as rotten and robust by using the deep learning algorithm of the apple images taken from the CAPA database. In the proposed model, the processing steps are image reading, preprocessing and classification of apples, respectively. In the image reading stage, images taken from the image database were used. The applied deep learning architecture consists of introduction, convolutional, activation, pooling, memorization, full connection and conclusion layers. The data used in this architecture are divided into two as 80% training and 20% test data. Four different wavelength, 16 kinds of image combinations were used for the training and testing of the system. At the classification stage, a success rate of 91.25% was achieved in detecting rotten and robust apples. As a result, it is predicted that the proposed model can be used in the fruit processing industry to automatically classify rotten and robust apples.

Anahtar Kelimeler

apple classification, deep learning, image processing, bruised, apple

Kaynakça

H. Kurt, Ş. Ö. Keşkek, T. Çil, and A. Canataroğlu, “Meme kanserli hastalarda tamamlayıcı/alternatif tedavi kullanımı,” Türk Onkol. Derg., vol. 28, no. 1, pp. 10–15, 2013.
C. A. Perussello, Z. Zhang, A. Marzocchella, and B. K. Tiwari, “Valorization of apple pomace by extraction of valuable compounds,” Compr. Rev. Food Sci. Food Saf., vol. 16, no. 5, pp. 776–796, 2017.
O. Cömert, M. Hekim, and K. Adem, “Faster R-CNN Kullanarak Elmalarda Çürük Tespiti,” Uluslararası Mühendislik Araştırma ve Geliştirme Derg., vol. 11, no. 1, pp. 335–341.
V. Leemans, H. Magein, and M.-F. Destain, “On-line fruit grading according to their external quality using machine vision,” Biosyst. Eng., vol. 83, no. 4, pp. 397–404, 2002.
M. M. Sofu, O. Er, M. C. Kayacan, and B. Cetişli, “Elmaların görüntü işleme yöntemi ile sınıflandırılması ve leke tespiti,” Gıda Teknol. Elektron. Derg., vol. 8, no. 1, pp. 12–25, 2013.
Y. Lu and R. Lu, “Detection of surface and subsurface defects of apples using structured-illumination reflectance imaging with machine learning algorithms,” Trans. ASABE, vol. 61, no. 6, pp. 1831–1842, 2018.
R. Siddiqi, “Automated apple defect detection using state-of-the-art object detection techniques,” SN Appl. Sci., vol. 1, no. 11, p. 1345, 2019.
Y. Yu, S. A. Velastin, and F. Yin, “Automatic grading of apples based on multi-features and weighted K-means clustering algorithm,” Inf. Process. Agric., 2019.
O. Kleynen, V. Leemans, and M.-F. Destain, “Development of a multi-spectral vision system for the detection of defects on apples,” Journal of Food Engineering, vol. 69, no. 1, pp. 41–49, 2005.
B. Zhang et al., “Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: A review,” Food Res. Int., vol. 62, pp. 326–343, 2014.
S. Cubero, W. S. Lee, N. Aleixos, F. Albert, and J. Blasco, “Automated systems based on machine vision for inspecting citrus fruits from the field to postharvest—a review,” Food Bioprocess Technol., vol. 9, no. 10, pp. 1623–1639, 2016.
A. Folch-Fortuny, J. M. Prats-Montalbán, S. Cubero, J. Blasco, and A. Ferrer, “VIS/NIR hyperspectral imaging and N-way PLS-DA models for detection of decay lesions in citrus fruits,” Chemom. Intell. Lab. Syst., vol. 156, pp. 241–248, 2016.
X. Zhu and G. Li, “Rapid detection and visualization of slight bruise on apples using hyperspectral imaging,” Int. J. Food Prop., vol. 22, no. 1, pp. 1709–1719, 2019.
Z. Du, X. Zeng, X. Li, X. Ding, J. Cao, and W. Jiang, “Recent advances in imaging techniques for bruise detection in fruits and vegetables,” Trends Food Sci. Technol., 2020.
X. Zeng, Y. Miao, S. Ubaid, X. Gao, and S. Zhuang, “Detection and classification of bruises of pears based on thermal images,” Postharvest Biol. Technol., vol. 161, p. 111090, 2020.
M. Zhang, Y. Jiang, C. Li, and F. Yang, “Fully convolutional networks for blueberry bruising and calyx segmentation using hyperspectral transmittance imaging,” Biosyst. Eng., vol. 192, pp. 159–175, 2020.
Y. LeCun et al., “Backpropagation applied to handwritten zip code recognition,” Neural Comput., vol. 1, no. 4, pp. 541–551, 1989.
R. P. Lippmann, “Review of neural networks for speech recognition,” Neural Comput., vol. 1, no. 1, pp. 1–38, 1989.
B. Yuan, “Efficient hardware architecture of softmax layer in deep neural network,” in 2016 29th IEEE International System-on-Chip Conference (SOCC), 2016, pp. 323–326.
A. Kamilaris and F. X. Prenafeta-Boldú, “Deep learning in agriculture: A survey,” Comput. Electron. Agric., vol. 147, pp. 70–90, 2018.
J. Wan et al., “Deep learning for content-based image retrieval: A comprehensive study,” in Proceedings of the 22nd ACM international conference on Multimedia, 2014, pp. 157–166.
M. I. Razzak, S. Naz, and A. Zaib, “Deep learning for medical image processing: Overview, challenges and the future,” in Classification in BioApps, Springer, 2018, pp. 323–350.
C. Tian, Y. Xu, L. Fei, and K. Yan, “Deep Learning for Image Denoising: A Survey,” Int. Conf. Genet. Evol. Comput., pp. 563–572, 2018.
V. Leemans and M.-F. Destain, “A real-time grading method of apples based on features extracted from defects,” J. Food Eng., vol. 61, no. 1, pp. 83–89, 2004.
J. Xing and J. De Baerdemaeker, “Bruise detection on ‘Jonagold’apples using hyperspectral imaging,” Postharvest Biol. Technol., vol. 37, no. 2, pp. 152–162, 2005.
D. Unay and B. Gosselin, “Automatic defect segmentation of ‘Jonagold’apples on multi-spectral images: A comparative study,” Postharvest Biol. Technol., vol. 42, no. 3, pp. 271–279, 2006.
D. Unay, B. Gosselin, O. Kleynen, V. Leemans, M.-F. Destain, and O. Debeir, “Automatic grading of Bi-colored apples by multispectral machine vision,” Comput. Electron. Agric., vol. 75, no. 1, pp. 204–212, 2011.
S. H. Mohana and C. J. Prabhakar, “Stem-calyx recognition of an apple using shape descriptors,” arXiv Prepr. arXiv1501.01083, 2015.
S. R. Dubey and A. S. Jalal, “Apple disease classification using color, texture and shape features from images,” Signal, Image Video Process., vol. 10, no. 5, pp. 819–826, 2016.
Y. Lu and R. Lu, “Histogram-based automatic thresholding for bruise detection of apples by structured-illumination reflectance imaging,” Biosyst. Eng., vol. 160, pp. 30–41, 2017.
S. Zhang, X. Wu, S. Zhang, Q. Cheng, and Z. Tan, “An effective method to inspect and classify the bruising degree of apples based on the optical properties,” Postharvest Biol. Technol., vol. 127, pp. 44–52, 2017.
“Gömülü kamera sistemleri”, [Online]. https://www.matrix-vision.com/smart-cam-compact-application-camera.html [Erişim tarihi: 21.05.2020.]

Toplam 32 adet kaynakça vardır.

Ayrıntılar

Birincil Dil	İngilizce
Konular	Yapay Zeka
Bölüm	Makaleler
Yazarlar	Kiyas Kayaalp 0000-0002-6483-1124 Sedat Metlek 0000-0002-0393-9908
Yayımlanma Tarihi	28 Ağustos 2020
Gönderilme Tarihi	9 Nisan 2020
Kabul Tarihi	29 Mayıs 2020
Yayımlandığı Sayı	Yıl 2020Cilt: 3 Sayı: 2

Kaynak Göster

IEEE	K. Kayaalp ve S. Metlek, “Classification of Robust and Rotten Apples by Deep Learning Algorithm”, SAUCIS, c. 3, sy. 2, ss. 112–120, 2020, doi: 10.35377/saucis.03.02.717452.