<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">agronauka</journal-id><journal-title-group><journal-title xml:lang="ru">Аграрная наука Евро-Северо-Востока</journal-title><trans-title-group xml:lang="en"><trans-title>Agricultural Science Euro-North-East</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">2072-9081</issn><issn pub-type="epub">2500-1396</issn><publisher><publisher-name>FARC North-East</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.30766/2072-9081.2023.24.4.685-696</article-id><article-id custom-type="elpub" pub-id-type="custom">agronauka-1419</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>ОРИГИНАЛЬНЫЕ СТАТЬИ: МЕХАНИЗАЦИЯ, ЭЛЕКТРИФИКАЦИЯ, АВТОМАТИЗАЦИЯ</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>ОRIGINAL SCIENTIFIC ARTICLES: MECHANIZATION, ELECTRIFICATION, AUTOMATION</subject></subj-group></article-categories><title-group><article-title>Применение сверточной нейронной сети для мониторинга состояния земляники садовой</article-title><trans-title-group xml:lang="en"><trans-title>Application of convolutional neural network for monitoring the condition of strawberries</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0001-7643-775X</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Кутырёв</surname><given-names>А. И.</given-names></name><name name-style="western" xml:lang="en"><surname>Kutyrev</surname><given-names>A. I.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Алексей Игоревич Кутырёв, кандидат техн. наук, заведующий лабораторией, старший научный сотрудник</p><p>лаборатория интеллектуальных цифровых систем мониторинга, диагностики и управления процессами в сельскохозяйственном производстве</p><p>1-й Институтский проезд, д. 5</p><p>Москва</p><p>e-mail: alexeykutyrev@gmail.com</p></bio><bio xml:lang="en"><p>Alexey I. Kutyrev, PhD in Engineering, Head of the Laboratory, senior researcher</p><p>Laboratory of Intelligent Digital Systems for Monitoring, Diagnostics and Process Management in Agricultural Production</p><p>1st Institute passage, 5</p><p>Moscow</p><p>e-mail: alexeykutyrev@gmail.com</p></bio><email xlink:type="simple">vim@vim.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0003-3586-3634</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Филиппов</surname><given-names>Р. А.</given-names></name><name name-style="western" xml:lang="en"><surname>Filippov</surname><given-names>R. A.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Ростислав Александрович Филиппов, кандидат с.-х. наук, ведущий научный сотрудник</p><p>1-й Институтский проезд, д. 5</p><p>Москва</p></bio><bio xml:lang="en"><p>Rostislav A. Filippov, PhD in Agricultural Science, Head of the Laboratory, leading researcher</p><p>Laboratory of Intelligent Digital Systems for Monitoring, Diagnostics and Process Management in Agricultural Production</p><p>1st Institute passage, 5</p><p>Moscow</p></bio><email xlink:type="simple">vim@vim.ru</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>ФГБНУ «Федеральный научный агроинженерный центр ВИМ»</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Federal Scientific Agroengineering Center VIM</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2023</year></pub-date><pub-date pub-type="epub"><day>31</day><month>08</month><year>2023</year></pub-date><volume>24</volume><issue>4</issue><fpage>685</fpage><lpage>696</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Кутырёв А.И., Филиппов Р.А., 2023</copyright-statement><copyright-year>2023</copyright-year><copyright-holder xml:lang="ru">Кутырёв А.И., Филиппов Р.А.</copyright-holder><copyright-holder xml:lang="en">Kutyrev A.I., Filippov R.A.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://www.agronauka-sv.ru/jour/article/view/1419">https://www.agronauka-sv.ru/jour/article/view/1419</self-uri><abstract><p>   В статье предложен метод повышения точности диагностирования недостатка кальция в растениях земляники садовой – применение алгоритмов машинного обучения, таких как сверточные нейронные сети (CNN), что позволяет обучить модель на наборе данных для качественного обнаружения признаков дефицита кальция на листьях. Собран набор данных (dataset) изображений здоровых листьев и с признаками недостатка кальция, использован способ искусственного увеличения объема обучающей выборки (image augmentation) путем горизонтального и вертикального отражения объектов на изображениях, поворота на заданный угол и случайного добавления «шума». Для обучения сверточной нейронной сети предложен алгоритм получения RGB-изображений с помощью роботизированной платформы. В качестве средства обнаружения признаков дефицита кальция на листьях земляники на изображениях использована современная модель нейронной сети YOLOv7. Определены гиперпараметры алгоритма машинного обучения модели YOLOv7 для распознавания областей поражения листьев земляники садовой, вызванных недостатком кальция. Для обучения модели YOLOv7 использован метод трансферного обучения (Transfer learning). Для оценки качества работы алгоритмов распознавания объектов использованы метрики mAP (mean average precision) и F1-score (F-мера), проведен расчет средней абсолютной ошибки (Mean Absolute Percentage Error, MAPE) рассматриваемой модели нейронной сети YOLOv7. Анализ полученных результатов показал, что модель YOLOv7 распознала класс «Calciuemdeficiency» с показателем MAPE, равным 7,52 %. Расчетное значение метрики бинарной классификации mAP составило 0,454, метрики F1-score – 0,53. Результаты исследований показали, что своевременный мониторинг состояния земляники садовой на промышленной плантации, проведенный с использованием колесной роботизированной платформы с применением сверточной нейронной сети YOLOv7 для обработки полученных данных, позволит на ранних этапах развития патологии с высокой точностью до 94,43 % определить дефицит кальция в листьях растений земляники садовой.</p></abstract><trans-abstract xml:lang="en"><p>   The article proposes a method for improving the accuracy of diagnosing calcium deficiency in strawberry plants, suggests the use of machine learning algorithms, such as convolutional neural networks (CNN), which makes it possible to train a model on a data set for qualitative detection of signs of calcium deficiency in the leaves. A dataset of images of healthy leaves and leaves with signs of calcium deficiency was collected, the method of artificially increasing the volume of the training sample (image augmentation) was applied, by horizontal and vertical reflection of objects in the images, rotation by a given angle and random addition of «noise». To train a convolutional neural network, an algorithm for obtaining RGB images using a robotic platform is proposed. A modern model of the YOLOv7 neural network was used as a means of detecting the signs of calcium deficiency in the leaves of strawberry in the images. The configuration of the YOLOv7 machine learning algorithm for recognizing areas of damage to strawberry leaves caused by calcium deficiency has been determined. To train the YOLOv7 model, the Transfer learning method was used. To assess the quality of the object recognition algorithms, the metric mAP (mean average precision) – 0.454 was used, the metric F1-score (F-measure) – 0.53, the average absolute error (Mean Absolute Percentage Error, MAPE) of the analyzed model of the YOLOv7 neural network was calculated. The analysis of the results showed that the YOLOv7 model recognized the «Calciuemdeficiency» class, with a MAPE index equal to 7.52 %. The analysis of the research results showed that timely monitoring of the condition of garden strawberries on an industrial plantation carried out using a wheeled robotic platform with the use of the YOLOv7 convolutional neural network for processing the data obtained will allow to determine calcium deficiency in the leaves of strawberry plants with high accuracy up to 94.43 % at the early stages of pathology development.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>трансферное обучение</kwd><kwd>машинное обучение</kwd><kwd>распознавание</kwd><kwd>роботизированная платформа</kwd><kwd>поражение листьев</kwd><kwd>искусственное увеличение выборки</kwd></kwd-group><kwd-group xml:lang="en"><kwd>transfer learning</kwd><kwd>machine learning</kwd><kwd>recognition</kwd><kwd>robotic platform</kwd><kwd>leaf damage</kwd><kwd>artificial increasing of sampling</kwd></kwd-group><funding-group><funding-statement xml:lang="ru">Работа выполнена при поддержке Минобрнауки России в рамках Государственного задания ФГБНУ «Федеральный научный агроинженерный центр ВИМ» (тема № FGUN-2022-0011)</funding-statement><funding-statement xml:lang="en">The research was carried out under the support of the Ministry of Science and Higher Education of the Russian Federation within the state assignment of the Federal Scientific Agroengineering Center VIM (theme No. FGUN-2022-0011). The authors thank the reviewers for their contribution to the peer review of this work</funding-statement></funding-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Dunn J. L., Able A. J. Pre-harvest calcium effects on sensory quality and calcium mobility in strawberry fruit. Acta Horticulture. 2006;708(708):307-312. doi: 10.17660/ActaHortic.2006.708.52</mixed-citation><mixed-citation xml:lang="en">Dunn J. L., Able A. J. Pre-harvest calcium effects on sensory quality and calcium mobility in strawberry fruit. Acta Horticulture. 2006;708(708):307-312. doi: 10.17660/ActaHortic.2006.708.52</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Moore K. A., Bradley L. K. North Carolina extension gardener handbook (Ch. 5). The University of North Carolina Press, North Carolina, USA, 2018. URL: https://content.ces.ncsu.edu/extension-gardener-handbook/5-diseases-and-disorders</mixed-citation><mixed-citation xml:lang="en">Moore K. A., Bradley L. K. North Carolina extension gardener handbook (Ch. 5). The University of North Carolina Press, North Carolina, USA, 2018. URL: https://content.ces.ncsu.edu/extension-gardener-handbook/5-diseases-and-disorders</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Kuronuma T., Watanabe Y., Ando M., Watanabe H. Tipburn severity and calcium distribution in lisianthus (Eustoma Grandiflorum (Raf.) Shinn.) cultivars under different relative air humidity conditions. Agronomy. 2018;8(10):218. doi: 10.3390/agronomy8100218</mixed-citation><mixed-citation xml:lang="en">Kuronuma T., Watanabe Y., Ando M., Watanabe H. Tipburn severity and calcium distribution in lisianthus (Eustoma Grandiflorum (Raf.) Shinn.) cultivars under different relative air humidity conditions. Agronomy. 2018;8(10):218. doi: 10.3390/agronomy8100218</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Bárcena A., Graciano C., Luca T., Guiamet J. J., Costa L. Shade cloths and polyethylene covers have opposite effects on tipburn development in greenhouse grown lettuce. Scientia Horticulturae. 2019;249:93-99. doi: 10.1016/j.scienta.2019.01.023</mixed-citation><mixed-citation xml:lang="en">Bárcena A., Graciano C., Luca T., Guiamet J. J., Costa L. Shade cloths and polyethylene covers have opposite effects on tipburn development in greenhouse grown lettuce. Scientia Horticulturae. 2019;249:93-99. doi: 10.1016/j.scienta.2019.01.023</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Olle M., Williams I. H. Physiological disorders in tomato and some methods to avoid them. The Journal of Horticultural Science and Biotechnology. 2017;92(3):223-230. doi: 10.1080/14620316.2016.1255569</mixed-citation><mixed-citation xml:lang="en">Olle M., Williams I. H. Physiological disorders in tomato and some methods to avoid them. The Journal of Horticultural Science and Biotechnology. 2017;92(3):223-230. doi: 10.1080/14620316.2016.1255569</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Sayğı H. Effects of Organic Fertilizer Application on Strawberry (Fragaria vesca L.) Cultivation. Agronomy. 2022;12(5):1233. doi: 10.3390/agronomy12051233</mixed-citation><mixed-citation xml:lang="en">Sayğı H. Effects of Organic Fertilizer Application on Strawberry (Fragaria vesca L.) Cultivation. Agronomy. 2022;12(5):1233. doi: 10.3390/agronomy12051233</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Mohamed M. H. M., Petropoulos S. A., Ali M. M. E. The Application of Nitrogen Fertilization and Foliar Spraying with Calcium and Boron Affects Growth Aspects, Chemical Composition, Productivity and Fruit Quality of Strawberry Plants. Horticulturae. 2021;7(8):257. doi: 10.3390/horticulturae7080257</mixed-citation><mixed-citation xml:lang="en">Mohamed M. H. M., Petropoulos S. A., Ali M. M. E. The Application of Nitrogen Fertilization and Foliar Spraying with Calcium and Boron Affects Growth Aspects, Chemical Composition, Productivity and Fruit Quality of Strawberry Plants. Horticulturae. 2021;7(8):257. doi: 10.3390/horticulturae7080257</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">Cvelbar Weber N., Koron D., Jakopič J., Veberič R., Hudina M., Baša Česnik H. Influence of Nitrogen, Calcium and Nano-Fertilizer on Strawberry (Fragaria × ananassa Duch.) Fruit Inner and Outer Quality. Agronomy. 2021;11(5):997. doi: 10.3390/agronomy11050997</mixed-citation><mixed-citation xml:lang="en">Cvelbar Weber N., Koron D., Jakopič J., Veberič R., Hudina M., Baša Česnik H. Influence of Nitrogen, Calcium and Nano-Fertilizer on Strawberry (Fragaria × ananassa Duch.) Fruit Inner and Outer Quality. Agronomy. 2021;11(5):997. doi: 10.3390/agronomy11050997</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">Sabatino L., D’Anna F., Prinzivalli C., Iapichino G. Soil Solarization and Calcium Cyanamide Affect Plant Vigor, Yield, Nutritional Traits, and Nutraceutical Compounds of Strawberry Grown in a Protected Cultivation System. Agronomy. 2019;9(9):513. doi: 10.3390/agronomy9090513</mixed-citation><mixed-citation xml:lang="en">Sabatino L., D’Anna F., Prinzivalli C., Iapichino G. Soil Solarization and Calcium Cyanamide Affect Plant Vigor, Yield, Nutritional Traits, and Nutraceutical Compounds of Strawberry Grown in a Protected Cultivation System. Agronomy. 2019;9(9):513. doi: 10.3390/agronomy9090513</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Kim H. M., Lee H. R., Kang J. H., Hwang S. J. Prohexadione-Calcium Application during Vegetative Growth Affects Growth of Mother Plants, Runners, and Runner Plants of Maehyang Strawberry. Agronomy. 2019;9(3):155. doi: 10.3390/agronomy9030155</mixed-citation><mixed-citation xml:lang="en">Kim H. M., Lee H. R., Kang J. H., Hwang S. J. Prohexadione-Calcium Application during Vegetative Growth Affects Growth of Mother Plants, Runners, and Runner Plants of Maehyang Strawberry. Agronomy. 2019;9(3):155. doi: 10.3390/agronomy9030155</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Cruz M., Mafra S., Teixeira E., Figueiredo F. Smart Strawberry Farming Using Edge Computing and IoT. Sensors. 2022;22(15):5866. doi: 10.3390/s22155866</mixed-citation><mixed-citation xml:lang="en">Cruz M., Mafra S., Teixeira E., Figueiredo F. Smart Strawberry Farming Using Edge Computing and IoT. Sensors. 2022;22(15):5866. doi: 10.3390/s22155866</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Basak J. K., Paudel B., Kim N. E., Deb N. C., Kaushalya Madhavi B. G., Kim H. T. Non-Destructive Estimation of Fruit Weight of Strawberry Using Machine Learning Models. Agronomy. 2022; 12(10):2487. doi: 10.3390/agronomy12102487</mixed-citation><mixed-citation xml:lang="en">Basak J. K., Paudel B., Kim N. E., Deb N. C., Kaushalya Madhavi B. G., Kim H. T. Non-Destructive Estimation of Fruit Weight of Strawberry Using Machine Learning Models. Agronomy. 2022; 12(10):2487. doi: 10.3390/agronomy12102487</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Ferentinos K. P. Deep learning models for plant disease detection and diagnosis. Computers and Electronics in Agriculture. 2018;145:311-318. doi: 10.1016/j.compag.2018.01.009</mixed-citation><mixed-citation xml:lang="en">Ferentinos K. P. Deep learning models for plant disease detection and diagnosis. Computers and Electronics in Agriculture. 2018;145:311-318. doi: 10.1016/j.compag.2018.01.009</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Vieira G. S., Fonseca A. U., Rocha B. M., Sousa N. M., Ferreira J. C., Felix J. P., Lima J. C., Soares F. Insect Predation Estimate Using Binary Leaf Models and Image-Matching Shapes. Agronomy. 2022;12(11):2769. doi: 10.3390/agronomy12112769</mixed-citation><mixed-citation xml:lang="en">Vieira G. S., Fonseca A. U., Rocha B. M., Sousa N. M., Ferreira J. C., Felix J. P., Lima J. C., Soares F. Insect Predation Estimate Using Binary Leaf Models and Image-Matching Shapes. Agronomy. 2022;12(11):2769. doi: 10.3390/agronomy12112769</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Zheng C., Abd-Elrahman A., Whitaker V. Remote Sensing and Machine Learning in Crop Phenotyping and Management, with an Emphasis on Applications in Strawberry Farming. Remote Sensing. 2021;13(3):531. doi: 10.3390/rs13030531</mixed-citation><mixed-citation xml:lang="en">Zheng C., Abd-Elrahman A., Whitaker V. Remote Sensing and Machine Learning in Crop Phenotyping and Management, with an Emphasis on Applications in Strawberry Farming. Remote Sensing. 2021;13(3):531. doi: 10.3390/rs13030531</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">Mahmud M. S., Zaman Q. U., Esau T. J., Chang Y. K., Price G. W., Prithiviraj B. Real-Time Detection of Strawberry Powdery Mildew Disease Using a Mobile Machine Vision System. Agronomy. 2020;10(7):1027. doi: 10.3390/agronomy10071027</mixed-citation><mixed-citation xml:lang="en">Mahmud M. S., Zaman Q. U., Esau T. J., Chang Y. K., Price G. W., Prithiviraj B. Real-Time Detection of Strawberry Powdery Mildew Disease Using a Mobile Machine Vision System. Agronomy. 2020;10(7):1027. doi: 10.3390/agronomy10071027</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">Khort D., Kutyrev A., Smirnov I., Osypenko V., Kiktev N. Computer vision system for recognizing the coordinates location and ripeness of strawberries. Communications in Computer and Information Science. 2020;1158:334-343. doi: 10.1007/978-3-030-61656-4_22</mixed-citation><mixed-citation xml:lang="en">Khort D., Kutyrev A., Smirnov I., Osypenko V., Kiktev N. Computer vision system for recognizing the coordinates location and ripeness of strawberries. Communications in Computer and Information Science. 2020;1158:334-343. doi: 10.1007/978-3-030-61656-4_22</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Maxwell A. E., Warner T. A., Guillén L. A. Accuracy Assessment in Convolutional Neural Network-Based Deep Learning Remote Sensing Studies - Part 1: Literature Review. Remote Sensing. 2021;13(13):2450. doi: 10.3390/rs13132450</mixed-citation><mixed-citation xml:lang="en">Maxwell A. E., Warner T. A., Guillén L. A. Accuracy Assessment in Convolutional Neural NetworkBased Deep Learning Remote Sensing Studies - Part 1: Literature Review. Remote Sensing. 2021;13(13):2450. doi: 10.3390/rs13132450</mixed-citation></citation-alternatives></ref><ref id="cit19"><label>19</label><citation-alternatives><mixed-citation xml:lang="ru">Maxwell A. E., Warner T. A., Guillén L. A. Accuracy Assessment in Convolutional Neural Network-Based Deep Learning Remote Sensing Studies - Part 2: Recommendations and Best Practices. Remote Sensing. 2021;13(13):2591. doi: 10.3390/rs13132591</mixed-citation><mixed-citation xml:lang="en">Maxwell A. E., Warner T. A., Guillén L. A. Accuracy Assessment in Convolutional Neural NetworkBased Deep Learning Remote Sensing Studies - Part 2: Recommendations and Best Practices. Remote Sensing. 2021;13(13):2591. doi: 10.3390/rs13132591</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
