Convolutional Neural Net-Based Cassava Storage Root Counting Using Real and Synthetic Images
Cassava roots are complex structures comprising several distinct types of root. The number and size of the storage roots are two potential phenotypic traits reflecting crop yield and quality. Counting and measuring the size of cassava storage roots are usually done manually, or semi-automatically by...
| Autores principales: | , , , , |
|---|---|
| Formato: | Journal Article |
| Lenguaje: | Inglés |
| Publicado: |
Frontiers Media
2019
|
| Materias: | |
| Acceso en línea: | https://hdl.handle.net/10568/106629 |
| _version_ | 1855534885056282624 |
|---|---|
| author | Atanbori, John Montoya Pizarro, Maria Elker Selvaraj, Michael Gomez French, Andrew P. Pridmore, Tony P. |
| author_browse | Atanbori, John French, Andrew P. Montoya Pizarro, Maria Elker Pridmore, Tony P. Selvaraj, Michael Gomez |
| author_facet | Atanbori, John Montoya Pizarro, Maria Elker Selvaraj, Michael Gomez French, Andrew P. Pridmore, Tony P. |
| author_sort | Atanbori, John |
| collection | Repository of Agricultural Research Outputs (CGSpace) |
| description | Cassava roots are complex structures comprising several distinct types of root. The number and size of the storage roots are two potential phenotypic traits reflecting crop yield and quality. Counting and measuring the size of cassava storage roots are usually done manually, or semi-automatically by first segmenting cassava root images. However, occlusion of both storage and fibrous roots makes the process both time-consuming and error-prone. While Convolutional Neural Nets have shown performance above the state-of-the-art in many image processing and analysis tasks, there are currently a limited number of Convolutional Neural Net-based methods for counting plant features. This is due to the limited availability of data, annotated by expert plant biologists, which represents all possible measurement outcomes. Existing works in this area either learn a direct image-to-count regressor model by regressing to a count value, or perform a count after segmenting the image. We, however, address the problem using a direct image-to-count prediction model. This is made possible by generating synthetic images, using a conditional Generative Adversarial Network (GAN), to provide training data for missing classes. We automatically form cassava storage root masks for any missing classes using existing ground-truth masks, and input them as a condition to our GAN model to generate synthetic root images. We combine the resulting synthetic images with real images to learn a direct image-to-count prediction model capable of counting the number of storage roots in real cassava images taken from a low cost aeroponic growth system. These models are used to develop a system that counts cassava storage roots in real images. Our system first predicts age group ('young' and 'old' roots; pertinent to our image capture regime) in a given image, and then, based on this prediction, selects an appropriate model to predict the number of storage roots. We achieve 91% accuracy on predicting ages of storage roots, and 86% and 71% overall percentage agreement on counting 'old' and 'young' storage roots respectively. Thus we are able to demonstrate that synthetically generated cassava root images can be used to supplement missing root classes, turning the counting problem into a direct image-to-count prediction task. |
| format | Journal Article |
| id | CGSpace106629 |
| institution | CGIAR Consortium |
| language | Inglés |
| publishDate | 2019 |
| publishDateRange | 2019 |
| publishDateSort | 2019 |
| publisher | Frontiers Media |
| publisherStr | Frontiers Media |
| record_format | dspace |
| spelling | CGSpace1066292025-03-13T09:44:57Z Convolutional Neural Net-Based Cassava Storage Root Counting Using Real and Synthetic Images Atanbori, John Montoya Pizarro, Maria Elker Selvaraj, Michael Gomez French, Andrew P. Pridmore, Tony P. cassava manihot esculenta roots phenotypic yields Cassava roots are complex structures comprising several distinct types of root. The number and size of the storage roots are two potential phenotypic traits reflecting crop yield and quality. Counting and measuring the size of cassava storage roots are usually done manually, or semi-automatically by first segmenting cassava root images. However, occlusion of both storage and fibrous roots makes the process both time-consuming and error-prone. While Convolutional Neural Nets have shown performance above the state-of-the-art in many image processing and analysis tasks, there are currently a limited number of Convolutional Neural Net-based methods for counting plant features. This is due to the limited availability of data, annotated by expert plant biologists, which represents all possible measurement outcomes. Existing works in this area either learn a direct image-to-count regressor model by regressing to a count value, or perform a count after segmenting the image. We, however, address the problem using a direct image-to-count prediction model. This is made possible by generating synthetic images, using a conditional Generative Adversarial Network (GAN), to provide training data for missing classes. We automatically form cassava storage root masks for any missing classes using existing ground-truth masks, and input them as a condition to our GAN model to generate synthetic root images. We combine the resulting synthetic images with real images to learn a direct image-to-count prediction model capable of counting the number of storage roots in real cassava images taken from a low cost aeroponic growth system. These models are used to develop a system that counts cassava storage roots in real images. Our system first predicts age group ('young' and 'old' roots; pertinent to our image capture regime) in a given image, and then, based on this prediction, selects an appropriate model to predict the number of storage roots. We achieve 91% accuracy on predicting ages of storage roots, and 86% and 71% overall percentage agreement on counting 'old' and 'young' storage roots respectively. Thus we are able to demonstrate that synthetically generated cassava root images can be used to supplement missing root classes, turning the counting problem into a direct image-to-count prediction task. 2019-11 2020-01-20T18:43:20Z 2020-01-20T18:43:20Z Journal Article https://hdl.handle.net/10568/106629 en Open Access Frontiers Media Atanbori, John; Montoya-P, Maria Elker; Selvaraj, Michael ; French, Andrew P. & Pridmore, Tony P. (2019). Convolutional Neural Net-Based Cassava Storage Root Counting Using Real and Synthetic Images. Frontier in Plant Science. 10-1516 |
| spellingShingle | cassava manihot esculenta roots phenotypic yields Atanbori, John Montoya Pizarro, Maria Elker Selvaraj, Michael Gomez French, Andrew P. Pridmore, Tony P. Convolutional Neural Net-Based Cassava Storage Root Counting Using Real and Synthetic Images |
| title | Convolutional Neural Net-Based Cassava Storage Root Counting Using Real and Synthetic Images |
| title_full | Convolutional Neural Net-Based Cassava Storage Root Counting Using Real and Synthetic Images |
| title_fullStr | Convolutional Neural Net-Based Cassava Storage Root Counting Using Real and Synthetic Images |
| title_full_unstemmed | Convolutional Neural Net-Based Cassava Storage Root Counting Using Real and Synthetic Images |
| title_short | Convolutional Neural Net-Based Cassava Storage Root Counting Using Real and Synthetic Images |
| title_sort | convolutional neural net based cassava storage root counting using real and synthetic images |
| topic | cassava manihot esculenta roots phenotypic yields |
| url | https://hdl.handle.net/10568/106629 |
| work_keys_str_mv | AT atanborijohn convolutionalneuralnetbasedcassavastoragerootcountingusingrealandsyntheticimages AT montoyapizarromariaelker convolutionalneuralnetbasedcassavastoragerootcountingusingrealandsyntheticimages AT selvarajmichaelgomez convolutionalneuralnetbasedcassavastoragerootcountingusingrealandsyntheticimages AT frenchandrewp convolutionalneuralnetbasedcassavastoragerootcountingusingrealandsyntheticimages AT pridmoretonyp convolutionalneuralnetbasedcassavastoragerootcountingusingrealandsyntheticimages |