Leveraging state of the art computer vision models for tree monitoring in silvopastoral systems
Silvopastoral systems allow the integration of trees with pastures offering a sustainable approach for livestock production. The effective monitoring of trees in this kind of system is essential for improved management in terms of productivity, follow-up, biomass estimation, livestock well-being, an...
| Main Authors: | , |
|---|---|
| Format: | Poster |
| Language: | Inglés |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10568/155547 |
| _version_ | 1855525708165545984 |
|---|---|
| author | Ruiz-Hurtado, Andres Felipe Cardoso, Juan Andres |
| author_browse | Cardoso, Juan Andres Ruiz-Hurtado, Andres Felipe |
| author_facet | Ruiz-Hurtado, Andres Felipe Cardoso, Juan Andres |
| author_sort | Ruiz-Hurtado, Andres Felipe |
| collection | Repository of Agricultural Research Outputs (CGSpace) |
| description | Silvopastoral systems allow the integration of trees with pastures offering a sustainable approach for livestock production. The effective monitoring of trees in this kind of system is essential for improved management in terms of productivity, follow-up, biomass estimation, livestock well-being, and environmental impact assessment. This study explores the application of recent advancements in artificial intelligence models for this purpose, particularly computer vision models applied to remote sensing imagery. Given the characteristic of the available data in the form of satellite and aerial RGB images, some models were tested for different computer vision tasks like tree detection, tree semantic segmentation and tree instance segmentation. These preliminary tasks can be used for subsequent analyses like tree counting, biomass estimation, and monitoring tree development. The general approach was to leverage pre-existing models, but depending on the model characteristics and data availability, different approaches were analyzed. Some of the tested models were specifically designed for tree analysis (DeepForest, DetectTree, TreeCrownDelineation, TreeFormer), others conformed a well-established computer vision architecture (U-Net, Mask R-CNN), and some of the most recent models were tested to assess their capabilities as foundation models (Segment Anything Model). According to the model’s capabilities, the methodology involved applying either model full training, transfer learning, out-of-the-box inference, or fine-tuning. Pre-trained models like U-Net are useful for semantic segmentation, while others like Mask R-CNN perform better for instance segmentation, and DeepForest for object detection. The most recent vision transformers were also compared. This work identifies the most promising models in terms of usability, acknowledging their advantages and limitations, and a user-friendly tool was developed to facilitate the application of these models in practice. |
| format | Poster |
| id | CGSpace155547 |
| institution | CGIAR Consortium |
| language | Inglés |
| publishDate | 2024 |
| publishDateRange | 2024 |
| publishDateSort | 2024 |
| record_format | dspace |
| spelling | CGSpace1555472025-11-05T11:42:41Z Leveraging state of the art computer vision models for tree monitoring in silvopastoral systems Ruiz-Hurtado, Andres Felipe Cardoso, Juan Andres remote sensing artificial intelligence silvopastoral systems inteligencia artificial imagery-computer vision imagen-visión por ordenador sensor sistema silvopascícola-sistemas silvopastorales Silvopastoral systems allow the integration of trees with pastures offering a sustainable approach for livestock production. The effective monitoring of trees in this kind of system is essential for improved management in terms of productivity, follow-up, biomass estimation, livestock well-being, and environmental impact assessment. This study explores the application of recent advancements in artificial intelligence models for this purpose, particularly computer vision models applied to remote sensing imagery. Given the characteristic of the available data in the form of satellite and aerial RGB images, some models were tested for different computer vision tasks like tree detection, tree semantic segmentation and tree instance segmentation. These preliminary tasks can be used for subsequent analyses like tree counting, biomass estimation, and monitoring tree development. The general approach was to leverage pre-existing models, but depending on the model characteristics and data availability, different approaches were analyzed. Some of the tested models were specifically designed for tree analysis (DeepForest, DetectTree, TreeCrownDelineation, TreeFormer), others conformed a well-established computer vision architecture (U-Net, Mask R-CNN), and some of the most recent models were tested to assess their capabilities as foundation models (Segment Anything Model). According to the model’s capabilities, the methodology involved applying either model full training, transfer learning, out-of-the-box inference, or fine-tuning. Pre-trained models like U-Net are useful for semantic segmentation, while others like Mask R-CNN perform better for instance segmentation, and DeepForest for object detection. The most recent vision transformers were also compared. This work identifies the most promising models in terms of usability, acknowledging their advantages and limitations, and a user-friendly tool was developed to facilitate the application of these models in practice. 2024-09-12 2024-10-24T04:51:32Z 2024-10-24T04:51:32Z Poster https://hdl.handle.net/10568/155547 en Open Access application/pdf Ruiz-Hurtado, A.F.; Cardoso, J.A. (2024) Leveraging state of the art computer vision models for tree monitoring in silvopastoral systems. Poster prepared for Tropentag: Explore opportunities... for managing natural resources and a better life for all, on 11-13 September 2024 in Vienna (Austria). 1 p. |
| spellingShingle | remote sensing artificial intelligence silvopastoral systems inteligencia artificial imagery-computer vision imagen-visión por ordenador sensor sistema silvopascícola-sistemas silvopastorales Ruiz-Hurtado, Andres Felipe Cardoso, Juan Andres Leveraging state of the art computer vision models for tree monitoring in silvopastoral systems |
| title | Leveraging state of the art computer vision models for tree monitoring in silvopastoral systems |
| title_full | Leveraging state of the art computer vision models for tree monitoring in silvopastoral systems |
| title_fullStr | Leveraging state of the art computer vision models for tree monitoring in silvopastoral systems |
| title_full_unstemmed | Leveraging state of the art computer vision models for tree monitoring in silvopastoral systems |
| title_short | Leveraging state of the art computer vision models for tree monitoring in silvopastoral systems |
| title_sort | leveraging state of the art computer vision models for tree monitoring in silvopastoral systems |
| topic | remote sensing artificial intelligence silvopastoral systems inteligencia artificial imagery-computer vision imagen-visión por ordenador sensor sistema silvopascícola-sistemas silvopastorales |
| url | https://hdl.handle.net/10568/155547 |
| work_keys_str_mv | AT ruizhurtadoandresfelipe leveragingstateoftheartcomputervisionmodelsfortreemonitoringinsilvopastoralsystems AT cardosojuanandres leveragingstateoftheartcomputervisionmodelsfortreemonitoringinsilvopastoralsystems |