A Survey of Robotic Harvesting Systems and Enabling Technologies

Overview

Journal J Intell Robot Syst

Date 2023 Feb 1

PMID 36721646

Authors

Leonidas Droukas

Zoe Doulgeri

Nikolaos L Tsakiridis

Dimitra Triantafyllou

Ioannis Kleitsiotis

Ioannis Mariolis

Dimitrios Giakoumis

Dimitrios Tzovaras

Dimitrios Kateris

Dionysis Bochtis

Affiliations

Soon will be listed here.

Abstract

This paper presents a comprehensive review of ground agricultural robotic systems and applications with special focus on harvesting that span research and commercial products and results, as well as their enabling technologies. The majority of literature concerns the development of crop detection, field navigation via vision and their related challenges. Health monitoring, yield estimation, water status inspection, seed planting and weed removal are frequently encountered tasks. Regarding robotic harvesting, apples, strawberries, tomatoes and sweet peppers are mainly the crops considered in publications, research projects and commercial products. The reported harvesting agricultural robotic solutions, typically consist of a mobile platform, a single robotic arm/manipulator and various navigation/vision systems. This paper reviews reported development of specific functionalities and hardware, typically required by an operating agricultural robot harvester; they include (a) vision systems, (b) motion planning/navigation methodologies (for the robotic platform and/or arm), (c) Human-Robot-Interaction (HRI) strategies with 3D visualization, (d) system operation planning & grasping strategies and (e) robotic end-effector/gripper design. Clearly, automated agriculture and specifically autonomous harvesting via robotic systems is a research area that remains wide open, offering several challenges where new contributions can be made.

Citing Articles

Gripping Success Metric for Robotic Fruit Harvesting.

Seo D, Oh I Sensors (Basel). 2025; 25(1.

PMID: 39796972 PMC: 11723232. DOI: 10.3390/s25010181.

LESA-Net: Semantic segmentation of multi-type road point clouds in complex agroforestry environment.

Duan Y, Wu D, Meng L, Meng Y, Zhu J, Zhang J Heliyon. 2024; 10(17):e36814.

PMID: 39296190 PMC: 11408797. DOI: 10.1016/j.heliyon.2024.e36814.

Application of Machine Vision Techniques in Low-Cost Devices to Improve Efficiency in Precision Farming.

Jaramillo-Hernandez J, Julian V, Marco-Detchart C, Rincon J Sensors (Basel). 2024; 24(3).

PMID: 38339654 PMC: 10857338. DOI: 10.3390/s24030937.

Rapid Determination of Wine Grape Maturity Level from pH, Titratable Acidity, and Sugar Content Using Non-Destructive In Situ Infrared Spectroscopy and Multi-Head Attention Convolutional Neural Networks.

Kalopesa E, Gkrimpizis T, Samarinas N, Tsakiridis N, Zalidis G Sensors (Basel). 2023; 23(23).

PMID: 38067909 PMC: 10708745. DOI: 10.3390/s23239536.

Human-Robot Interaction in Agriculture: A Systematic Review.

Benos L, Moysiadis V, Kateris D, Tagarakis A, Busato P, Pearson S Sensors (Basel). 2023; 23(15).

PMID: 37571559 PMC: 10422385. DOI: 10.3390/s23156776.

References

Fernandez-Novales J, Garde-Cerdan T, Tardaguila J, Gutierrez-Gamboa G, Perez-Alvarez E, Diago M . Assessment of amino acids and total soluble solids in intact grape berries using contactless Vis and NIR spectroscopy during ripening. Talanta. 2019; 199:244-253. DOI: 10.1016/j.talanta.2019.02.037. View

Williams D, Britten A, McCallum S, Jones H, Aitkenhead M, Karley A . A method for automatic segmentation and splitting of hyperspectral images of raspberry plants collected in field conditions. Plant Methods. 2017; 13:74. PMC: 5664591. DOI: 10.1186/s13007-017-0226-y. View

Shafiekhani A, Kadam S, Fritschi F, DeSouza G . Vinobot and Vinoculer: Two Robotic Platforms for High-Throughput Field Phenotyping. Sensors (Basel). 2017; 17(1). PMC: 5298785. DOI: 10.3390/s17010214. View

Kirk R, Cielniak G, Mangan M . L*a*b*Fruits: A Rapid and Robust Outdoor Fruit Detection System Combining Bio-Inspired Features with One-Stage Deep Learning Networks. Sensors (Basel). 2020; 20(1). PMC: 6983004. DOI: 10.3390/s20010275. View

Mazzia V, Comba L, Khaliq A, Chiaberge M, Gay P . UAV and Machine Learning Based Refinement of a Satellite-Driven Vegetation Index for Precision Agriculture. Sensors (Basel). 2020; 20(9). PMC: 7249115. DOI: 10.3390/s20092530. View

Szczepaniak J, Tanas W, Pawlowski T, Kromulski J . Modelling of agricultural combination driver behaviour from the aspect of safety of movement. Ann Agric Environ Med. 2014; 21(2):403-6. DOI: 10.5604/1232-1966.1108613. View

Arad B, Kurtser P, Barnea E, Harel B, Edan Y, Ben-Shahar O . Controlled Lighting and Illumination-Independent Target Detection for Real-Time Cost-Efficient Applications. The Case Study of Sweet Pepper Robotic Harvesting. Sensors (Basel). 2019; 19(6). PMC: 6470490. DOI: 10.3390/s19061390. View

Fountas S, Mylonas N, Malounas I, Rodias E, Hellmann Santos C, Pekkeriet E . Agricultural Robotics for Field Operations. Sensors (Basel). 2020; 20(9). PMC: 7273211. DOI: 10.3390/s20092672. View

Tang Y, Chen M, Wang C, Luo L, Li J, Lian G . Recognition and Localization Methods for Vision-Based Fruit Picking Robots: A Review. Front Plant Sci. 2020; 11:510. PMC: 7250149. DOI: 10.3389/fpls.2020.00510. View

10.

Fernandez R, Salinas C, Montes H, Sarria J . Multisensory system for fruit harvesting robots. Experimental testing in natural scenarios and with different kinds of crops. Sensors (Basel). 2015; 14(12):23885-904. PMC: 4299092. DOI: 10.3390/s141223885. View

11.

Mink R, Linn A, Santel H, Gerhards R . Sensor-based evaluation of maize (Zea mays) and weed response to post-emergence herbicide applications of Isoxaflutole and Cyprosulfamide applied as crop seed treatment or herbicide mixing partner. Pest Manag Sci. 2019; 76(5):1856-1865. DOI: 10.1002/ps.5715. View

12.

Sa I, Ge Z, Dayoub F, Upcroft B, Perez T, McCool C . DeepFruits: A Fruit Detection System Using Deep Neural Networks. Sensors (Basel). 2016; 16(8). PMC: 5017387. DOI: 10.3390/s16081222. View

13.

Christiansen P, Nielsen L, Steen K, Jorgensen R, Karstoft H . DeepAnomaly: Combining Background Subtraction and Deep Learning for Detecting Obstacles and Anomalies in an Agricultural Field. Sensors (Basel). 2016; 16(11). PMC: 5134563. DOI: 10.3390/s16111904. View

14.

Zhang T, Huang Z, You W, Lin J, Tang X, Huang H . An Autonomous Fruit and Vegetable Harvester with a Low-Cost Gripper Using a 3D Sensor. Sensors (Basel). 2019; 20(1). PMC: 6982854. DOI: 10.3390/s20010093. View

15.

Gu Y, Li Z, Zhang Z, Li J, Chen L . Path Tracking Control of Field Information-Collecting Robot Based on Improved Convolutional Neural Network Algorithm. Sensors (Basel). 2020; 20(3). PMC: 7038679. DOI: 10.3390/s20030797. View

16.

Hasan M, Chopin J, Laga H, Miklavcic S . Detection and analysis of wheat spikes using Convolutional Neural Networks. Plant Methods. 2018; 14:100. PMC: 6236889. DOI: 10.1186/s13007-018-0366-8. View

17.

Lin G, Tang Y, Zou X, Xiong J, Li J . Guava Detection and Pose Estimation Using a Low-Cost RGB-D Sensor in the Field. Sensors (Basel). 2019; 19(2). PMC: 6359182. DOI: 10.3390/s19020428. View

18.

Virlet N, Sabermanesh K, Sadeghi-Tehran P, Hawkesford M . Field Scanalyzer: An automated robotic field phenotyping platform for detailed crop monitoring. Funct Plant Biol. 2020; 44(1):143-153. DOI: 10.1071/FP16163. View

19.

Proto A, Zimbalatti G . Risk assessment of repetitive movements in the citrus fruit industry. J Agric Saf Health. 2010; 16(4):219-28. DOI: 10.13031/2013.34834. View

20.

Kang H, Chen C . Fruit Detection and Segmentation for AppleHarvesting Using Visual Sensor in Orchards. Sensors (Basel). 2019; 19(20). PMC: 6832306. DOI: 10.3390/s19204599. View