Autonomous fruit harvesting requires not only accurate fruit detection but also the reliable transformation of uncertain visual observations into safe, efficient, and low-damage robotic harvesting actions. Achieving this objective remains challenging in commercial orchards because variable illumination, severe fruit occlusion, plant motion, and constrained workspaces introduce substantial uncertainty into both visual perception and robotic execution. In this review, we systematically synthesize recent advances in machine vision for fruit detection, segmentation, three-dimensional localization, pose estimation, and picking-point localization, and examine their integration with end-effector operation and hand–eye coordination in intelligent harvesting robots. We compare eye-in-hand, eye-to-hand, and hybrid vision configurations; two-dimensional and three-dimensional sensing modalities; machine-learning-, deep-learning-, and Transformer-based perception methods; and representative harvesting-system configurations. This review establishes an integrated perspective on the interactions among sensing, perception, motion planning, grasping, detachment, and feedback within a perception–action–interaction cycle. It highlights the transition from object-oriented detection to operation-oriented perception, which involves not only understanding the fruit position but also the attachment structure, approach direction, obstacles, interaction risk, and harvestability. There are several challenges to deployment in complex field conditions, including calibration drift, incomplete spatial information, limited end-effector adaptability, and accumulated perception-execution errors. Future harvesting systems will need to integrate multimodal sensing, active view planning, uncertainty-aware decision-making, visual servoing, and tactile-force feedback to enable autonomous fruit harvesting to be scalable and damage-aware.

Keywords

Fruit-harvesting robots

;

Machine vision

;

Fruit detection

;

Pose estimation

;

Picking-point localization

;

Hand-eye coordination

Sorry, something went wrong. Please try again and make sure cookies are enabled

Data availability

Data will be made available on request.

Cookie Preference Center

We use cookies which are necessary to make our site work. We may also use additional cookies to analyse, improve and personalise our content and your digital experience. For more information, see our Cookie Policy and the list of Google Ad-Tech Vendors.

You may choose not to allow some types of cookies. However, blocking some types may impact your experience of our site and the services we are able to offer. See the different category headings below to find out more or change your settings.

You may also be able to exercise your privacy choices Image 8: Cookie Settings | Your Privacy Choices as described in our Privacy Policy

Allow all

Manage Consent Preferences

Strictly Necessary Cookies

Always active

These cookies are necessary for the website to function and cannot be switched off in our systems. They are usually only set in response to actions made by you which amount to a request for services, such as setting your privacy preferences, logging in or filling in forms. You can set your browser to block or alert you about these cookies, but some parts of the site will not then work.

Cookie Details List

Functional Cookies

[x] Functional Cookies

These cookies enable the website to provide enhanced functionality and personalisation. They may be set by us or by third party providers whose services we have added to our pages. If you do not allow these cookies then some or all of these services may not function properly.

Cookie Details List

Performance Cookies

[x] Performance Cookies

These cookies allow us to count visits and traffic sources so we can measure and improve the performance of our site. They help us to know which pages are the most and least popular and see how visitors move around the site.

Cookie Details List

Contextual Advertising Cookies

[x] Contextual Advertising Cookies

These cookies are used for properly showing banner advertisements on our site and associated functions such as limiting the number of times ads are shown to each user.

Cookie Details List

Cookie List

Clear

- [x] checkbox label label

Apply Cancel

Consent Leg.Interest

[x] checkbox label label
[x] checkbox label label
[x] checkbox label label

Confirm my choices

论文原文与出版信息

Smart Agricultural Technology

查看论文原文

继续探索

技术

农业人工智能

其他

智慧农业采摘机器人机器视觉果实检测

智能采摘机器人中的果实检测与定位机器视觉：综述（Machine Vision for Fruit Detection and Localization in Intelligent Harvesting Robots: A Comprehensive Review）

论文解读

论文摘要

全文

Smart Agricultural Technology