Failure-Triggered VLM Diagnostics for Autonomous Precision Agriculture Missions
July 2026My research poster for my internship at IoT4Ag, where I developed a framework to diagnose failures in Vision-Language Models (VLMs) for autonomous precision agriculture missions executed by robots.
- Abstract: We employed a VLM to operate post-failure, producing structured, GPS-tagged diagnostic event reports that explain operational failures experienced by the agricultural robot during deployment. The result is a system that passively builds a detailed record of the robot’s difficulties during tasks paired with recommendations over the course of a mission, bridging the gap between robot perception and farmer decision-making.