Meet the Superhero Farm Robots in Training
go.ncsu.edu/readext?1115134
en Español / em Português
El inglés es el idioma de control de esta página. En la medida en que haya algún conflicto entre la traducción al inglés y la traducción, el inglés prevalece.
Al hacer clic en el enlace de traducción se activa un servicio de traducción gratuito para convertir la página al español. Al igual que con cualquier traducción por Internet, la conversión no es sensible al contexto y puede que no traduzca el texto en su significado original. NC State Extension no garantiza la exactitud del texto traducido. Por favor, tenga en cuenta que algunas aplicaciones y/o servicios pueden no funcionar como se espera cuando se traducen.
Português
Inglês é o idioma de controle desta página. Na medida que haja algum conflito entre o texto original em Inglês e a tradução, o Inglês prevalece.
Ao clicar no link de tradução, um serviço gratuito de tradução será ativado para converter a página para o Português. Como em qualquer tradução pela internet, a conversão não é sensivel ao contexto e pode não ocorrer a tradução para o significado orginal. O serviço de Extensão da Carolina do Norte (NC State Extension) não garante a exatidão do texto traduzido. Por favor, observe que algumas funções ou serviços podem não funcionar como esperado após a tradução.
English
English is the controlling language of this page. To the extent there is any conflict between the English text and the translation, English controls.
Clicking on the translation link activates a free translation service to convert the page to Spanish. As with any Internet translation, the conversion is not context-sensitive and may not translate the text to its original meaning. NC State Extension does not guarantee the accuracy of the translated text. Please note that some applications and/or services may not function as expected when translated.
Collapse ▲[View the original story by Robin Ann Smith at N.C. Plant Sciences Initiative News.]
In the Marvel Comics universe, Thor is known for wielding a magical hammer with superhuman stamina.
But at NC State University, Thor is a hammer-wielding robot in training for an earthly but backbreaking task: tending vegetables.
Grocery shoppers might not think about it, but the bulk of the fresh produce we buy in the supermarket is still tended and picked by hand. NC State researchers have been trying to do things a little differently, using AI and robots.
From her home office, N.C. Plant Sciences Initiative Makerspace Director Andrea Monteza proudly showed off a rendering of Thor and a second device, dubbed SpiderBot — for weaving twine — mounted on a self-driving frame about the size of a golf cart.
On-board stereo cameras act as the system’s eyes, giving it a 360-degree view of what is around. Its LiDAR laser sensors help it scan and map a field of crops and maneuver through variable terrain.
“It’s like how a Roomba uses cameras and sensors to create a floor plan of your house,” said NC State Extension vegetable specialist Emmanuel Torres, who is working with Monteza to bring the robots to life.
While machines now grow and harvest crops such as corn, wheat, soybeans and cotton, many fruit and vegetable farmers still rely on large numbers of human laborers, Torres said.
Take tomatoes and peppers. These vegetables get top-heavy as they grow. So farmers use supports like stakes and twine to keep them from toppling over onto the ground, where they become susceptible to blight.
To build this support system, workers drive thousands of tall stakes into the ground using heavy tools. They then run twine between the stakes, adding additional levels as the plants grow taller.
It’s a labor-intensive job representing a sizable expense in farm budgets. Yet it’s becoming harder to find workers willing to take it on.
Torres, an N.C. PSI faculty affiliate, and Monteza, a mechatronics engineer, want to see if robots could automate some of the more arduous and repetitive tasks.
Harnessing Super-Powered Tools
They have been developing prototypes for a suite of tools named after superheroes, each with unique abilities. Enter Thor. But for a tomato-staking robot to do its job properly, it must be able to hammer stakes in a precisely spaced way without damaging the plants.
To start building the intelligent tool they wanted, the researchers needed mountains of images of plants and other things a machine might encounter in farmers’ fields to train it to recognize, say, a tomato plant from a weed.
So they built another tool to streamline the process: the Hawkeye.
“We’re trying to make tools that are flexible enough for multiple potential uses.”
In the Marvel Universe, Hawkeye is an archer known for his keen eyesight and master marksmanship. At NC State, Hawkeye’s superpower is computer vision.
With support from the N.C General Assembly-funded Ag Analytics Platform and the U.S. Department of Agriculture, they came up with a tractor-mounted device equipped with low-cost computers and high-resolution, wide-lens cameras configured to capture top-down and side views of tomato plants.
The Hawkeye got its first test run last summer. The 50,000 images they collected will become the training data to make their AI algorithms smarter.
Eventually, Monteza said, the system could be used to automate the monitoring of fields for potential problems like pests, diseases and nutrient deficiencies. Traditionally, people must trek through fields and manually inspect a crop to monitor its health and see if there are any issues. A robot equipped with machine vision could automate the process.
“We’re trying to make tools that are flexible enough for multiple potential uses,” Monteza said.
Devising a Delicate Tomato Harvester
In late November, students in an electrical and computer engineering senior design course met Monteza at NC State’s horticultural field lab to test out their ideas for a robotic arm to do another type of work: picking tomatoes.
It sounds simple: their task was to design a system that can find and identify which tomatoes are ready for picking, pinpoint their locations and pluck them without squishing them.
“The beauty about machines is that they don’t need to stop, right? They can pick all day and into the night.”
That’s not easy for a machine. Tomatoes are not located in exactly the same places on every plant. One tomato might be in plain sight, another might be partially hidden or nestled among the leaves.
Electrical and computer engineering major Luke Holt showed off one of their designs. The device uses a mechanical arm guided by AI and a depth-sensing camera to scan plants and locate tomatoes, plus a silicone gripper to avoid damaging the fruit.
The tomato-harvesting robot features a soft silicone gripper attached to a mechanical arm that’s guided by artificial intelligence and a depth-sensing camera. Photo by Marc Hall.
Currently, humans can do the task much faster and more efficiently, but the students are trying to narrow the gap.
“The beauty about machines is that they don’t need to stop, right? They can pick all day and into the night,” Torres said.
Not all the robots being developed have a superhero namesake.
Another tool, in development with another N.C. PSI faculty affiliate, Lorena Lopez, is a device that could hoover up insects to help identify what kinds of pests are present in different crops. Lopez, an NC State Extension integrated pest management specialist with the Department of Entomology and Plant Pathology, happens to be Torres’ wife.
They hope to have the first prototype built by March.
“For now, we’re just calling it the bug vacuum,” Monteza said.