The International Journal of Advanced Manufacturing Technology - Experiment 2

The International Journal of Advanced Manufacturing Technology
Kevin Braathen de Carvalho, Daniel Khede Dourado Villa, Mário Sarcinelli-Filho & Alexandre Santos Brandão
The International Journal of Advanced Manufacturing Technology, 118(5), 1999-2015. Publication year: 2022
Abstract
This work presents a solution for the teleoperation of a heterogeneous team of mobile robots. Regarding the team of robots, two possibilities are considered which are UAV-UGV (Unmanned Aerial Vehicle-Unmanned Ground Vehicle) and UAV-UAV. To execute this task, high-level gesture patterns are made in a remote station, and we proposed an easy-to-train Artificial Neural Network (ANN) classifier to identify the skeletal data extracted by an RGB-D (Red, Green, Blue-Depth) camera. Our classifier uses custom data to build the gesture patterns, allowing the use of smooth and intuitive gestures for the teleoperation of mobile robots. To validate our proposal, experiments were run using two off-the-shelf Parrot AR.Drone 2 quadrotors and the differential drive platform Pioneer 3-DX. The results of such experiments allow concluding that the proposed teleoperation system is able to accomplish inspection/surveillance tasks, and it can be easily modified to similar applications, as emergency response or load transportation.
Read our manuscript at: doi.org/10.100...
00:15: Start of the Experiment
Cite us with following bibtex:
@article{de2022gestures,
title={Gestures-teleoperation of a heterogeneous multi-robot system},
author={de Carvalho, Kevin Braathen and Villa, Daniel Khede Dourado and Sarcinelli-Filho, Mario and Brandao, Alexandre Santos},
journal={The International Journal of Advanced Manufacturing Technology},
volume={118},
number={5},
pages={1999--2015},
year={2022},
publisher={Springer}
}