- Видео 23
- Просмотров 4 108
Drexel Zhou Robotics Lab
Добавлен 22 июл 2022
Hierarchical LLMs In-the-loop Optimization for Real-time Multi-Robot Target Tracking Unknown Hazards
Paper available at: arxiv.org/abs/2409.12274
Abstract:
In this paper, we propose a hierarchical Large Language Models (LLMs) in-the-loop optimization framework for real-time multi-robot task allocation and target tracking in an unknown hazardous environment subject to sensing and communication attacks. We formulate multi-robot coordination for tracking tasks as a bi-level optimization problem, with LLMs to reason about potential hazards in the environment and the status of the robot team and modify both the inner and outer levels of the optimization. The inner LLM adjusts parameters to prioritize various objectives, including performance, safety, and energy efficiency, while the outer LLM h...
Abstract:
In this paper, we propose a hierarchical Large Language Models (LLMs) in-the-loop optimization framework for real-time multi-robot task allocation and target tracking in an unknown hazardous environment subject to sensing and communication attacks. We formulate multi-robot coordination for tracking tasks as a bi-level optimization problem, with LLMs to reason about potential hazards in the environment and the status of the robot team and modify both the inner and outer levels of the optimization. The inner LLM adjusts parameters to prioritize various objectives, including performance, safety, and energy efficiency, while the outer LLM h...
Просмотров: 159
Видео
Resilient and Adaptive Replanning for Multi-Robot Target Tracking with Sensing and Comm Danger Zone
Просмотров 56Месяц назад
Paper available at: arxiv.org/abs/2409.11230 Abstract: Multi-robot collaboration for target tracking presents significant challenges in hazardous environments, including addressing robot failures, dynamic priority changes, and other unpredictable factors. Moreover, these challenges are increased in adversarial settings if the environment is unknown. In this paper, we propose a resilient and ada...
An Energy-Aware Routing Algorithm for Mobile Ground-to-Air Charging
Просмотров 1043 месяца назад
Paper: arxiv.org/abs/2310.07729 Abstract: We investigate the problem of energy-constrained planning for a cooperative system of an Unmanned Ground Vehicles (UGV) and an Unmanned Aerial Vehicle (UAV). In scenarios where the UGV serves as a mobile base to ferry the UAV and as a charging station to recharge the UAV, we formulate a novel energy-constrained routing problem. To tackle this problem, w...
RSS2024: Dynamic Adversarial Attacks on Autonomous Driving Systems (v2)
Просмотров 2635 месяцев назад
Paper: arxiv.org/abs/2312.06701 Abstract: This paper introduces an attacking mechanism to challenge the resilience of autonomous driving systems. Specifically, we manipulate the decision-making processes of an autonomous vehicle by dynamically displaying adversarial patches on a screen mounted on another moving vehicle. These patches are optimized to deceive the object detection models into mis...
Challenges Faced by Large Language Models in Solving Multi-Agent Flocking
Просмотров 767 месяцев назад
Paper available at: arxiv.org/abs/2404.04752 Abstract: Flocking is a behavior where multiple agents in a system attempt to stay close to each other while avoiding collision and maintaining a desired formation. This is observed in the natural world and has applications in robotics, including natural disaster search and rescue, wild animal tracking, and perimeter surveillance and patrol. Recently...
Multi-Robot Target Tracking with Sensing and Communication Danger Zones
Просмотров 1367 месяцев назад
Paper available at: arxiv.org/abs/2404.07880 Abstract: Multi-robot target tracking finds extensive applications in different scenarios, such as environmental surveillance and wildfire management, which require the robustness of the practical deployment of multi-robot systems in uncertain and dangerous environments. Traditional approaches often focus on the performance of tracking accuracy with ...
Dynamic Adversarial Attacks on Autonomous Driving Systems
Просмотров 19111 месяцев назад
We introduce an attacking mechanism to challenge the resilience of autonomous driving systems. Specifically, we manipulate the decision-making processes of an autonomous vehicle by dynamically displaying adversarial patches on a screen mounted on another moving vehicle. These patches are optimized to deceive the object detection models into misclassifying targeted objects, e.g., traffic signs. ...
Monte-Carlo Tree Search for Behavior Planning in Autonomous Driving
Просмотров 370Год назад
Paper: arxiv.org/abs/2310.12075 Github: github.com/zhongshun/MCTS_for_Behavior_Planning Abstract: The integration of autonomous vehicles into urban and highway environments necessitates the development of robust and adaptable behavior planning systems. This study presents an innovative approach to address this challenge by utilizing a Monte-Carlo Tree Search (MCTS) based algorithm for autonomou...
Learning Decentralized Flocking Controllers with Spatio-Temporal Graph Neural Network
Просмотров 205Год назад
Paper link: arxiv.org/abs/2309.17437 Abstract: Recently a line of researchers has delved into the use of graph neural networks (GNNs) for decentralized control in swarm robotics. However, it has been observed that relying solely on the states of immediate neighbors is insufficient to imitate a centralized control policy. To address this limitation, prior studies proposed incorporating L-hop del...
IROS 2023: Assignment Algorithms for Multi-Robot Multi-Target Tracking
Просмотров 141Год назад
Paper: arxiv.org/abs/2303.04894 We study the problem of assigning robots with actions to track targets. The objective is to optimize the robot team's tracking quality which can be defined as the reduction in the uncertainty of the targets' states. Specifically, we consider two assignment problems given the different sensing capabilities of the robots. In the first assignment problem, a single r...
Autonomous drone landing with QR code detection
Просмотров 496Год назад
Autonomous drone landing with QR code detection
CoRL 2023: Large Language Models and Open-Vocabulary 3D Scene Graph for Autonomous Indoor Navigation
Просмотров 675Год назад
Paper: Context-Aware Entity Grounding with Open-Vocabulary 3D Scene Graphs. Link: openreview.net/forum?id=cjEI5qXoT0 Abstract: We present an Open-Vocabulary 3D Scene Graph (OVSG), a formal framework for grounding a variety of entities, such as object instances, agents, and regions, with free-form text-based queries. Unlike conventional semantic-based object localization approaches, our system f...
Assignment Algorithms for Multi-Robot Multi-Target Tracking with Sufficient and Limited Sensing
Просмотров 229Год назад
Assignment Algorithms for Multi-Robot Multi-Target Tracking with Sufficient and Limited Sensing
Active Target Tracking with Self-Triggered Communications in Multi-Robot Teams
Просмотров 392 года назад
Active Target Tracking with Self-Triggered Communications in Multi-Robot Teams
Sensor Assignment Algorithms to Improve Observability while Tracking Targets
Просмотров 202 года назад
Sensor Assignment Algorithms to Improve Observability while Tracking Targets
Resilient Active Target Tracking with Multiple Robots
Просмотров 262 года назад
Resilient Active Target Tracking with Multiple Robots
Resilient Coverage Exploring the Local to Global Trade off
Просмотров 92 года назад
Resilient Coverage Exploring the Local to Global Trade off
Distributed Attack Robust Submodular Maximization for Multi-Robot Planning
Просмотров 152 года назад
Distributed Attack Robust Submodular Maximization for Multi-Robot Planning
Adaptive and risk-aware target tracking for robot teams with heterogeneous sensors
Просмотров 252 года назад
Adaptive and risk-aware target tracking for robot teams with heterogeneous sensors
Introduction of Drexel ECE T580: Decision Making for Robotics
Просмотров 1382 года назад
Introduction of Drexel ECE T580: Decision Making for Robotics
ICRA?
That's so ironic, yet so cool
Can provide details on all the parts used please
Excuse me, I just saw your source code. You set MaxTimeHorizon as 2.0, does that mean we cannot go deeper than 2 or 3 in this algorithm?