Curriculum learning and reward shaping for multi-robot navigation via deep reinforcement learning

Name: Nugroho, Rasyid Febrianto Adi

keyword: Autonomous multi-robot system

; Curriculum learning

; Deep reinforcement learning (DRL)

; Prioritized experience replay (PER)

; Reward shaping

; Twin-delayed deep deterministic policy gradient (TD3)

Abstract: Autonomous multi-robot navigation in unknown environments remains a challenging task, as robots must make real-time decisions under dynamic and partially observable conditions without relying on global information or inter-robot communication. In recent years, the use of mobile robots has significantly expanded across diverse fields, transforming automation and efficiency in applications such as manufacturing, warehousing, logistics, healthcare, and service industries. This study presents a deep reinforcement learning–based (DRL-based) framework for multi-robot navigation and exploration in unknown environments, addressing the limitations of traditional and hybrid path planning approaches that rely on predefined maps and then resulting high computational demands. The proposed framework employs the twin delayed deep deterministic policy gradient with prioritized experience replay (TD3-PER) to enhance learning efficiency and adaptability without requiring prior environmental information. To mitigate suboptimal navigation behaviors such as oscillations, stagnation, and local optima, a structured reward function was designed through reward shaping. Furthermore, a curriculum learning strategy was introduced to improve scalability and robustness as the number of robots increases, followed by a policy-switching mechanism that enables adaptive decision-making without inter-robot communication. Experimental results in a virtual environment show that the proposed framework reduces training time and improves success rate in various types of environments and scenarios. In exploration tasks, the switching model demonstrated the best balance between speed, stability, and fault tolerance. Overall, the findings establish that the integration of reinforcement learning, reward shaping, curriculum learning, and policy switching provides a scalable and robust foundation for multi-robot systems operating in unknown and dynamic environments.

Thammasat University. Thammasat University Library

Address: BANGKOK

Email: preserv@tu.ac.th

Name: Itthisek Nilkhamhang

Role: advisor

Created: 2025

Modified: 2026-04-24

Issued: 2026-04-24

วิทยานิพนธ์/Thesis

application/pdf

DOI: 10.14457/TU.the.2025.66

eng

DegreeName: Master of Engineering

Level: Master's Degree

Descipline: Engineering and Technology

Grantor: Thammasat University

©copyrights Thammasat University

ลำดับที่.	ชื่อแฟ้มข้อมูล	ขนาดแฟ้มข้อมูล	จำนวนเข้าถึง	วัน-เวลาเข้าถึงล่าสุด
1	337601Nugroho.pdf	10.53 MB

ใช้เวลา

0.03733 วินาที