Next Article in Journal
Factors Affecting the Indoor Air Quality and Occupants’ Thermal Comfort in Urban Agglomeration Regions in the Hot and Humid Climate of Pakistan
Previous Article in Journal
The Impact of Green Business Ethics and Green Financing on Sustainable Business Performance of Industries in Türkiye: The Mediating Role of Corporate Social Responsibility
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Optimizing Autonomous UAV Navigation with D* Algorithm for Sustainable Development

by
Pannee Suanpang
1,* and
Pitchaya Jamjuntr
2
1
Department of Information Technology, Faculty of Science & Technology, Suan Dusit University, Bangkok 10300, Thailand
2
Electronic and Telecommunication Engineering, Faculty of Engineering, King Mongkut’s University of Technology Thonburi, Bangkok 10140, Thailand
*
Author to whom correspondence should be addressed.
Sustainability 2024, 16(17), 7867; https://doi.org/10.3390/su16177867
Submission received: 23 July 2024 / Revised: 28 August 2024 / Accepted: 2 September 2024 / Published: 9 September 2024

Abstract

:
Autonomous navigation for Unmanned Aerial Vehicles (UAVs) has emerged as a critical enabler in various industries, from agriculture, delivery services, and surveillance to search and rescue operations. However, navigating UAVs in dynamic and unknown environments remains a formidable challenge. This paper explores the application of the D* algorithm, a prominent path-planning method rooted in artificial intelligence and widely used in robotics, alongside comparisons with other algorithms, such as A* and RRT*, to augment autonomous navigation capabilities in UAVs’ implication for sustainability development. The core problem addressed herein revolves around enhancing UAV navigation efficiency, safety, and adaptability in dynamic environments. The research methodology involves the integration of the D* algorithm into the UAV navigation system, enabling real-time adjustments and path planning that account for dynamic obstacles and evolving terrain conditions. The experimentation phase unfolds in simulated environments designed to mimic real-world scenarios and challenges. Comprehensive data collection, rigorous analysis, and performance evaluations paint a vivid picture of the D* algorithm’s efficacy in comparison to other navigation methods, such as A* and RRT*. Key findings indicate that the D* algorithm offers a compelling solution, providing UAVs with efficient, safe, and adaptable navigation capabilities. The results demonstrate a path planning efficiency improvement of 92%, a 5% reduction in collision rates, and an increase in safety margins by 2.3 m. This article addresses certain challenges and contributes by demonstrating the practical effectiveness of the D* algorithm, alongside comparisons with A* and RRT*, in enhancing autonomous UAV navigation and advancing aerial systems. Specifically, this study provides insights into the strengths and limitations of each algorithm, offering valuable guidance for researchers and practitioners in selecting the most suitable path-planning approach for their UAV applications. The implications of this research extend far and wide, with potential applications in industries such as agriculture, surveillance, disaster response, and more for sustainability.

1. Introduction

Unmanned Aerial Vehicles (UAVs) have emerged as versatile tools with applications spanning surveillance, agriculture, search and rescue, and delivery services [1,2,3]. A critical challenge in the deployment of UAVs is ensuring their capability for autonomous navigation in complex and dynamic environments. UAVs, colloquially known as drones, have soared beyond their origins in military applications to become indispensable tools in a wide array of industries [4,5]. From precision agriculture and environmental monitoring to infrastructure inspection and emergency response, UAVs have transcended boundaries, offering versatile solutions to complex challenges. The transformative impact of UAVs is underscored by their ability to reach remote or hazardous locations, gather data, and perform tasks efficiently and cost-effectively [6,7]. Yet, the key to unlocking the full potential of UAVs lies in autonomous navigation. Autonomous UAVs possess the capacity to make independent decisions, adapt to their surroundings, and navigate without constant human intervention [7]. This autonomy amplifies their utility across industries, allowing for tasks that range from crop monitoring and wildlife conservation to disaster assessment and aerial cinematography [8,9,10]. However, the path toward autonomous UAV navigation is fraught with challenges, particularly when confronted with dynamic and unknown environments [11,12]. These environments can be unpredictable, with obstacles that appear suddenly and variables that shift unexpectedly. Traditional navigation algorithms struggle to cope with these intricacies, leading to suboptimal paths, increased collision risks, and a reduced capacity to fulfill mission objectives [13].
The D* (D star) algorithm, initially developed for ground robots [14], has shown promise in path planning and navigation due to its dynamic re-planning capabilities. However, its application in UAVs presents unique challenges, such as the need for 3D path planning, consideration of aerial obstacles, and integration with UAV-specific sensors and control systems [14,15]. Additionally, the computational efficiency of the D* algorithm is critical for real-time applications in UAVs, where processing power and energy resources are limited. The crux of this paper lies in addressing these challenges head-on. Our mission is to explore the transformative potential of the D* algorithm, a path-planning method rooted in the field of robotics and artificial intelligence [16]. Thus, the aim of this paper is to harness the power of the D* algorithm to enhance UAV navigation capabilities, particularly in scenarios where adaptability, real-time adjustments, and safety are paramount.
In the following sections, we explore the integration of the D* algorithm into UAV navigation systems. We delve into the intricacies of this algorithm, its adaptability to dynamic obstacles, and its ability to recalibrate paths in real time [16,17]. Through meticulous experimentation in simulated environments that mimic the complexities of the real world, we scrutinize the D* algorithm’s performance and compare it against other established navigation methods [18,19].

1.1. Purpose of the Study

The purpose of this study is to showcase the tangible benefits of implementing the D* algorithm in enhancing UAVs’ navigation efficiency and safety. By conducting comprehensive experiments and analyses, this research reveals the algorithm’s capabilities and limitations in dynamic and unknown environments.
This paper’s objective is to explore the application of the D* algorithm, a prominent path-planning method rooted in artificial intelligence and widely used in robotics, alongside comparisons with other algorithms, such as A* and RRT*, to augment autonomous navigation capabilities in UAVs for sustainability development.
Moreover, this research is to provide practical insights into the integration process of the D* algorithm into UAV navigation systems. This involves meticulously detailing the algorithmic considerations and hardware configurations necessary for seamless implementation. By addressing the technical aspects, our aim is to facilitate the adoption of the D* algorithm by UAV developers, researchers, and practitioners. This secondary objective complements the primary goal by ensuring that the transformative potential of the D* algorithm is not only understood but also practically applied, contributing to the advancement of autonomous UAV capabilities in real-world scenarios.

1.2. Problem Statement

The rapid expansion of UAV applications across various industries has highlighted a critical challenge: the need for highly adaptable and reliable autonomous navigation systems. Current navigation methods, such as waypoint following, often fall short in dynamic and unpredictable environments, particularly when dealing with complex terrains and obstacles [20]. While control methods like PID controllers are essential for ensuring efficient movement along a selected trajectory, they do not address the core issue of how to determine that trajectory in the first place, especially in real time and in the presence of unforeseen obstacles. The core problem, therefore, is determining how UAVs can achieve autonomous navigation that is both highly adaptable and capable of making real-time adjustments, ensuring collision-free path planning in these challenging and unknown environments.
This paper seeks to bridge the critical gap identified by this research question by exploring the transformative potential of the D* algorithm, a path-planning methodology grounded in robotics and artificial intelligence [20,21]. The primary challenge is to develop an autonomous navigation framework that enables UAVs to navigate independently through a wide range of scenarios, including cluttered environments, dynamic obstacles, and diverse terrains. The complexity of real-world landscapes demands a navigation solution that not only overcomes the limitations of current algorithms but also seamlessly integrates autonomy, adaptability, and safety [21].
There is a situation where UAVs are increasingly being integrated into various industries, but current navigation systems, such as waypoint following and PID controllers, struggle to operate effectively in dynamic and unpredictable environments. The available data shows significant limitations in these systems, particularly in dealing with complex terrains and obstacles. Therefore, there is a need to develop new autonomous navigation actions that do not yet exist, specifically a framework that enhances UAVs’ adaptability, allows real-time adjustments, and ensures collision-free path planning. Following this, the paper will discuss the methods for solving this problem by exploring the potential of the D* algorithm as a solution to these challenges [22,23].

1.3. Challenges and Solution Proposal

As the integration of UAVs continues to expand across diverse industries, the demand for robust autonomous navigation systems becomes increasingly urgent. Conventional navigation methods, such as waypoint following and PID controllers [24], have proven insufficient in addressing the complexities of dynamic and unpredictable environments, leaving a critical gap in the effective deployment of UAVs [25].
This paper’s proposed solution centers around the application of the D* algorithm, a path-planning methodology deeply rooted in robotics and artificial intelligence. This algorithm is poised to revolutionize autonomous navigation for UAVs by providing heightened adaptability, real-time adjustments, and collision-free path planning capabilities in dynamic and unknown environments [23,24,25].
The transformative potential of the D* algorithm lies in its dynamic path planning and adjustment features. Unlike traditional methods, the D* algorithm takes into account real-time changes in the environment, enabling UAVs to adapt swiftly to evolving conditions. This is particularly crucial in scenarios with complex terrains, dynamic obstacles, and cluttered environments, where traditional algorithms often fall short [24,26]. By integrating the D* algorithm into the navigation framework of UAVs, we propose a solution that empowers these vehicles to navigate autonomously through diverse and challenging scenarios. The algorithm’s emphasis on collision-free navigation aligns with the safety requirements essential for UAV operations. Moreover, its efficiency in recalibrating paths in real time addresses the need for adaptability, ensuring optimal performance even in the face of unexpected obstacles or changes in terrain [27,28].
Through meticulous experimentation and analysis in simulated environments mirroring real-world complexities, our research demonstrates the efficacy of the D* algorithm in comparison to conventional navigation methods. The key findings, including improved path planning efficiency, reduced collision rates, and increased safety margins, underscore the potential of our proposed solution [29,30].
The implementation of the D* algorithm in UAV navigation systems offers a pathway to overcoming the limitations of existing algorithms, providing a seamless integration of autonomy, adaptability, and safety. The implications of this solution extend across industries, from agriculture and surveillance to disaster response, where UAVs equipped with the D* algorithm can redefine the capabilities of autonomous systems [27,31].

1.4. Conributions

This research significantly advances the domain of autonomous navigation in UAVs by leveraging and refining the D* algorithm [32,33,34] within the simulation framework. The key contributions of this paper can be summarized as follows:
  • Simulation-Based Comparative Analysis with Established Navigation Methods: This paper provides a comprehensive comparative analysis between the D* algorithm and other well-established navigation methods used in UAVs, namely, A* (A-Star), RRT* (Rapidly Exploring Random Trees), and SLAM (Simultaneous Localization and Mapping) [35]. This comparative study specifically elucidates the strengths of the D* algorithm within the context of simulation, particularly in scenarios demanding real-time adjustments and safety-critical missions [36,37].
  • Simulation-Driven Evaluation Across Diverse Scenarios and Challenges: To evaluate the algorithm’s practical applicability, this research defines and addresses a diverse set of simulated scenarios and challenges [38]. These include obstacle avoidance, dynamic obstacle interactions, terrain adaptation, weather resilience, and localization challenges. The experimentation framework measures the algorithm’s performance under conditions mirroring real-world complexities, albeit within the controlled environment of simulations.
  • Detailed Documentation of Simulation Environments: This paper provides an extensive overview of the simulated test environments used for experimentation, including their size, terrain types, weather conditions, and lighting variations [39]. This contribution ensures transparency in the research methodology within the simulation context and allows for the replication and validation of the results in simulated settings [40,41].
This paper contributes a demonstration of the D* algorithm’s potential to enhance autonomous UAV navigation within the simulation paradigm. It provides insights into its adaptability, real-time adjustments, and safety features within controlled virtual environments [33,34,36]. The findings presented herein contribute to the advancement of navigation methodologies for UAVs, specifically within the simulation domain, with implications for diverse applications.
The study begins with an overview of the integration of UAVs in various industries and the challenges of autonomous navigation in dynamic environments. It aims to address these challenges by leveraging the benefits of the D* algorithm. The literature review highlights existing UAV navigation algorithms’ limitations and the D* algorithm’s potential, identifying gaps in the current research. The theoretical framework explains the principles of the D* algorithm and its alignment with UAV navigation requirements. In the summary of the methodology, the simulation setup, algorithm integration, and experimental scenarios are described. The section on data collection and analysis outlines the process of simulating data and presents the comparative analysis results. The results and discussion emphasize the D* algorithm’s efficacy in enhancing UAV navigation and address encountered limitations. Finally, the recommendations for future research work suggest avenues for further research and real-world testing, ensuring continuous improvement and practical implementation of the algorithm in UAV navigation systems.

2. Literature Review

2.1. Unmanned Aerial Vehicles (UAVs)

The literature review highlights the rapid evolution and widespread adoption of UAVs across various industries, a trend fueled by significant technological advancements [30,39]. Initially developed primarily for military purposes, UAVs have progressively infiltrated civilian and commercial sectors, offering versatile solutions in fields such as surveillance, agriculture, search and rescue, infrastructure inspection, environmental monitoring, and delivery services [27]. Enhanced with sophisticated sensors and imaging capabilities, UAVs serve as valuable tools for real-time data collection and analysis, empowering decision-making processes in diverse domains [42,43]. Despite their considerable benefits, challenges related to safety, privacy, and regulatory compliance persist, underscoring the need for comprehensive frameworks to ensure the effective and ethical operation of UAVs [44]. Moreover, the study categorizes UAV path planning algorithms into several types, including classical methods (e.g., grid-based, geometric methods), sampling-based methods (e.g., Rapidly Exploring Random Trees, Probabilistic Roadmaps), heuristic approaches (e.g., A* algorithm), and bio-inspired algorithms (e.g., genetic algorithms, particle swarm optimization). Each category has distinct advantages depending on the specific requirements of the UAV mission [39]. Various path planning algorithms are reviewed, focusing on their applicability in communication network scenarios. This paper categorizes these solutions into centralized, distributed, and hybrid approaches, each with its benefits and trade-offs in terms of efficiency, scalability, and robustness [44,45].
The reviewed papers collectively examine the integration of UAVs into a range of critical applications, including communication networks, urban surveillance, weather monitoring, and smart city management [46]. They emphasize the crucial role of efficient path planning, real-time data processing, and robust system architectures in enhancing UAV performance within dynamic environments. Key challenges identified include energy constraints, data security, and the necessity for adaptive algorithms, while opportunities for innovation are noted in areas such as machine learning and AI-driven decision-making [47]. These findings highlight the increasing importance of UAVs in enhancing connectivity, surveillance, and emergency response in contemporary urban settings [48]. In summary, UAVs continue to revolutionize industries and stimulate innovation, heralding a future where A autonomous UAVs will assume pivotal roles across various applications [46,47,48].
Figure 1 illustrates a reinforcement learning model. It features a “Deep Agent”, represented by a deep neural network, which processes states and decides on actions. The environment provides the current state (1) to the agent. The agent then outputs an action (2) affecting the environment. The environment responds with a reward (3) and the next state, forming a feedback loop to optimize the agent’s decision-making.

2.2. UAV Navigation Algorithms

The field of UAVs has experienced remarkable growth, largely driven by their widespread integration across diverse industries. Central to the operational autonomy of UAVs are navigation algorithms, which play a pivotal role in determining their ability to navigate complex environments, avoid obstacles, and effectively achieve mission objectives. Through an extensive exploration of existing literature, a diverse spectrum of UAV navigation methodologies emerges, each offering unique advantages and tailored solutions. Classical navigation methods, including waypoint navigation, terrain following, and line-of-sight navigation, provide established frameworks suitable for specific operational scenarios [47,48,49]. Meanwhile, optimization-based algorithms leverage mathematical models such as the A* search algorithm and dynamic programming to optimize paths by considering factors such as distance, fuel consumption, and obstacle avoidance [50,51,52,53]. Bio-inspired navigation approaches draw inspiration from biological systems, offering adaptability and resilience in dynamic environments [54,55,56,57]. Additionally, machine learning and deep learning techniques utilize vast datasets of sensor information to enable real-time adaptation and robust obstacle avoidance [58,59,60]. Collectively, these diverse navigation methodologies underscore the expansive landscape of research and development in UAV navigation, indicating the potential for increasingly sophisticated systems poised to redefine applications across diverse domains as technology continues to evolve.

2.3. Limitations of Existing Navigation Algorithms

While conventional algorithms such as waypoint following and PID controllers played a pivotal role in early UAV navigation, they exhibit inherent limitations when confronted with dynamic and unstructured environments. These limitations encompass challenges such as suboptimal path planning, vulnerability to obstacle collisions, and limited adaptability to changing conditions. The need for more robust and versatile navigation solutions becomes apparent as UAVs are increasingly tasked with missions in unpredictable settings [61,62]. Specific limitations and corresponding research further highlight these challenges, and innovative solutions have been proposed. For instance, Gao et al. [53] address the issue of suboptimal path planning by introducing a hybrid algorithm combining A* search and reinforcement learning, significantly improving path efficiency while handling dynamic obstacles. Additionally, the vulnerability to obstacle collisions is tackled through a real-time obstacle avoidance framework utilizing deep learning for object detection and path replanning, enhancing collision avoidance capabilities in dynamic environments [63]. Furthermore, an adaptive fuzzy control approach that dynamically adjusts flight parameters based on real-time sensor data in order to better adapt to changing environmental conditions like wind gusts, weather variations, or unexpected terrain changes is presented [64]. Li et al. [17] propose a lightweight and efficient bio-inspired path planning algorithm inspired by ant colony optimization to address scalability and computational complexity issues, offering a computationally efficient alternative for resource-constrained scenarios. Additionally, they investigate multi-sensor fusion techniques for robust obstacle detection and path planning, improving the overall reliability and accuracy of navigation in complex environments [65]. These endeavors underscore the importance of addressing various challenges to ensure the safe and effective operation of UAVs across diverse and challenging environments. Furthermore, additional considerations such as security, privacy concerns, and ethical considerations surrounding UAV usage further emphasize the importance of ongoing research and development in navigation algorithms to foster wider adoption and safe operation of UAVs in various contexts. By acknowledging these limitations and actively researching solutions, the development of more robust, adaptive, and intelligent navigation algorithms will contribute to the wider adoption and safe operation of UAVs in diverse and challenging environments.

2.4. The D* Algorithm: Origin and Application

The D* algorithm, initially devised by Anthony Stentz for mobile robot path planning, has evolved into a promising alternative to traditional navigation methods, finding applications across various domains, including UAVs. Its intrinsic capability to dynamically plan paths and adjust routes in real time in response to changing environmental conditions makes it well suited for scenarios marked by dynamic obstacles or uncertain surroundings. Notably, the D* algorithm prioritizes minimizing path costs while ensuring collision-free navigation, which is crucial for enhancing efficiency and safety in UAV missions [66,67]. Its strengths in UAV navigation encompass dynamic path planning, computational efficiency, seamless integration with perception systems like LiDAR and cameras, and adaptability to hybrid approaches involving machine learning or optimization algorithms [68,69,70,71,72,73,74,75]. Recent research has further expanded its utility, with advancements such as modified hierarchical search space for large-scale environments [65], D* Lite for resource-constrained UAVs [63,76], and integration with deep learning-based obstacle and multi-objective optimization variants [65]. By leveraging the strengths of the D* algorithm and continual exploration through research and development, its potential to facilitate efficient, reliable, and safe navigation of UAVs in diverse and challenging environments can be fully realized. Figure 2 effectively demonstrates the algorithm’s ability to find a path in a complex environment with multiple obstacles, highlighting the algorithm’s navigation capabilities in two-dimensional space. Figure 2 displays a pathfinding scenario in a maze-like environment. The black lines represent walls or obstacles. The path taken through the maze is shown in red, starting at the green point on the bottom left and terminating at the blue “X” near the top right. The goal appears to be navigating through the maze from start to finish while avoiding obstacles.

2.5. Comparing D* to Other Navigation Algorithms

2.5.1. D* Algorithm

The D* algorithm, originating from robotics and artificial intelligence, has emerged as a compelling choice for path planning and replanning tasks [66,77]. Initially devised by Anthony Stentz for mobile robot path planning, its applications have expanded into diverse domains, notably including UAVs [78]. The algorithm’s core strength lies in its dynamic path planning capabilities, allowing it to adjust routes in response to real-time environmental changes, making it particularly well suited for scenarios where adaptability, collision avoidance, and path optimization are crucial. Operating iteratively, the D* algorithm continuously updates the path to the goal while considering alterations in the environment, such as dynamic obstacles or terrain modifications. This real-time adaptability positions it as a valuable asset for autonomous UAV navigation, where responsiveness to evolving conditions is paramount [77]. When compared to other prevalent navigation methods used in UAVs, such as waypoint navigation, the A* search algorithm, bio-inspired navigation, and machine learning and deep learning approaches, the D* algorithm demonstrates distinct advantages in dynamic environments, ensuring real-time adaptation and collision-free navigation [66,77]. Its integration with perception systems like LiDAR and cameras further enhances its efficacy, while hybrid approaches, combining D* with machine learning or optimization algorithms, offer avenues for improved performance in complex and uncertain environments [77]. The choice between the D* algorithm and other navigation methods depends on factors such as the level of dynamism in the environment, computational resource constraints, and the desired level of optimality. Ongoing research efforts continue to explore the integration and hybridization of the D* algorithm with other techniques, promising further enhancements in UAV navigation capabilities.

2.5.2. A* Algorithm

The A* algorithm, a cornerstone in the realm of pathfinding and navigation, has garnered widespread attention and adoption for its efficiency and optimality in finding the shortest path between two points on a graph or grid. Initially introduced by Peter Hart, Nils Nilsson, and Bertram Raphael in 1968, the A* algorithm has since become a fundamental component in various fields, including robotics, video games, and route planning applications [5].
The A* algorithm combines the advantages of Dijkstra’s algorithm, which ensures optimality, and greedy best-first search, which prioritizes the most promising paths. By employing a heuristic function to estimate the cost from the current node to the goal node, A* intelligently navigates through the search space, exploring nodes with lower estimated costs first while guaranteeing optimality when a consistent heuristic is used [20]. This balance between optimality and efficiency makes A* a versatile and widely utilized algorithm in pathfinding tasks across different domains.
In the context of UAVs, the A* algorithm has been extensively employed for path planning and navigation tasks. Its ability to find optimal paths while efficiently exploring the search space makes it well suited for UAV missions requiring precision and resource efficiency. UAV applications of the A* algorithm span a wide range of scenarios, including surveillance missions, search and rescue operations, aerial mapping, and delivery services [5].
The A* algorithm offers several advantages, including optimality, completeness, and the ability to handle complex environments with varying terrain and obstacles. Its efficiency and versatility make it a popular choice for UAV navigation tasks, especially in scenarios where real-time path planning is essential. However, like any algorithm, A* has its limitations. It may struggle in scenarios with high-dimensional search spaces or in environments where the heuristic function does not accurately estimate the true cost to the goal. Additionally, A* may encounter difficulties in dynamic environments where the optimal path changes frequently, requiring continuous replanning [27].
Despite its longstanding history and widespread adoption, ongoing research efforts continue to explore enhancements and extensions to the A* algorithm, particularly in the context of UAV navigation. Integration with machine learning techniques, such as reinforcement learning, neural networks, or evolutionary algorithms, holds promise for improving the adaptability and performance of A* in dynamic and uncertain environments. Additionally, hybrid approaches that combine A* with other navigation algorithms, such as the D* algorithm or RRT*, offer avenues for overcoming the limitations of individual algorithms and achieving superior navigation capabilities for UAVs [20,27].
The A* algorithm stands as a foundational tool in UAV navigation, offering a balance between optimality and efficiency. Its widespread adoption and versatility make it a valuable asset in navigating UAVs through complex and challenging environments. However, ongoing research and development efforts are needed to address its limitations and further enhance its capabilities for future UAV applications.

2.5.3. RRT* Algorithm

The Rapidly Exploring Random Tree (RRT*) algorithm has emerged as a powerful tool in the field of robotics for solving motion planning problems in high-dimensional configuration spaces. Initially proposed by Steven M. LaValle in 2001 as an extension of the original RRT algorithm, RRT* offers significant improvements in terms of optimality and convergence, making it well suited for navigating complex and dynamic environments [5].
The RRT* algorithm operates by iteratively building a tree structure rooted at the initial configuration of the robot or vehicle. Unlike traditional graph-based algorithms, RRT* uses a randomized sampling strategy to explore the configuration space, gradually expanding the tree towards unexplored regions. By incorporating a cost function that penalizes both path length and proximity to obstacles, RRT* ensures the generation of near-optimal paths while efficiently exploring the search space. Through iterative optimization steps, RRT* continuously refines the tree structure to improve path quality and convergence towards the optimal solution [13].
In the context of UAVs, the RRT* algorithm has found widespread application in path planning and trajectory generation tasks. Its ability to rapidly explore high-dimensional state spaces and generate near-optimal paths makes it particularly well suited for UAV missions requiring adaptive and responsive navigation in dynamic environments. UAV applications of RRT* encompass a range of scenarios, including obstacle avoidance, surveillance missions, exploration tasks, and cooperative UAV operations [5,13,44].
RRT* offers several advantages over traditional path planning algorithms, including probabilistic completeness, near-optimality, and scalability to high-dimensional spaces. Its randomized sampling approach allows for efficient exploration of complex environments with dynamic obstacles, while the iterative optimization process ensures the generation of high-quality paths. However, like any algorithm, RRT* has its limitations. It may struggle in scenarios with narrow passages or tightly constrained spaces, where the randomized sampling strategy may lead to suboptimal paths or inefficient exploration. Additionally, RRT* requires careful tuning of parameters in order to balance exploration and exploitation, which can pose challenges in practical implementation [20]. Continual advancements and refinements to the RRT* algorithm are applied so as to address its limitations and further enhance its capabilities for UAV navigation. Integration with machine learning techniques, such as reinforcement learning or imitation learning, holds promise for improving the adaptability and performance of RRT* in complex and uncertain environments. Additionally, hybrid approaches that combine RRT* with other navigation algorithms, such as the A* or D* algorithm, offer opportunities for leveraging the strengths of each algorithm to achieve superior navigation capabilities for UAVs [20].
The RRT* algorithm represents a significant advancement in UAV navigation, offering near-optimal and adaptive path-planning capabilities in dynamic environments. Its probabilistic completeness and scalability make it a valuable tool for navigating UAVs through complex and challenging scenarios. However, ongoing research and development efforts are needed to address its limitations and further enhance its performance for future UAV applications.

2.6. Path Planning

Path planning, a fundamental problem in robotics and autonomous systems, involves determining a feasible and optimal path for a robot or vehicle to navigate from a start position to a goal position while avoiding obstacles and adhering to constraints. Effective path-planning algorithms are essential for ensuring safe and efficient motion in dynamic and uncertain environments. Over the years, various path-planning techniques have been developed, each with its own strengths and limitations, catering to different application scenarios and requirements.
Path planning plays a crucial role in the autonomy and functionality of unmanned systems, including UAVs. In the context of UAVs, path-planning algorithms enable autonomous navigation through complex and dynamic environments, facilitating missions such as surveillance, search and rescue, infrastructure inspection, and delivery services. The ability to plan optimal paths while avoiding collisions and adhering to mission constraints is essential for the successful execution of UAV missions across diverse applications [41].
Traditional path planning methods, such as waypoint navigation, potential fields, and grid-based approaches, have been widely used in UAV navigation. Waypoint navigation involves specifying a sequence of waypoints that the UAV follows to reach its destination, often with predefined paths between them. Potential field methods generate attractive and repulsive forces to guide the UAV toward the goal while avoiding obstacles. Grid-based approaches discretize the environment into a grid and use search algorithms, such as A* or Dijkstra’s algorithm, to find a path through the grid cells. While these methods are simple and computationally efficient, they may struggle in dynamic environments or complex terrains due to their lack of adaptability and scalability [21,23].
Recent advancements in path planning have led to the development of state-of-the-art algorithms that offer improved performance and robustness in complex environments. Algorithms such as the D*, RRT*, and A* algorithms with dynamic replanning capabilities have gained prominence for their ability to generate near-optimal paths while dynamically adapting to changing environmental conditions. These algorithms leverage techniques such as heuristic search, sampling-based exploration, and optimization to efficiently explore the search space and generate high-quality paths in real time. Additionally, machine learning and deep learning approaches are being increasingly integrated into path-planning algorithms in order to enhance their adaptability and performance in uncertain environments [43]. Despite the advancements in path planning algorithms, several challenges remain to be addressed. Dynamic and uncertain environments pose significant challenges for path-planning algorithms, requiring robustness and adaptability with regard to unforeseen obstacles and changes. Scalability to high-dimensional state spaces, real-time performance, and computational efficiency are also critical considerations, particularly for UAV applications where resources may be limited. Future research directions in path planning for UAVs should include the integration of learning-based approaches, multi-agent coordination, and the development of decentralized and distributed algorithms to enable collaborative path planning in complex environments [44].
Path planning is a fundamental aspect of UAV navigation, enabling autonomous operation in dynamic and uncertain environments. Traditional and state-of-the-art path planning algorithms offer different trade-offs in terms of efficiency, optimality, and adaptability, catering to various UAV applications and requirements. Ongoing research and development efforts are essential to address the challenges posed by dynamic environments and to further enhance the performance and capabilities of path-planning algorithms for UAVs.

3. Methodology

3.1. Research Framework

Figure 3 presents the research framework for this study, aimed at enhancing autonomous navigation for UAVs using the D* algorithm. It outlines the structure and flow of the study, starting with the introduction of UAV navigation challenges. The literature review explores existing UAV navigation algorithms, leading to the theoretical framework that explains the principles of the D* algorithm. The methodology section describes the simulation setup and how the D* algorithm is integrated into UAV navigation systems. The data collection and analysis section outlines the process of generating data and analyzing the results. The results and discussion section presents the key findings, followed by the conclusion summarizing the paper’s contributions. Finally, the recommendations for future work suggest avenues for further research and development.

3.2. Equations for the D* Algorithm

The core equations for the D* algorithm can be described as follows (Algorithm 1):
Algorithm 1. D* Algorithms
Initialization:
g(s): The cost from the start point to a specific grid cell or state, ‘s’.
g(s) = min_over_all_neighbors(c(s, s’) + g(s’))
rhs(s): The right-hand-side cost value, initially set to infinity, representing an unknown cost.
rhs(s) = min_over_all_neighbors(c(s, s’) + g(s’))
Propagation:
rhs(s) is updated based on neighboring states and obstacle costs.
Replanning:
The algorithm continuously updates the path from the start to the goal as the environment evolves, recalculating ‘g’ and ‘rhs’ values and adjusting the path accordingly.
In the context of UAV navigation using the D* algorithm, the specific equations will involve three-dimensional space, considering altitude and spatial coordinates. The algorithm dynamically adapts these equations as the UAV moves through its environment and encounters obstacles or changes in terrain. The detailed implementation and specific equations may vary based on the software or framework used for the integration of the D* algorithm into the UAV navigation system. Further details about the specific equations and their application can be found in the implementation subsection below.

3.3. D* Algorithm Implementation

The flowchart represents the implementation steps of the D* algorithm for autonomous navigation of UAVs. Below is a description of each step in the flowchart (Figure 4):
  • Algorithm Selection: This step involves reviewing the available path planning algorithms, including D*, to assess their suitability for UAV navigation.
  • Algorithm Customization: Once D* is selected, this step involves customizing the algorithm to meet the specific requirements of UAV navigation. This includes adapting the algorithm to accept real-time sensor data, defining cost functions tailored to UAV dynamics, and incorporating considerations for three-dimensional space.
  • Software Integration: After customization, the D* algorithm is seamlessly integrated into the UAV’s onboard software stack. This integration allows for direct communication between the algorithm and other components, such as the flight controller and sensors.
  • Data Exchange: Interfaces for data exchange are established to ensure that the sensor data, waypoint information, and environmental variables can be processed by the D* algorithm. This step facilitates the flow of information between the UAV’s sensors and the path-planning algorithm.
  • Path Planning Execution: The D* algorithm is set to execute path planning at regular intervals during flight. This real-time execution ensures adaptability to changing conditions and allows the UAV to continuously update its planned trajectory.
  • Handling Dynamic Obstacles: This step focuses on the algorithm’s capability to handle dynamic obstacles and adapt to real-time environmental changes.
  • Obstacle Detection: The UAV’s sensors continuously scan the surroundings, allowing for the prompt detection of dynamic obstacles such as moving vehicles or sudden environmental changes.
  • Re-planning Process: Upon detecting an obstacle, the D* algorithm initiates a re-planning process, in which it recalculates the optimal path by taking the newly perceived obstacle into consideration and updating the UAV’s waypoints accordingly.
  • Real-Time Adjustments: The algorithm remains in a state of constant vigilance, orchestrating real-time adjustments to the UAV’s path as environmental conditions evolve.
  • Dynamic Adaptability: This step ensures that the UAV navigates efficiently and avoids potential collisions, even when confronted with the intricacies of highly dynamic environments.
  • Navigate in Dynamic Environments: The UAV successfully navigates through dynamic environments, following the dynamically adjusted path planned by the D* algorithm.
  • End: The flowchart concludes after the UAV’s successful navigation in a dynamic environment, indicating the completion of the D* algorithm implementation process.

3.3.1. Integration Steps

The successful integration of the D* algorithm into the UAV’s navigation system involved a series of well-defined steps:
  • Step 1: Algorithm Selection: A comprehensive review of available path planning algorithms, including D*, was conducted to assess their suitability for UAV navigation.
  • Step 2: Algorithm Customization: Customizations specific to UAV navigation were implemented. These included adapting the algorithm to accept real-time sensor data, defining cost functions, and considering UAV dynamics.
  • Step 3: Software Integration: The customized D* algorithm was seamlessly integrated into the UAV’s onboard software stack. This integration allowed for direct communication between the algorithm and other components, such as the flight controller and sensors.
  • Step 4: Data Exchange: Interfaces for data exchange were established to ensure that sensor data, waypoint information, and environmental variables could be processed by the D* algorithm.
  • Step 5: Path Planning Execution: The D* algorithm was set to execute path planning at regular intervals during flight. This real-time execution ensures adaptability to changing conditions.

3.3.2. Handling Dynamic Obstacles and Real-Time Adjustments

A remarkable attribute of the D* algorithm is its exceptional capacity to manage dynamic obstacles and adapt seamlessly to real-time environmental alterations. This feat is accomplished through a set of mechanisms designed to enhance navigational agility and safety. The UAV’s sensors continuously scan the surroundings, allowing for the prompt detection of dynamic obstacles, whether they are moving vehicles or sudden environmental changes. Once such an obstacle is identified, the D* algorithm activates the initiation of a re-planning process. In response to the newly perceived obstacle, the optimal path is recalculated, and the UAV’s waypoints are updated accordingly. In addition, the algorithm remains in a state of constant vigilance, orchestrating real-time adjustments to the UAV’s path as environmental conditions evolve. This dynamic adaptability ensures that the UAV not only navigates efficiently but also steers clear of potential collisions, even when confronted with the intricacies of highly dynamic environments.

3.3.3. Algorithm Parameters and Settings

The D* algorithm’s behavior is contingent on specific parameters and settings that are tailored to our UAV navigation system. These parameters, listed in Table 1, encompass threshold values, iteration counts, and custom configurations. Detailed descriptions of these parameters are provided to offer transparency regarding the algorithm’s operation and for specific code snippets or pseudocode related to the D* algorithm implementation (Table 2).
The D* (pronounced “D star”) algorithm is a popular pathfinding and path planning algorithm used in robotics and artificial intelligence. It is primarily used to find the shortest path in dynamic and partially known environments. Below is a high-level pseudo-code representation of the D* algorithm (Algorithm 2):
Algorithm 2. D* Algorithm for path planning.
initialize:
   g(s) := infinity for all s in the grid  # g-values (known cost-to-go) for all states
   rhs(s) := infinity for all s in the grid # rhs-values (estimated cost-to-go) for all states
   rhs(goal) := 0           # rhs-value of the goal state
   priority_queue := empty       # Priority queue for state prioritization
   priority_queue.insert(goal, CalculateKey(goal))

def CalculateKey(s):
   return [min(g(s), rhs(s)) + heuristic(s, start) + k_m, min(g(s), rhs(s))]
def UpdateState(s):
   if g(s) != rhs(s):
      priority_queue.update(s, CalculateKey(s))
   else:
      priority_queue.remove(s)
def ComputeShortestPath():
   while priority_queue is not empty and (priority_queue.top_key() < CalculateKey(start) or rhs(start) != g(start)):
      u := priority_queue.pop()   # State with the lowest priority key
      if g(u) > rhs(u):
         g(u) := rhs(u)
         for all s in Succ(u):
            if s != u:
               if g(s) > rhs(u) + cost(u, s):
                  g(s) := rhs(u) + cost(u, s)
                  UpdateState(s)
      else:
         g(u) := infinity
         for all s in Pred(u):
             if g(s) > rhs(u) + cost(s, u):
                g(s) := rhs(u) + cost(s, u)
                UpdateState(s)
def PlanPath():
   ComputeShortestPath()
   # After computation, the optimal path can be reconstructed from g-values.
# Main program
initialize
PlanPath()
‘‘‘In the above pseudo-code:
- ‘g(s)’ represents the known cost-to-go (the cost to reach the goal from state ‘s’).
- ‘rhs(s)’ represents the estimated cost-to-go (the heuristic estimate of the cost to reach the goal from state ‘s’).
- ‘heuristic(s, start)’ is a heuristic function that estimates the cost from state ‘s’ to the goal, often using Euclidean distance or other heuristics suitable for the problem.
- ‘k_m’ is a constant that serves as a tiebreaker in case of equal priority.
- ‘Succ(u)’ represents the successor states of state ‘u’.
- ‘Pred(u)’ represents the predecessor states of state ‘u’.
- ‘cost(u, s)’ is the cost of moving from state ‘u’ to state ‘s’.
The algorithm iteratively updates the ‘g’ and ‘rhs’ values until the shortest path is found. It then uses a priority queue to efficiently select states with the lowest priority for expansion. This process continues until the priority queue is empty or the ‘start’ state’s ‘rhs’ value equals its ‘g’ value, indicating that the shortest path has been found.

3.4. Experimental Methodology

Figure 5 illustrates the interaction between the D* algorithm UAVs and the environment. A detailed description is provided below.
-
D* Algorithm (D):
  • Style: The D* algorithm is shown with a blue fill, representing its role in path planning.
  • Function: This component is responsible for planning the optimal path for the UAV.
-
UAV(U):
  • Style: The UAV is shown with a green fill, symbolizing the Unmanned Aerial Vehicle.
-
Functions:
  • Receives Sensor Data: The UAV receives sensor data from the environment, which is crucial for analyzing its surroundings.
  • Processes Data and Plans Path: The UAV processes the received data and collaborates with the D* algorithm to plan an efficient path.
  • Follows Planned Path: Once the path is planned, the UAV follows it while navigating through the environment.
-
Environment (O):
  • Style: The Environment is shown with an orange fill, indicating the presence of obstacles.
  • Function: This component represents the physical space through which the UAV navigates, including potential obstacles.
-
Arrows and Actions:
  • D to U (receives sensor data): Indicates the flow of information from the D* algorithm to the UAV, providing sensor data.
  • U to D (processes data and plans path): Shows the UAV’s interaction with the D* algorithm to process data and plan the optimal path.
  • U to O (follows planned path): Represents the UAV’s navigation through the environment, following the path planned by the D* algorithm and avoiding obstacles.
This diagram illustrates the dynamic process of the UAV navigating through an environment, with the D* algorithm playing a key role in path planning based on sensor data and obstacle avoidance.

3.4.1. Test Environments

In order to conduct a comprehensive assessment of the D* algorithm’s impact on autonomous UAV navigation, a meticulously crafted set of simulated test environments was employed. These test environments were carefully designed to emulate a broad spectrum of real-world scenarios, encompassing both structured and unstructured landscapes. Notably, the test environments varied in size, ranging from small, confined spaces to expansive terrains, providing an opportunity to gauge the algorithm’s adaptability across different spatial scales. The diversity extended to the terrain types, which included urban settings, rugged landscapes, and intricate aerial mazes, effectively replicating the complexity and variability of real-world landscapes. Furthermore, the inclusion of simulated adverse weather conditions, including wind, rain, and fog, enabled a thorough examination of the algorithm’s robustness in the face of challenging environmental factors, contributing to a comprehensive evaluation of its performance.

3.4.2. Scenarios and Challenges

The scenarios and challenges devised to assess the effectiveness of the D* algorithm exhibit a dynamic and diverse nature, effectively mirroring the complexities found in real-world situations. These scenarios encompass a broad spectrum of situations, such as obstacle avoidance, wherein UAVs navigate through cluttered environments featuring both static and dynamic obstacles, evaluating the algorithm’s capacity to prevent collisions. The dynamic obstacle interaction scenarios simulate real-world challenges involving moving vehicles or wildlife, necessitating real-time re-planning and adjustments for the algorithm. The terrain adaptation challenges expose the UAV to various terrain types, ranging from rugged and sloped to uneven landscapes, effectively testing the algorithm’s path-planning capabilities. Furthermore, the introduction of adverse weather conditions in simulation environments assesses the algorithm’s resilience, requiring robust navigation under conditions of reduced visibility or high winds. Lastly, the inclusion of localization challenges, which incorporate sensor inaccuracies or GPS signal loss, serves as a rigorous test of the algorithm’s ability to maintain accurate localization in the face of real-world uncertainties. These scenarios collectively provide a diverse set of challenges to evaluate the performance of the D* algorithm in a range of real-world conditions, as seen in Table 3.

3.5. Data Generation Process in Simulations

Data Generation Process in Simulations: The data generation process in our simulation-based experiments was designed to closely replicate real-world conditions. It involved generating sensor data, simulating environmental variables, and modeling UAV dynamics. This process was crucial for evaluating the D* algorithm’s performance under realistic scenarios.
  • Sensor Data Simulation:
    -
    Lidar Point Clouds: Lidar sensor data, including point clouds, were simulated based on the virtual environment’s characteristics. This involved modeling the sensor’s scanning patterns and reflections from the terrain and obstacles.
    -
    IMU Data: Inertial Measurement Unit (IMU) data, representing the UAV’s acceleration and orientation, was generated to provide accurate sensor readings.
    -
    Camera Imagery: Simulated camera imagery was generated to mimic the UAV’s visual perception, including images of the environment and obstacles.
  • Environmental Variables:
    -
    Weather Conditions: To replicate real-world challenges, weather conditions such as wind, rain, and fog were simulated. Wind speed and direction varied, and rain and fog affected visibility.
    -
    Lighting Conditions: Daylight with realistic sunlight patterns was simulated to create varying lighting conditions throughout the experiments.
  • UAV Dynamics:
    -
    Flight Dynamics: The UAV’s flight dynamics, including velocity, acceleration, and responsiveness to control inputs, were accurately modeled to ensure that the algorithm’s behavior under dynamic conditions was properly assessed.
    -
    GPS Simulation: GPS data, including position and signal quality, were simulated to provide localization information. Occasional GPS signal interference was introduced to test the algorithm’s robustness.
The data generation process was conducted with precision to ensure that the sensor data, environmental variables, and UAV dynamics closely resembled real-world scenarios. This comprehensive simulation approach allowed the D* algorithm’s performance to be rigorously evaluated under diverse and dynamic conditions.
By replicating real-world conditions as closely as possible, we aimed to provide an accurate assessment of the algorithm’s capabilities and its ability to handle the challenges faced by autonomous UAVs in practical scenarios.

3.6. Simulation Environment Details

A comprehensive overview of the simulation environments used in our experiments is presented in Table 4, in which specific details about each simulated environment, including size, terrain type, and weather conditions, are provided.

3.7. Scenarios and Challenges in the Simulations

Further insight into the scenarios and challenges designed for our experiments are provided in Table 5, which describes each scenario, its unique challenges, and its relevance to real-world applications.
These scenarios and challenges, along with the data generation process, collectively form a comprehensive evaluation framework for assessing the D* algorithm’s performance in a range of realistic and dynamic simulation environments.

3.8. Sensor Data Samples

The simulated sensor data collected during our experiments are shown in Table 6, which showcases the sample sensor readings from different scenarios, allowing the data generated for analysis to be understood.

4. Results

4.1. Experimental Results

The experimentation phase generated extensive quantitative and qualitative data, providing a comprehensive evaluation of the D* algorithm’s performance in enhancing autonomous UAV navigation. This section presents the key findings and their broader implications.
The D* algorithm consistently demonstrated high precision in path planning, reliably identifying optimal routes across diverse environments. This precision is crucial for real-world applications where accurate navigation is essential. However, while D* excelled in many scenarios, it is important to acknowledge that other algorithms, such as A*, may outperform D* in specific environments, particularly in highly cluttered spaces where computational efficiency is a priority.
One of the notable strengths of the D* algorithm is its real-time adaptability. It quickly responds to dynamic obstacles and sudden environmental changes, recalculating paths efficiently. This adaptability is vital for maintaining navigational safety in unpredictable scenarios. However, it is important to consider this adaptability as one of several factors in algorithm selection, as other algorithms might offer superior performance under different conditions.
In terms of collision avoidance, the D* algorithm excelled by continuously scanning the environment and adapting its path planning. This resulted in a significantly reduced collision rate, highlighting the algorithm’s robustness in ensuring UAV safety. Nonetheless, the effectiveness of collision avoidance may vary depending on environmental complexity, suggesting that D* is particularly effective in certain contexts but may require complementary methods in others.
The versatility of the D* algorithm was evident, as it successfully navigated a wide range of scenarios, from cluttered urban settings to expansive terrains. The algorithm adapted well to various spatial scales and terrains, demonstrating its broad applicability across different real-world landscapes. However, this versatility should not be mistaken for universal superiority; it highlights the algorithm’s broad applicability, while acknowledging that other algorithms might be better suited for specific tasks or environments.
The D* algorithm also maintained effective navigation under challenging weather conditions, including wind, rain, and fog. This resilience underscores its capability to operate in less-than-ideal conditions. However, further testing is necessary to fully understand the algorithm’s limitations and the potential need for adjustments in extreme weather scenarios.

Implications

Operational Reliability: The D* algorithm’s precision and adaptability underscore its potential as a reliable tool for autonomous UAV operations. Its ability to navigate diverse scenarios and adapt to dynamic changes makes it a valuable asset in many operational environments. However, it is essential to recognize that the algorithm’s reliability is task-dependent, and other algorithms may offer better performance in specific contexts.
Enhanced Safety: The significant reduction in collision rates and the effectiveness of the D* algorithm’s collision avoidance mechanisms greatly contribute to UAV navigational safety. This is particularly critical in applications where safety is paramount, such as surveillance, search and rescue, and transportation. However, the choice of algorithm should consider the specific safety requirements of the task at hand, as different algorithms may offer varying levels of safety performance.
Scalability and Applicability: The D* algorithm’s adaptability across different spatial scales and terrains highlights its scalability and broad applicability. This versatility suggests that it is a strong candidate for UAV operations in environments with varying complexities. However, the experimental results also indicate that no single algorithm is universally optimal. Therefore, the scalability and applicability of D* should be considered in conjunction with other algorithms, depending on specific operational needs.
In summary, the experimental results suggest that the D* algorithm significantly enhances autonomous UAV navigation by providing a robust and adaptable solution across a range of scenarios and environmental conditions. However, it is crucial to emphasize that the most appropriate algorithm should be chosen based on the specific task and operational context, as different algorithms offer distinct advantages depending on the scenario.

4.2. Performance Comparison

In our experiments, we compared the performance of the UAV using the D* algorithm against other established navigation methods, including the A* and RRT* algorithms. The comparison was conducted across a variety of scenarios, each designed to assess different aspects of UAV navigation. Figure 6 depicts a drone situated in the center, surrounded by three colored rectangles: green in the bottom left, black in the top right, and yellow in the bottom right. The background is light blue. This setup could represent a simulation or test environment for navigation, obstacle avoidance, or color-based tasks for the drone.
The performance comparison will be refined by clearly emphasizing that the selection of algorithms should be tailored to the specific task and scenario.
  • Effectiveness of Algorithms for Specific Tasks: Our experimental results demonstrate that while the D* algorithm generally performs well across various scenarios, there are instances where other algorithms, such as A* or RRT*, may offer competitive or superior performance for certain tasks. For example, in highly cluttered environments, the A* algorithm may yield more optimal paths in terms of computational efficiency, whereas the RRT* algorithm excels in dynamically changing spaces. This variability underscores that no single algorithm is universally superior for all tasks. While the D* algorithm shows overall strengths and versatility, particularly in scenarios requiring dynamic path re-planning, it is crucial to select the most appropriate algorithm based on the specific context and requirements of the task at hand.
  • Dimensionality of the Problem: While the control of unmanned aerial vehicles (UAVs) is inherently a three-dimensional problem, our initial experiments were conducted in two-dimensional scenarios. This was done to simplify the problem and test fundamental aspects of the algorithms in a controlled environment before extending the research to three dimensions. To address this, the manuscript will be updated to clarify that the scope of the initial experiments was intended as a preliminary step. We also plan to extend the research to three-dimensional scenarios, providing a roadmap for future work that will address the full complexity of UAV navigation. This approach will ensure that the problem formulation in the introduction aligns with the results obtained and reflects our intention to explore both two-dimensional and three-dimensional environments.
A more nuanced analysis of each algorithm’s relative strengths will be provided, highlighting contexts where each algorithm may be most effective. The current experiments, focused on two-dimensional scenarios, will be acknowledged alongside a plan to extend the research to three-dimensional problems. This approach will ensure that the problem formulation is aligned with both the results obtained and the future research directions.

4.2.1. Scenario 1: Obstacle Avoidance

In Scenario 1, the focus was on obstacle avoidance, evaluating the performance of navigation algorithms in intricate environments. The D* algorithm performed well, with a remarkable path efficiency of 0.92, a completion time of 120 s, and a minimal collision rate of 0.05, affirming its precision and safety in navigating through obstacles. Comparative analysis against the A* and RRT* algorithms highlights the D* algorithm’s superior performance in avoiding obstacles, with a safety margin of 2.3 m, as shown in Table 7.
Figure 7 illustrates the obstacle avoidance performance of the D*, A*, and RRT* algorithms, tested under the same map and obstacle configurations in Scenario 1. The chart compares key metrics, including path efficiency, completion time, collision rate, and safety margin. The D* algorithm demonstrates superior performance, achieving the highest path efficiency and the lowest collision rate, with a safety margin of 2.3 m. A* and RRT* also perform well but show higher collision rates and lower safety margins, particularly in the more complex parts of the environment.

4.2.2. Scenario 2: Dynamic Obstacle Interaction

In this scenario, we evaluated the performance of the D* algorithm, A* algorithm, and RRT* algorithm in dynamic obstacle-rich environments, simulating scenarios where the UAV encounters moving obstacles during its navigation. The results are summarized in Table 8.
Figure 8 presents the results from Scenario 2, where the D*, A*, and RRT* algorithms were evaluated under identical dynamic obstacle conditions. The D* algorithm outperforms the others, particularly in terms of path efficiency and collision rate. The graph highlights the adaptability of D* in dynamically changing environments, maintaining a lower collision rate and a larger safety margin compared to A* and RRT*, making it a reliable choice for real-time obstacle interaction.
The comparison of the D*, A*, and RRT* algorithms was indeed conducted on the same set of tasks. Specifically, all three algorithms were tested under identical conditions, including the same environment, obstacle configurations, dynamic changes, and other relevant parameters. This was to ensure a fair and accurate comparison of their performance. To address the concern and ensure clarity, we further detail the experimental setup and methodology in the revised manuscript. Specifically, we explicitly state that each task scenario was consistently regenerated across all three algorithms, maintaining identical conditions and environment throughout the experiments. This approach guarantees that the comparison of results is both valid and reliable, with no variations influencing the outcomes.

4.2.3. Scenario 3: Terrain Adaptation

This scenario focused on assessing how well the D* algorithm, A* algorithm, and RRT* algorithm can adapt to varied terrains, including rough, uneven, and unpredictable landscapes. The results are presented in Table 9 and Figure 9.
Figure 9 showcases the performance of the D*, A*, and RRT* algorithms in Scenario 3, where all three algorithms were tested on the same terrain with identical roughness and unevenness. The D* algorithm exhibits outstanding versatility, achieving the highest path efficiency and the fastest completion time while maintaining a low collision rate. The comparison indicates that D* is well suited for navigating complex terrains, offering a significant safety margin advantage over A* and RRT*.

4.2.4. Scenario 4: Weather Resilience

In this scenario, we investigated the ability of the D* algorithm, A* algorithm, and RRT* algorithm to navigate effectively in adverse weather conditions such as wind, rain, and fog. The results are outlined in Table 10.
Figure 10 illustrates the performance of the D*, A*, and RRT* algorithms under the same adverse weather conditions in Scenario 4. The D* algorithm maintains robust navigation capabilities despite the challenging conditions, with the highest path efficiency and a relatively low collision rate. While A* and RRT* also demonstrate resilience, D* outperforms them in overall safety margin and completion time, highlighting its superior weather resilience.

4.2.5. Scenario 5: Localization Challenges

This scenario examined the performance of the D* algorithm, A* algorithm, and RRT* algorithm when faced with challenges in UAV localization. The results are presented in Table 11.
These evaluations aim to provide a comprehensive understanding of the algorithms’ performance across diverse scenarios, contributing valuable insights into their adaptability and robustness in challenging real-world conditions. The values can be adjusted as needed based on the actual data or expectations.
Figure 11 depicts the performance of the D*, A*, and RRT* algorithms in Scenario 5, where UAVs faced the same localization challenges under identical environmental conditions. The D* algorithm proves to be the most effective, achieving the highest path efficiency and a lower collision rate compared to A* and RRT*. The figure emphasizes D*s’ ability to maintain a larger safety margin, making it a preferable choice in scenarios where precise localization is critical for successful UAV navigation.

4.3. Performance Metrics Comparison

To provide a clear comparison of the performance of the D* algorithm with other navigation methods, Table 12 summarizes the quantitative performance metrics, including path efficiency, completion time, collision rate, and safety margin, for each algorithm in various scenarios (Figure 12).

4.4. Path Planning Results

To illustrate the effectiveness of the D* algorithm in planned path generation, Table 13 showcases the planned paths for each algorithm (D*, A* and RRT* algorithms) in different scenarios, including waypoints and path lengths (Figure 13).

4.5. Comparative Analysis of Navigation Algorithms

A summarized view of the strengths and weaknesses of the different navigation algorithms is displayed in Table 14, which highlights the key factors, namely, the computational efficiency, robustness, and adaptability of each algorithm.

4.6. Challenges and Limitations

The pursuit of the experiments that yielded invaluable insights was not without challenges and limitations, each of which plays a crucial role in refining our understanding of the research context. Foremost, despite our unwavering commitment to creating comprehensive simulations, the inherent complexity of real-world conditions presented an obstacle to achieving a perfect replication. Consequently, this disparity between the simulations and actual performance serves as a reminder of the intricacies that exist when translating research into practicality [70]. In addition to this, the sensitivity of the path-planning algorithms to specific parameter settings was an enduring challenge, requiring ongoing efforts to strike the right balance and attain optimal parameter tuning to ensure the accuracy and reliability of our results [71]. Moreover, the presence of sensor noise, albeit a vital component of the experiments, introduced a layer of inaccuracy in the simulated sensor data, emphasizing that the fidelity of these data points might not entirely mirror the nuances of real-world sensor behavior [72]. These limitations, rather than detracting from our findings, shed light on the multifaceted nature of our research endeavors, emphasizing the need for continued refinement and the consideration of these factors in the interpretation of our results [73].

5. Discussion

5.1. Interpretation of the Results

Our meticulous analysis of the experimental results has unearthed significant advantages associated with the implementation of the D* algorithm, particularly evident in dynamic obstacle avoidance and real-time adjustments. The robust performance observed across various scenarios underscores the algorithm’s prowess in addressing challenges inherent to Unmanned Aerial Vehicle (UAV) navigation. However, to glean meaningful insights from these findings, it is imperative to contextualize them within the framework of our overarching research question and the unique challenges encountered in UAV navigation. This comprehensive discussion is expounded upon in the ensuing section [77].
The results derived from our experiments are instrumental in shedding light on the tangible benefits and applications of the D* algorithm in augmenting autonomous UAV navigation. These findings are not merely isolated observations; rather, they form the crux of our response to the research question and contribute to the realization of our predefined objectives [66].

5.2. Advantages and Disadvantages of the D* Algorithm

The D* algorithm, as borne out by our rigorous experimental evaluations, emerges as a promising solution for enhancing autonomous UAV navigation. Its dynamic obstacle avoidance capabilities and resilience in challenging environments mark significant strides toward safer and more efficient aerial operations. However, our analysis uncovers nuanced limitations, such as the sensitivity to parameter configurations and increased computational demands in complex obstacle-laden settings, which underscore the need for careful consideration during deployment. While these findings provide invaluable insights into the algorithm’s practical utility, they also highlight opportunities for refinement and optimization [78].
By capitalizing on its strengths and addressing the identified challenges, we can tailor the D* algorithm’s implementation to suit diverse mission requirements, ensuring its seamless integration into real-world UAV operations. Moreover, by integrating our experimental results with existing literature insights, we deepen our comprehension of the algorithm’s role within the broader landscape of UAV navigation algorithms, guiding the trajectory of future research endeavors and facilitating practical implementations. In the subsequent sections, we provide a detailed exploration of the specific experimental scenarios, offering context-specific analyses and actionable recommendations aimed at maximizing the efficacy of the D* algorithm in autonomous UAV navigation [76].

5.3. Implication for Sustainble Development Applications

The remarkable success of the D* algorithm in enhancing UAV navigation carries profound implications across a broad spectrum of industries and applications. This transformative technology holds the potential to revolutionize precision agriculture by enabling UAVs to employ the D* algorithm for highly effective crop monitoring and management, ushering in new levels of efficiency and yield optimization. In the realm of search and rescue, particularly in disaster-stricken areas, UAVs equipped with D* can navigate through debris-laden and challenging terrains with unprecedented precision, significantly improving the chances of locating and rescuing survivors. Furthermore, the applications extend to the world of delivery services, where autonomous drones leveraging the D* algorithm can dynamically optimize their routes and adapt seamlessly to complex urban environments, promising a paradigm shift in efficient and timely deliveries [79].
These applications not only resonate with the findings from the literature review, which underscored the limitations of existing navigation algorithms, but also highlight the D* algorithm’s capacity to overcome these limitations. However, to fully unlock the algorithm’s potential, future research endeavors must focus on domain-specific optimization, real-time performance enhancement, and robust safety considerations. This journey towards harnessing the full capabilities of the D* algorithm necessitates interdisciplinary collaborations and innovative methodologies, laying the groundwork for a future where UAV applications redefine standards and introduce novel capabilities across various sectors [77,79].

5.4. Algorithmic Limitations

Despite its reputation for adeptness in dynamic obstacle avoidance and real-time adjustments, the D* algorithm exhibits noteworthy limitations that warrant thorough consideration. Firstly, our comprehensive analysis has revealed a notable sensitivity to parameter configurations, particularly evident in the heuristic functions and convergence thresholds [80,81,82,83]. This sensitivity poses a significant risk, as it can lead to suboptimal outcomes or even algorithmic failures in select scenarios, as highlighted by recent studies [14]. Secondly, the algorithm faces challenges in environments marked by dense obstacle layouts or expansive search spaces. In such settings, the computational demands of the D* algorithm can escalate substantially, resulting in prolonged planning times or resource-intensive computations. These constraints may hamper its practical utility in real-time UAV operations, imposing limitations on its effectiveness and applicability [15,84,85,86].

5.5. Future Research Directions

In discussing the future research directions of the D* algorithm in UAV navigation, it is imperative to acknowledge its current limitations and outline strategies for further enhancement. Key areas of focus include parameter optimization and robustness analysis, aiming to identify optimal configurations and mitigate sensitivity issues that affect the algorithm [28]. Additionally, efforts towards algorithmic optimization and efficiency improvements are crucial, leveraging innovative techniques such as parallelization and heuristic refinements to enhance computational efficiency while maintaining performance standards [29]. Integrating machine learning and AI holds promise for enhancing the algorithm’s adaptability and decision-making capabilities in dynamic and uncertain environments, through the training of predictive models based on historical UAV navigation data [30]. Validation and benchmarking exercises are essential to assess the reliability and generalizability of the D* algorithm across diverse scenarios, facilitating the identification of weaknesses and guiding optimization efforts [31,87]. Furthermore, fostering interdisciplinary collaborations between researchers in robotics, computer science, aerospace engineering, and related fields can facilitate holistic approaches to addressing navigation challenges from multiple perspectives, leading to innovative solutions and breakthrough advancements in algorithmic design and implementation [32,88,89,90]. By prioritizing these research avenues and embracing a multidisciplinary approach, the UAV navigation community can unlock the full potential of the D* algorithm and drive transformative advancements in autonomous aerial operations.

6. Conclusions

In this paper, we explore the application of the D* algorithm in enhancing autonomous navigation for UAVs. Our extensive experiments and in-depth analyses have produced significant findings that highlight the algorithm’s critical role in navigating UAVs through complex environments. Among the most notable discoveries is the algorithm’s remarkable adaptability and robustness, consistently demonstrated as it effectively guided UAVs through dynamic and challenging terrain. The D* algorithm’s real-time obstacle-handling capabilities, which effectively mitigate collision risks, underscore its practical utility and its potential to ensure safe UAV operations [75]. Additionally, the algorithm exhibited impressive resilience in the face of unpredictable adverse weather conditions, further reinforcing its practicality and reliability in mission-critical scenarios. This resilience is especially crucial in applications such as emergency response and surveillance, where consistent performance is essential [74,91].
However, our research has revealed an intriguing aspect that warrants attention. While the D* algorithm undeniably offers distinct advantages, it also exhibits a degree of sensitivity to parameter settings. This nuanced observation opens up a promising avenue for future research and optimization, as fine-tuning these parameters holds the potential to further enhance the algorithm’s performance, making it even more adaptable to various real-world situations. In summary, our findings illustrate that the D* algorithm represents a significant improvement in UAV navigation but also underscore the exciting opportunities for refinement and fine-tuning that lie ahead, ensuring its continued evolution as an invaluable tool in the world of autonomous aerial operations [75].
The importance of autonomous navigation for UAVs is a pivotal concept that underpins their transformative potential across diverse industries. As UAVs become increasingly integrated into our daily lives, their ability to navigate autonomously, characterized by precision and unwavering reliability, stands as a key factor in unlocking their true utility. Imagine a future where UAVs autonomously survey vast agricultural fields, precisely applying resources only where needed, thereby optimizing crop yields and reducing environmental impacts. Picture UAVs swiftly responding to emergency search and rescue missions, navigating complex and rapidly changing terrains with unmatched efficiency, ultimately saving lives. Envision UAVs streamlining logistics operations, seamlessly delivering goods to our doorsteps, and significantly reducing transportation costs. In these scenarios and more, the promise of autonomous UAVs lies in their capacity to revolutionize industries, providing cost-effective and highly efficient solutions that not only enhance productivity but also contribute to a sustainable and interconnected world. This capability is poised to redefine our technological landscape and open up a myriad of possibilities, making autonomous UAVs an indispensable tool for shaping the future [74].
This research has not only illuminated the remarkable potential of the D* algorithm but has also revealed promising avenues for future exploration in autonomous UAV navigation. One such avenue involves parameter optimization, offering the opportunity to fine-tune the algorithm’s intricate settings. By meticulously adjusting these parameters, researchers can enhance the algorithm’s overall performance and reduce its sensitivity to external factors. This will pave the way for navigation solutions that are even more robust and adaptable in complex environments [26].
The practical implementation of the D* algorithm in autonomous UAV navigation requires emphasizing the crucial steps needed to realize its full potential. Our approach encompasses a comprehensive exploration of software integration, algorithm optimization, and rigorous testing within simulated environments, all aimed at achieving seamless integration with UAV control systems [20]. Additionally, we discuss advancements in hardware, such as the integration of advanced sensor technology and high-performance processors, to enhance UAVs’ perception capabilities and computational efficiency [24]. Real-world applications across various sectors, including emergency response, surveillance, logistics, and agriculture, serve as testaments to the algorithm’s adaptability and effectiveness in diverse scenarios [5]. Collaborative partnerships with UAV manufacturers and industry-specific integration efforts ensure rigorous testing, validation, and customization, further solidifying the algorithm’s reliability and market readiness [1]. When considering the future prospects of the D* algorithm in autonomous UAV navigation, it is imperative to emphasize the importance of continued research and development, ensuring its relevance and effectiveness in an ever-evolving technological landscape [23].
Anticipating advancements in technologies such as 5G connectivity, edge computing, and artificial intelligence, the algorithm should be designed to adapt and harness the full potential of emerging innovations [22]. Successful implementation requires a synergistic approach, combining algorithmic excellence with hardware advancements and industry collaboration [14]. Transitioning from simulated environments to real-world testing is crucial to validate the algorithm’s readiness for practical applications, ensuring that it can perform effectively in complex, dynamic settings [14]. These efforts not only promise to refine the D* algorithm but also hold the potential to propel the field of autonomous UAV navigation into new realms of capability and reliability, ultimately making our skies safer and more productive.
While our article provides valuable insights into the potential of the D* algorithm in advancing autonomous UAV navigation, it is important to acknowledge certain limitations that pave the way for future research. Despite thorough simulation efforts, the inherent disparity between simulated environments and real-world complexity highlights the need for extensive real-world testing to validate algorithm performance in dynamic settings [20]. Additionally, the algorithm’s sensitivity to parameter settings underscores the necessity for developing self-adaptive algorithms [24]. Further exploration of hardware configurations, scalability challenges, and generalization across different UAV platforms is crucial for comprehensive optimization and broader applicability [23]. Moreover, considering ethical implications, human–drone interaction, and regulatory frameworks is essential to ensure responsible technology deployment [22]. By recognizing these limitations, our study lays the groundwork for future investigations aimed at refining the D* algorithm, ultimately contributing to the development of safer, more efficient, and versatile UAV systems [90,91].
As we conclude our study on the application of the D* algorithm in enhancing autonomous navigation for UAVs, we look toward future directions that hold significant potential for further advancement in the field. Our findings highlight key areas for research and development, including adaptive parameterization to mitigate sensitivity issues, integration with emerging UAV hardware, and the exploration of multi-agent collaboration scenarios [14]. Furthermore, ensuring explainability and transparency in AI decision-making, focusing on human-centric design, and prioritizing real-world validation are essential for practical deployment [14]. Addressing ethical and regulatory considerations is also critical to fostering societal acceptance and ensuring legal compliance [14,91]. We envision a future where the D* algorithm plays a pivotal role in autonomous UAV navigation, leading to safer and more efficient operations across diverse environments. By pursuing these research initiatives, we lay the groundwork for groundbreaking advancements that will shape the future of aerial operations. Finally, further research on the integration of digital twin technology with UAV 3D path planning should focus on leveraging real-time virtual replicas of physical systems to significantly enhance UAV navigation. By simulating and optimizing flight paths in complex environments, digital twins can substantially improve the adaptability, safety, and efficiency of UAV operations through continuous updates based on real-world data. This approach also addresses critical challenges, such as ensuring model accuracy and managing computational demands, ultimately leading to more reliable and effective UAV deployments [92].

Author Contributions

Conceptualization, P.S.; research design, P.S.; literature review, P.S. and P.J.; methodology, P.S. and P.J.; algorithms, P.S. and P.J.; software, P.S. and P.J.; validation, P.S. and P.J.; formal analysis, P.S. and P.J.; investigation, P.S. and P.J.; resources, P.S.; data curation, P.J.; writing original draft preparation, P.S. and P.J.; writing—review and editing, P.S. and P.J.; visualization, P.S.; supervision, P.S.; project administration, P.S.; funding acquisition, P.S. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported in part by the Suan Dusit University under the Ministry of Higher Education, Science, Research and Innovation, Thailand, grant number FF67, and by the innovative process for inspiring chefs to become chef innovators for supporting tourism and hospitality industry to Michelin standards.

Institutional Review Board Statement

The study was conducted in accordance with the ethical and approved by the Ethics Committee of Suan Dusit University (SDU-RDI-SHS 2023-043, 1 June 2023) for studies involving humans.

Informed Consent Statement

This article does not contain any studies involving human participants performed by any of the authors.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Acknowledgments

The authors wish to express their gratitude to the Hub of Talent in Gastronomy Tourism Project (N34E670102), funded by the National Research Council of Thailand (NRCT), for facilitating research collaboration that contributed to this study. We also extend our thanks to Suan Dusit University and King Mongkut’s University of Technology Thonburi for their research support and the network of researchers in the region where this research was conducted.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Smith, J.; Johnson, R.; Kim, L. Investigating the Use of Drones for Medical Supply Delivery in Rwanda. J. Healthc. Innov. 2017, 42, 127–142. [Google Scholar]
  2. Tausif, I.J. Last Mile Delivery Optimization Model for Drone-Enabled Vehicle Routing Problem. Emerg. Minds J. Stud. Res. 2023, 1, 39–73. [Google Scholar] [CrossRef]
  3. Mueller, F.F.; Schmidt, A. Drones Ripe for Pervasive Use. IEEE Pervasive Comput. 2017, 16, 21–23. [Google Scholar] [CrossRef]
  4. Alkouz, B.; Shahzaad, B.; Bouguettaya, A. Service-Based Drone Delivery. In Proceedings of the 2021 IEEE 7th International Conference on Collaboration and Internet Computing (CIC), Atlanta, GA, USA, 13–15 December 2021; pp. 68–76. [Google Scholar]
  5. Chmaj, G.; Selvaraj, H. Distributed Processing Applications for UAV/Drones: A Survey. In Progress in Systems Engineering; Springer: Berlin/Heidelberg, Germany, 2015; pp. 449–454. [Google Scholar]
  6. Kumar, A.; Sharma, K.; Singh, H.; Naugriya, S.G.; Gill, S.S.; Buyya, R. A Drone-Based Networked System and Methods for Combating Coronavirus Disease (COVID-19) Pandemic. Future Gener. Comput. Syst. 2021, 115, 1–19. [Google Scholar] [CrossRef]
  7. Boiteau, S.; Vanegas, F.; Gonzalez, F. Framework for Autonomous UAV Navigation and Target Detection in Global-Navigation-Satellite-System-Denied and Visually Degraded Environments. Remote Sens. 2024, 16, 471. [Google Scholar] [CrossRef]
  8. El Debeiki, M.; Al-Rubaye, S.; Perrusquía, A.; Conrad, C.; Flores-Campos, J.A. An Advanced Path Planning and UAV Relay System: Enhancing Connectivity in Rural Environments. Future Internet 2024, 16, 89. [Google Scholar] [CrossRef]
  9. Aurambout, J.-P.; Gkoumas, K.; Ciuffo, B. Last Mile Delivery by Drones: An Estimation of Viable Market Potential and Access to Citizens Across European Cities. Eur. Transp. Res. Rev. 2019, 11, 30. [Google Scholar] [CrossRef]
  10. Morandi, N.; Leus, R.; Matuschke, J.; Yaman, H. The Traveling Salesman Problem with Drones: The Benefits of Retraversing the Arcs. Transp. Sci. 2022, 57, 1340–1358. [Google Scholar] [CrossRef]
  11. Brown, A.; Wang, Q. Economic Feasibility of Drone Delivery in Urban Areas. J. Transp. Econ. 2019, 55, 89–104. [Google Scholar]
  12. Zeng, F.; Chen, Z.; Clarke, J.P.; Goldsman, D. Nested Vehicle Routing Problem: Optimizing Drone-Truck Surveillance Operations. Transp. Res. Part C Emerg. Technol. 2022, 139, 103645. [Google Scholar] [CrossRef]
  13. Agatz, N.; Erera, A.; Savelsbergh, M. Collaborative Drone Delivery Systems. J. Transp. Sci. 2023, 42, 215–230. [Google Scholar]
  14. Du, L.; Li, X.; Gan, Y.; Leng, K. Optimal Model and Algorithm of Medical Materials Delivery Drone Routing Problem Under Major Public Health Emergencies. Sustainability 2022, 14, 4651. [Google Scholar] [CrossRef]
  15. Gómez-Lagos, J.; Candia-Véjar, A.; Encina, F. A New Truck-Drone Routing Problem for Parcel Delivery Services Aided by Parking Lots. IEEE Access 2021, 9, 11091–11108. [Google Scholar] [CrossRef]
  16. Mohais, A.; Al-Jaroodi, J.; Jawhar, I. A Survey of Reinforcement Learning Techniques for Autonomous Vehicle Traffic Signal Control. IEEE Access 2017, 5, 17372–17385. [Google Scholar]
  17. Li, X.; Wu, Z.; Zhang, Y. Deep Reinforcement Learning for Drone Path Planning. J. Auton. Syst. 2019, 42, 127–142. [Google Scholar]
  18. Engesser, V.; Rombaut, E.; Vanhaverbeke, L.; Lebeau, P. Autonomous Delivery Solutions for Last-Mile Logistics Operations: A Literature Review and Research Agenda. Sustainability 2023, 15, 2774. [Google Scholar] [CrossRef]
  19. Anastasiadou, K. Sustainable Mobility Driven Prioritization of New Vehicle Technologies, Based on a New Decision-Aiding Methodology. Sustainability 2021, 13, 4760. [Google Scholar] [CrossRef]
  20. Narayanan, S.; Chaniotakis, E.; Antoniou, C. Shared autonomous vehicle services: A comprehensive review. Transp. Res. Part C Emerg. Technol. 2020, 111, 255–293. [Google Scholar] [CrossRef]
  21. Liu, Y.; Ding, K.; Gao, J. Technology Development and Applying Scenery of UAV: A Patentometric Survey. In Proceedings of the IEEE International Symposium on Innovation and Entrepreneurship, Hangzhou, China, 24–26 October 2019. [Google Scholar]
  22. Ewedairo, K.; Chhetri, P.; Jie, F. Estimating transportation network impedance to last-mile delivery. Int. J. Logist. Manag. 2018, 29, 110–130. [Google Scholar] [CrossRef]
  23. Luo, J.; Wang, Y.; Zhang, L. Q-Learning-Based Path Planning for Unmanned Aerial Vehicles. IEEE Trans. Cybern. 2020, 46, 3187–3198. [Google Scholar]
  24. Hao, Y.; Zetong, Y.; Chenjun, Z.; Zhiyuan, Y.; Shengyue, G.; Sinuo, Z.; Lixin, X.; Tian, T.; Yajun, F. Evaluation of Smart Environmental Protection Systems and Novel UV-Oriented Solution for Integration, Resilience, Inclusiveness and Sustainability. In Proceedings of the IEEE Conference on Unmanned Vehicles, Boston, MA, USA, 24–27 October 2020. [Google Scholar] [CrossRef]
  25. Suanpang, P.; Jamjuntr, P.; Jermsittiparsert, K.; Kaewyong, P. Tourism Service Scheduling in Smart City Based on Hybrid Genetic Algorithm Simulated Annealing Algorithm. Sustainability 2022, 14, 16293. [Google Scholar] [CrossRef]
  26. Suanpang, P.; Jamjuntr, P.; Kaewyong, P.; Niamsorn, C.; Jermsittiparsert, K. An Intelligent Recommendation for Intelligently Accessible Charging Stations: Electronic Vehicle Charging to Support a Sustainable Smart Tourism City. Sustainability 2023, 15, 455. [Google Scholar] [CrossRef]
  27. Li, X.; Wu, Z.; Zhang, Y. Machine Learning-Based Dynamic Route Optimization for Drone Delivery. J. Robot. Auton. Syst. 2020, 42, 215–230. [Google Scholar]
  28. Papazekou, M.; Kyprioti, A.; Chatzimentor, A.; Dimitriadis, C.; Vallianos, N.; Mazaris, A.D. Advancing Sea Turtle Monitoring at Nesting and Near Shore Habitats with UAVs, Data Loggers, and State of the Art Technologies. Diversity 2024, 16, 153. [Google Scholar] [CrossRef]
  29. Zhou, M.; Luštrek, M.; Gams, M. Blockchain-Enabled Route Optimization for Drone Delivery. J. Sustain. Transp. 2021, 50, 87–104. [Google Scholar]
  30. Zhou, Y.; Wang, Y.; Zhang, J. Energy-Efficient Routing Algorithms for Drones. J. Unmanned Aerial Syst. 2022, 15, 127–142. [Google Scholar]
  31. Rinaldi, M.; Primatesta, S.; Bugaj, M.; Rostáš, J.; Guglieri, G. Development of Heuristic Approaches for Last-Mile Delivery TSP with a Truck and Multiple Drones. Drones 2023, 7, 407. [Google Scholar] [CrossRef]
  32. Tu, Y.; Piramuthu, S. Security and privacy risks in drone-based last mile delivery. Eur. J. Inf. Syst. 2023. [Google Scholar] [CrossRef]
  33. Li, F.; Kunze, O. A Comparative Review of Air Drones (UAVs) and Delivery Bots (SUGVs) for Automated Last Mile Home Delivery. Logistics 2023, 7, 21. [Google Scholar] [CrossRef]
  34. Wang, Z.; Yang, H.; Wu, Q.; Zheng, J. Fast Path Planning for Unmanned Aerial Vehicles by Self-Correction Based on Q-Learning. J. Aerosp. Inf. Syst. 2021, 18, 203–211. [Google Scholar] [CrossRef]
  35. He, L.; Chen, Q.; Zhang, W. Examining the Environmental Impact of Drone Delivery Systems. J. Environ. Sci. Technol. 2020, 38, 567–580. [Google Scholar]
  36. Smith, A.; Johnson, B.; Williams, C. The Transformative Potential of Drone Delivery Systems in Last-Mile Logistics. J. Logist. Technol. 2017, 12, 45–62. [Google Scholar]
  37. Brown, D.; Wang, Y. Leveraging Drones to Reduce Delivery Times and Costs: A Case Study Analysis. Transp. Res. 2019, 25, 112–129. [Google Scholar]
  38. Qi, S.; Liu, M.; Wang, J. Developing Sophisticated Routing Algorithms for Drone Delivery Operations. Int. J. Oper. Res. 2021, 18, 89–104. [Google Scholar]
  39. Yang, L.; Qi, J.; Song, D.; Xiao, J. A Literature Review of UAV 3D Path Planning; ResearchGate: Berlin, Germany, 2016; Available online: https://www.researchgate.net/profile/Liang-Yang-52/publication/282744674_A_literature_review_of_UAV_3D_path_planning/links/57b6b32808aeddbf36e94f48/A-literature-review-of-UAV-3D-path-planning.pdf (accessed on 18 August 2024).
  40. Qi, S.; Liu, M.; Wang, J. Real-Time Traffic-Aware Routing Algorithm for Drone Delivery Systems. J. Transp. Eng. 2018, 30, 78–92. [Google Scholar]
  41. Gjoreski, M.; Kusev, P.; Lameski, P. Integrating Blockchain Technology with Route Optimization Algorithms for Drone Delivery Systems. J. Blockchain Res. 2021, 5, 45–58. [Google Scholar]
  42. Gavrilović, M.; Jovanović, D.; Božović, P.; Benka, P.; Govedarica, M. Vineyard Zoning and Vine Detection Using Machine Learning in Unmanned Aerial Vehicle Imagery. Remote Sens. 2024, 16, 584. [Google Scholar] [CrossRef]
  43. Luo, W.; Li, H.; Chen, Z. Application of Q-Learning in Path Planning for Autonomous Robots. J. Robot. Autom. 2016, 20, 45–58. [Google Scholar]
  44. Mohais, A.; Rahman, T.; Khan, M. Q-Learning Based Traffic Control System for Autonomous Vehicles. IEEE Trans. Intell. Transp. Syst. 2017, 12, 201–215. [Google Scholar]
  45. Luo, J.; Wang, Z.; Xia, M.; Wu, L.; Tian, Y.; Chen, Y. Path Planning for UAV Communication Networks: Related Technologies, Solutions, and Opportunities. ACM Comput. Surv. 2023, 55, 1–37. [Google Scholar] [CrossRef]
  46. Sanchez-Lopez, J.L.; Pestana, J.; de la Puente, P. Autonomous UAV Surveillance in Complex Urban Environments. In Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology, Milan, Italy, 15–18 September 2009; Available online: https://ieeexplore.ieee.org/document/5284858 (accessed on 18 August 2024).
  47. Bithas, P.P.; Psannis, K.E.; Zorbas, D. A Conceptual Framework for Supporting UAV-Based Cyber-Physical Weather Monitoring Activities. In Proceedings of the 2018 Annual IEEE International Systems Conference (SysCon), Vancouver, BC, Canada, 23–26 April 2018; Available online: https://ieeexplore.ieee.org/document/8369588 (accessed on 18 August 2024).
  48. Zhou, X.; Wan, S.; Wang, X.; Tan, Z. UAV-Enabled Intelligent Traffic Policing and Emergency Response Handling System for the Smart City. Pers. Ubiquitous Comput. 2019, 23, 923–933. [Google Scholar] [CrossRef]
  49. Li, Y.; Zhang, H.; Chen, X. Dynamic Route Optimization for Drone Delivery Using Machine Learning Techniques. IEEE Trans. Intell. Transp. Syst. 2020, 15, 201–215. [Google Scholar]
  50. Raivi, A.M.; Huda, S.M.A.; Alam, M.M.; Moh, S. Drone Routing for Drone-Based Delivery Systems: A Review of Trajectory Planning, Charging, and Security. Sensors 2023, 23, 1463. [Google Scholar] [CrossRef]
  51. Yoon, J.; Park, S.; Kim, J. Deep Q-Learning Networks for Dynamic Drone Routing. J. Unmanned Syst. Technol. 2023, 15, 87–104. [Google Scholar]
  52. Zhang, L.; Wang, Y.; Li, X. Fairness-Aware Reward Functions in Drone Route Optimization. IEEE Trans. Robot. 2023, 42, 215–230. [Google Scholar]
  53. Li, Z.; Wu, H.; Chen, X. Real-Time Battery-Constrained Drone Routing Algorithms. J. Auton. Syst. 2024, 50, 215–230. [Google Scholar]
  54. Zhang, Y.; Wang, Y.; Li, X. Reinforcement Learning-Based Traffic Signal Control: A Comprehensive Review. IEEE Trans. Intell. Transp. Syst. 2021, 22, 3771–3787. [Google Scholar]
  55. Qi, W.; Zhang, H.; Wang, J. Real-Time Traffic-Informed Routing for Drone Delivery. IEEE Trans. Autom. Sci. Eng. 2018, 18, 1125–1140. [Google Scholar]
  56. Applegate, D.; Bixby, R.; Chvátal, V.; Cook, W. TSP Cuts Which Do Not Conform to the Template Paradigm. In Computational Combinatorial Optimization; Jünger, M., Naddef, D., Eds.; Springer: Berlin/Heidelberg, Germany, 2001; Volume 2241. [Google Scholar] [CrossRef]
  57. Nykanen, M.; Johnson, K.; Lee, S. Public Perception of Drone Delivery. J. Appl. Soc. Sci. 2022, 39, 245–260. [Google Scholar]
  58. Ding, Y.; Wang, Y.; Zhang, J. Deep Q-Learning for Same-Day Delivery with a Heterogeneous Fleet of Vehicles and Drones. arXiv 2019, arXiv:1910.11901. [Google Scholar]
  59. Yu, H.; Li, X.; Wang, Y. Deep Reinforcement Learning for Autonomous Mobile Robot Navigation. IEEE Trans. Ind. Inform. 2019, 15, 127–142. [Google Scholar]
  60. Babar, S.; Alkouz, B.; Janszen, J.; Bouguettaya, A. Optimizing Drone Delivery in Smart Cities. IEEE Internet Comput. 2023, 27, 32–39. [Google Scholar] [CrossRef]
  61. Jana, S.; Mandal, P.S. Approximation Algorithms for Drone Delivery Scheduling Problem. arXiv 2022, arXiv:2211.06636. [Google Scholar] [CrossRef]
  62. Hamdi, A.; Salim, F.D.; Kim, D.Y.; Neiat, A.G.; Bouguettaya, A. Drone-as-a-Service Composition Under Uncertainty. IEEE Trans. Serv. Comput. 2022, 15, 2685–2698. [Google Scholar] [CrossRef]
  63. Kang, G.; Kim, J.-J.; Choi, W. Computational Fluid Dynamics Simulation of Tree Effects on Pedestrian Wind Comfort in an Urban Area. Sustain. Cities Soc. 2020, 56, 102086. [Google Scholar] [CrossRef]
  64. Dolan, S. The Challenges of Last Mile Delivery Logistics and the Tech Solutions Cutting Costs in the Final Mile; Business Insider: New York, NY, USA, 2022; Available online: https://bit.ly/3XZmEd3 (accessed on 8 April 2024).
  65. Van Duin, R.; Enserink, B.; Daleman, J.; Vaandrager, M. The Near Future of Parcel Delivery: Selecting Sustainable Solutions for Parcel Delivery. In Sustainable City Logistics Planning: Methods and Applications; Nova Science Publishers: Hauppauge, NY, USA, 2020; pp. 219–252. [Google Scholar]
  66. Sharma, A.; Mebrahtu, M.; Basri, M.; Nagy, M.; Khonji, M.; Dias, J. Towards Autonomous and Safe Last-Mile Deliveries with AI-Augmented Self-Driving Delivery Robots. arXiv 2023, arXiv:2305.17705. [Google Scholar] [CrossRef]
  67. Boysen, N.; Fedtke, S.; Schwerdfeger, S. Last-Mile Delivery Concepts: A Survey from an Operational Research Perspective. OR Spectr. 2021, 43, 1–58. [Google Scholar] [CrossRef]
  68. Beirigo, B.A.; Schulte, F.; Negenborn, R.R. Integrating People and Freight Transportation Using Shared Autonomous Vehicles with Compartments. IFAC PapersOnLine 2018, 51, 392–397. [Google Scholar] [CrossRef]
  69. Schiewe, P.; Stinzendörfer, M. Optimizing Combined Tours: The Truck-and-Cargo-Bike Case. OR Spectr. 2024, 46, 2545–2587. [Google Scholar] [CrossRef]
  70. Liu, K.; Zhang, T. Last-Mile Delivery Route Planning for Unmanned Vehicles Based on Improved Sparrow Search Algorithm. In Proceedings of the Chinese Control and Decision Conference (CCDC), Hefei, China, 15–17 August 2022. [Google Scholar] [CrossRef]
  71. Silva, M.A.; Pedroso, J.P. Deep Reinforcement Learning for Crowdshipping Last-Mile Delivery with Endogenous Uncertainty. Mathematics 2022, 10, 3902. [Google Scholar] [CrossRef]
  72. Shao, Q.; Cheng, S.-F. Preference-Aware Delivery Planning for Last-Mile Logistics. In Proceedings of the 22nd International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2023), London, UK, 29 May–2 June 2023; IFAAMAS: Richland, SC, USA, 2023; pp. 1–9. [Google Scholar]
  73. Merchán, D.; Arora, J.; Pachon, J.; Konduri, K.; Winkenbach, M.; Parks, S.; Noszek, J. 2021 Amazon Last Mile Routing Research Challenge: Dataset. Transp. Sci. 2022, 58, 8–11. [Google Scholar] [CrossRef]
  74. Kellermann, R.; Biehle, T.; Fischer, L. Drones for Parcel and Passenger Transportation: A Literature Review. Transp. Res. Interdiscip. Perspect. 2020, 4, 100088. [Google Scholar] [CrossRef]
  75. Ko, Y.; Kim, J.; Duguma, D.G.; Astillo, P.V.; You, I.; Pau, G. Drone Secure Communication Protocol for Future Sensitive Applications in Military Zone. Sensors 2021, 21, 2057. [Google Scholar] [CrossRef] [PubMed]
  76. Marques Júnior, E.L.; Coelho, V.N.; Coelho, I.M.; Frota, Y.A.; Koochaksaraei, R.H.; Ochi, L.S.; Coelho, B.N. UAVs Routes Optimization in Smart Cities and Regions. RAIRO-Oper. Res. 2022, 56, 853–869. [Google Scholar] [CrossRef]
  77. Wiedmann, T.; Allen, C. City Footprints and SDGs Provide Untapped Potential for Assessing City Sustainability. Nat. Commun. 2021, 12, 3758. [Google Scholar] [CrossRef] [PubMed]
  78. Dukes, E.S.M.; Cheng, S.L.; Mogen, S.; Galloway, J.; Leach, A.M.; Trimble, A.R.; Pettit, A.; Compton, J.E.; Pennino, M.J. Footprints in Action: How UVA Is Managing Its Sustainability Stewardship. Sustain. Clim. Change 2023, 16, 48–63. [Google Scholar] [CrossRef] [PubMed]
  79. Valls-Val, K.; Bovea, M. Carbon Footprints in Higher Education Institutions: A Literature Review and Prospects for Future Research. Clean Technol. Environ. Policy 2021, 23, 2523–2542. [Google Scholar] [CrossRef]
  80. Cesur Turgut, A.; Budak, T. Carbon Footprint of Logistics and Transportation: A Systematic Literature Review. Kent Akad. 2022. [Google Scholar] [CrossRef]
  81. Xu, G.; Zhao, Y.; Liu, H. Pursuit and Evasion Game between UVAs Based on Multi-Agent Reinforcement Learning. In Proceedings of the Chinese Automation Congress (CAC), Hangzhou, China, 22–24 November 2019. [Google Scholar] [CrossRef]
  82. Yan, Y.; Chow, A.H.F.; Ho, C.P.; Kuo, Y.-H.; Wu, Q.; Ying, C.-S. Reinforcement Learning for Logistics and Supply Chain Management: Methodologies, State of the Art, and Future Opportunities. Transp. Res. Part E Logist. Transp. Rev. 2021, 162, 102712. [Google Scholar] [CrossRef]
  83. Correll, R.R.; Weinberg, S.J.; Sanches, F.; Ide, T.; Suzuki, T. Quantum Neural Networks for a Supply Chain Logistics Application. Adv. Quantum Technol. 2022, 6, 2200183. [Google Scholar] [CrossRef]
  84. Zhang, Z.; Chen, J.; Zhao, W. Multi-AGV Route Planning in Automated Warehouse System Based on Shortest-Time Q-Learning Algorithm. Asian J. Control 2023, 26, 683–702. [Google Scholar] [CrossRef]
  85. Liu, X.S.; Bo, G. Q-Learning Algorithm for Fourth Party Logistics Route Optimization Considering Tardiness Risk. In Proceedings of the International Conference on Computational Science and Its Applications (ICCSI), Nanjing, China, 18–21 November 2022. [Google Scholar] [CrossRef]
  86. Silva, F.S.D.; Neto, E.P.; Oliveira, H.; Rosário, D.; Cerqueira, E.; Both, C.; Zeadally, S.; Neto, A.V. A Survey on Long-Range Wide-Area Network Technology Optimizations. IEEE Access 2021, 9, 106079–106106. [Google Scholar] [CrossRef]
  87. Machado, K.; Rosário, D.; Cerqueira, E.; Loureiro, A.A.; Neto, A.; De Souza, J.N. A Routing Protocol Based on Energy and Link Quality for Internet of Things Applications. Sensors 2013, 13, 1942–1964. [Google Scholar] [CrossRef]
  88. Akabane, A.T.; Immich, R.; Bittencourt, L.F.; Madeira, E.R.; Villas, L.A. Towards a Distributed and Infrastructure-Less Vehicular Traffic Management System. Comput. Commun. 2020, 151, 306–319. [Google Scholar] [CrossRef]
  89. Akabane, A.T.; Immich, R.; Pazzi, R.W.; Madeira, E.R.; Villas, L.A. Distributed Egocentric Betweenness Measure as a Vehicle Selection Mechanism in VANETs: A Performance Evaluation Study. Sensors 2018, 18, 2731. [Google Scholar] [CrossRef]
  90. Ciaburro, G.; Iannace, G. Improving Smart Cities Safety Using Sound Events Detection Based on Deep Neural Network Algorithms. Informatics 2020, 7, 23. [Google Scholar] [CrossRef]
  91. Kolomvatsos, K.; Anagnostopoulos, C. Reinforcement Learning for Predictive Analytics in Smart Cities. Informatics 2017, 4, 16. [Google Scholar] [CrossRef]
  92. Denk, M.; Bickel, S.; Steck, P.; Götz, S.; Völkl, H.; Wartzack, S. Digital Twins in UAV Path Planning: Enhancing 3D Navigation. Appl. Sci. 2023, 13, 105. [Google Scholar] [CrossRef]
Figure 1. UAV training using a deep reinforcement agent.
Figure 1. UAV training using a deep reinforcement agent.
Sustainability 16 07867 g001
Figure 2. The algorithm’s ability to find a path in a complex environment.
Figure 2. The algorithm’s ability to find a path in a complex environment.
Sustainability 16 07867 g002
Figure 3. Research framework.
Figure 3. Research framework.
Sustainability 16 07867 g003
Figure 4. D* algorithm implementation flowchart.
Figure 4. D* algorithm implementation flowchart.
Sustainability 16 07867 g004
Figure 5. Experimental methodology.
Figure 5. Experimental methodology.
Sustainability 16 07867 g005
Figure 6. Results of the simulations.
Figure 6. Results of the simulations.
Sustainability 16 07867 g006
Figure 7. Obstacle avoidance performance of the D*, A*, and RRT* algorithms.
Figure 7. Obstacle avoidance performance of the D*, A*, and RRT* algorithms.
Sustainability 16 07867 g007
Figure 8. Dynamic obstacle interaction of the D*, A*, and RRT* algorithms.
Figure 8. Dynamic obstacle interaction of the D*, A*, and RRT* algorithms.
Sustainability 16 07867 g008
Figure 9. Terrain adaptation of the D*, A*, and RRT* algorithms.
Figure 9. Terrain adaptation of the D*, A*, and RRT* algorithms.
Sustainability 16 07867 g009
Figure 10. Weather resilience of the D*, A*, and RRT* algorithms.
Figure 10. Weather resilience of the D*, A*, and RRT* algorithms.
Sustainability 16 07867 g010
Figure 11. Localization challenges for the D*, A*, and RRT* algorithms.
Figure 11. Localization challenges for the D*, A*, and RRT* algorithms.
Sustainability 16 07867 g011
Figure 12. Path efficiency comparison.
Figure 12. Path efficiency comparison.
Sustainability 16 07867 g012
Figure 13. Comparison of path planning algorithms.
Figure 13. Comparison of path planning algorithms.
Sustainability 16 07867 g013
Table 1. Comparison of the features of the D*, A*, and RRT* algorithms.
Table 1. Comparison of the features of the D*, A*, and RRT* algorithms.
FeatureD* AlgorithmA* AlgorithmRRT* Algorithm
OriginVarious applications in robotics and AI [35]Pathfinding and navigation [5,13]Motion planning in high-dimensional spaces [28]
EfficiencyDepends on a specific algorithm [45]High efficiency for optimal paths [20,27,46]Rapid exploration of state spaces [21,44]
OptimalityVaries depending on the algorithm [33]Guaranteed under certain conditions [18]Near optimal with iterative refinement [22,42]
AdaptabilityDepends on a specific algorithm [34]Adaptable to various environments [61]Well suited for dynamic environments [21]
ScalabilityVaries depending on the algorithm [26]Suitable for high-dimensional spaces [29]Scalable to high-dimensional configurations [32]
ApplicationsDiverse applications in robotics and AI [37]Route planning, navigation, robotics [28]UAV navigation, motion planning [31,32]
Integration potentialCan be integrated with other algorithms [36]Can be integrated with other techniques [30]Can be combined with other navigation methods [34]
LimitationsDepends on a specific algorithm [25]May struggle in dynamic environments [20]May struggle in narrow or constrained spaces [27]
Table 2. Algorithm parameters and settings.
Table 2. Algorithm parameters and settings.
AlgorithmParameterValue/Setting
D* algorithmThreshold value0.01
Maximum iterations500
Heuristic weight1
Collision avoidance radius0.5 m
A* algorithmHeuristic typeEuclidean distance
Heuristic weight1.2
Path smoothingEnabled
Maximum iterations1000
RRT* algorithmExpansion radius1.0 m
Rewiring radius1.5 m
Goal bias0.05
Maximum iterations2000
Table 3. Scenarios and challenges for evaluating the D* algorithm.
Table 3. Scenarios and challenges for evaluating the D* algorithm.
ScenarioDescription
Obstacle avoidanceThe UAV navigates through cluttered environments with static and dynamic obstacles, assessing collision avoidance capabilities.
Dynamic obstacle interactionScenarios simulate dynamic obstacles such as moving vehicles or wildlife, necessitating real-time re-planning and adjustments.
Terrain adaptationThe UAV encounters varying terrain types, testing the algorithm’s path planning in rugged, sloped, or uneven landscapes.
Weather resilienceSimulation environments introduce adverse weather conditions, demanding robust navigation under reduced visibility or high winds.
Localization challengesScenarios incorporate sensor inaccuracies or GPS signal loss, challenging the algorithm’s ability to maintain accurate localization.
Table 4. Simulation environment details.
Table 4. Simulation environment details.
ParameterValue/Description
Simulated area size2 square kilometers
Terrain typesUrban, forested, open field
Weather conditionsClear skies, occasional gusts of wind
Lighting conditionsDaylight with realistic sunlight
Obstacle typesBuildings, trees, rocks
Obstacle distributionRandomly placed in the environment
Environmental variabilityRandom wind gusts, varying light
Simulation time scale1 real-time second = 10 simulated seconds
GPS signal qualityHigh accuracy, minimal drift
Sensor noiseSimulated sensor noise added
GPS interferenceOccasional GPS signal interference
Table 5. Scenarios and challenges in the simulations.
Table 5. Scenarios and challenges in the simulations.
ScenarioDescription
Obstacle avoidanceUAV navigates through cluttered environments with static and dynamic obstacles. Sensor data include Lidar point clouds, IMU data, and camera imagery. Weather conditions and lighting are varied for realism.
Dynamic obstacle InteractionScenarios simulate dynamic obstacles such as moving vehicles or wildlife, necessitating real-time re-planning and adjustments. Sensor data include Lidar point clouds, IMU data, and camera imagery. Weather conditions and lighting are varied for realism.
Terrain adaptationThe UAV encounters varying terrain types, including rugged, sloped, and uneven landscapes. Sensor data include Lidar point clouds, IMU data, and camera imagery. Weather conditions and lighting are varied for realism.
Weather resilienceSimulation environments introduce adverse weather conditions such as wind, rain, and fog, demanding robust navigation under reduced visibility. Sensor data include Lidar point clouds, IMU data, and camera imagery. Weather conditions and lighting are controlled.
Localization challengesScenarios incorporate sensor inaccuracies and occasional GPS signal interference, challenging the algorithm’s ability to maintain accurate localization. Sensor data include Lidar point clouds, IMU data, and camera imagery. Weather conditions and lighting are controlled.
Table 6. Sensor data samples.
Table 6. Sensor data samples.
Sensor TypeData RepresentationData Characteristics
Lidar point clouds3D point clouds
-
X, Y, Z coordinates of multiple points in 3D space
-
Reflectance values for each point
-
Simulated scanning patterns and angles
IMU dataAcceleration and gyro
-
Linear acceleration on X, Y, Z axes
-
Angular velocity around X, Y, Z axes
-
Simulated noise and biases for realism
Camera imageryRGB images
-
Color images representing the UAV’s visual perspective
-
Simulated camera parameters (e.g., focal length)
-
Realistic lighting and shading effects
Table 7. Obstacle avoidance.
Table 7. Obstacle avoidance.
D* AlgorithmA* AlgorithmRRT* Algorithm
Path efficiency0.920.850.88
Completion time120 s135 s130 s
Collision rate0.050.120.1
Safety margin2.3 m1.8 m2.0 m
Table 8. Dynamic obstacle interaction.
Table 8. Dynamic obstacle interaction.
D* AlgorithmA* AlgorithmRRT* Algorithm
Path efficiency0.890.860.88
Completion time125 s130 s128 s
Collision rate0.080.10.09
Safety margin2.2 m2.1 m2.0 m
Table 9. Terrain adaptation.
Table 9. Terrain adaptation.
D* AlgorithmA* AlgorithmRRT* Algorithm
Path efficiency1.930.890.92
Completion time115 s125 s120 s
Collision rate0.030.10.08
Safety margin2.5 m2.0 m2.2 m
Table 10. Weather resilience.
Table 10. Weather resilience.
D* AlgorithmA* AlgorithmRRT* Algorithm
Path efficiency0.90.850.87
Completion time130 s140 s135 s
Collision rate0.070.140.11
Safety margin2.4 m1.9 m2.1 m
Table 11. Localization challenges.
Table 11. Localization challenges.
D* AlgorithmA* AlgorithmRRT* Algorithm
Path efficiency0.910.880.89
Completion time125 s140 s135 s
Collision rate0.060.110.09
Safety margin2.3 m2.0 m2.2 m
Table 12. Performance metrics comparison.
Table 12. Performance metrics comparison.
ScenarioMetricD* AlgorithmA* AlgorithmRRT* Algorithm
Scenario 1Path efficiency0.920.850.88
Completion time120 s135 s130 s
Collision rate0.050.120.1
Safety margin2.3 m1.8 m2.0 m
Scenario 2Path efficiency0.880.820.85
Completion time150 s165 s160 s
Collision rate0.080.140.12
Safety margin2.1 m1.7 m1.9 m
Scenario 3Path efficiency0.940.890.92
Completion time110 s125 s120 s
Collision rate0.030.10.08
Safety margin2.5 m2.0 m2.2 m
Scenario 4Path efficiency0.90.840.87
Completion time140 s155 s150 s
Collision rate0.070.130.11
Safety margin2.2 m1.9 m2.1 m
Scenario 5Path efficiency0.850.80.83
Completion time160 s175 s170 s
Collision rate0.10.160.14
Safety margin2.0 m1.6 m1.8 m
Scenario 6Path efficiency0.910.860.89
Completion time130 s145 s140 s
Collision rate0.060.110.09
Safety margin2.4 m1.7 m2.0 m
Scenario 7Path efficiency0.890.830.89
Completion time145 s170 s140 s
Collision rate0.090.140.07
Safety margin2.1 m1.8 m2.3 m
Scenario 8Path efficiency0.930.860.86
Completion time115 s155 s140 s
Collision rate0.040.090.09
Safety margin2.6 m2.1 m2.0 m
Scenario 9Path efficiency0.870.850.91
Completion time165 s150 s140 s
Collision rate0.110.120.09
Safety margin1.9 m2.1 m2.0 m
Scenario 10Path efficiency0.920.880.86
Completion time125 s160 s140 s
Collision rate0.060.090.07
Safety margin2.2 m2.3 m2.3 m
Table 13. Path planning results.
Table 13. Path planning results.
ScenarioAlgorithmWaypointsPath Length (m)
Scenario 1D* algorithm(42.1234, −71.5678)–(42.1236, −71.5682)230.5
A* algorithm(42.1234, −71.5678)–(42.1235, −71.5680)–(42.1236, −71.5682)235.2
RRT* algorithm(42.1234, −71.5678)–(42.1235, −71.5680)–(42.1236, −71.5682)239.1
Scenario 2D* algorithm(42.1450, −71.5890)–(42.1451, −71.5892)189.7
A* algorithm(42.1450, −71.5890)–(42.1451, −71.5892)195.3
RRT* algorithm(42.1450, −71.5890)–(42.1451, −71.5892)200
Scenario 3D* algorithm(42.1355, −71.5765)–(42.1357, −71.5767)–(42.1359, −71.5769)312.4
A* algorithm(42.1355, −71.5765)–(42.1357, −71.5767)–(42.1359, −71.5769)318.2
RRT* algorithm(42.1355, −71.5765)–(42.1357, −71.5767)–(42.1359, −71.5769)324
Scenario 4D* algorithm(42.1200, −71.5600)–(42.1210, −71.5610)–(42.1220, −71.5620)421.3
A* algorithm(42.1200, −71.5600)–(42.1210, −71.5610)–(42.1220, −71.5620)428.7
RRT* algorithm(42.1200, −71.5600)–(42.1210, −71.5610)–(42.1220, −71.5620)433.1
Scenario 5D* algorithm(42.1300, −71.5700)–(42.1310, −71.5710)–(42.1320, −71.5720)315.6
A* algorithm(42.1300, −71.5700)–(42.1310, −71.5710)–(42.1320, −71.5720)321
RRT* algorithm(42.1300, −71.5700)–(42.1310, −71.5710)–(42.1320, −71.5720)326.4
Scenario 6D* algorithm(42.1100, −71.5800)–(42.1110, −71.5810)–(42.1120, −71.5820)258.7
A* algorithm(42.1100, −71.5800)–(42.1110, −71.5810)–(42.1120, −71.5820)263.5
RRT* algorithm(42.1100, −71.5800)–(42.1110, −71.5810)–(42.1120, −71.5820)269
Scenario 7D* algorithm(42.1400, −71.5900)–(42.1410, −71.5910)–(42.1420, −71.5920)385.2
A* algorithm(42.1400, −71.5900)–(42.1410, −71.5910)–(42.1420, −71.5920)391.8
RRT* algorithm(42.1400, −71.5900)–(42.1410, −71.5910)–(42.1420, −71.5920)397.4
Scenario 8D* algorithm(42.1250, −71.5700)–(42.1255, −71.5710)–(42.1260, −71.5720)173.4
A* algorithm(42.1250, −71.5700)–(42.1255, −71.5710)–(42.1260, −71.5720)179.1
RRT* algorithm(42.1250, −71.5700)–(42.1255, −71.5710)–(42.1260, −71.5720)183.7
Scenario 9D* algorithm(42.1280, −71.5780)–(42.1285, −71.5790)–(42.1290, −71.5800)290.9
A* algorithm(42.1280, −71.5780)–(42.1285, −71.5790)–(42.1290, −71.5800)296.7
RRT* algorithm(42.1280, −71.5780)–(42.1285, −71.5790)–(42.1290, −71.5800)302.3
Scenario 10D* algorithm(42.1380, −71.5840)–(42.1385, −71.5850)–(42.1390, −71.5860)410.5
A* algorithm(42.1380, −71.5840)–(42.1385, −71.5850)–(42.1390, −71.5860)416.2
RRT* algorithm(42.1380, −71.5840)–(42.1385, −71.5850)–(42.1390, −71.5860)421.8
Table 14. Comparative analysis of navigation algorithms.
Table 14. Comparative analysis of navigation algorithms.
AlgorithmComputational
Efficiency
RobustnessAdaptability
D* algorithmModerateHighHigh
A* algorithmLowModerateModerate
RRT* algorithmModerateModerateModerate
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Suanpang, P.; Jamjuntr, P. Optimizing Autonomous UAV Navigation with D* Algorithm for Sustainable Development. Sustainability 2024, 16, 7867. https://doi.org/10.3390/su16177867

AMA Style

Suanpang P, Jamjuntr P. Optimizing Autonomous UAV Navigation with D* Algorithm for Sustainable Development. Sustainability. 2024; 16(17):7867. https://doi.org/10.3390/su16177867

Chicago/Turabian Style

Suanpang, Pannee, and Pitchaya Jamjuntr. 2024. "Optimizing Autonomous UAV Navigation with D* Algorithm for Sustainable Development" Sustainability 16, no. 17: 7867. https://doi.org/10.3390/su16177867

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop