Next Article in Journal
Study on Surrounding Rock Control and Support Stability of Ultra-Large Height Mining Face
Next Article in Special Issue
Convolutional Neural Networks for Classifying Electronic Components in Industrial Applications
Previous Article in Journal
Verification of Utilizing Nanowaste (Glass Waste and Fly Ash) as an Alternative to Nanosilica in Epoxy
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Machine Learning in Creating Energy Consumption Model for UAV

by
Krystian Góra
*,
Paweł Smyczyński
,
Mateusz Kujawiński
and
Grzegorz Granosik
*
Institute of Automatic Control, Lodz University of Technology, 90-537 Lodz, Poland
*
Authors to whom correspondence should be addressed.
Energies 2022, 15(18), 6810; https://doi.org/10.3390/en15186810
Submission received: 17 August 2022 / Revised: 9 September 2022 / Accepted: 14 September 2022 / Published: 18 September 2022
(This article belongs to the Special Issue Artificial Neural Network in Engineering)

Abstract

:
The growing interest in the utilization of Unmanned Aerial Vehicles (UAVs) demands minimizing the costs of robot maintenance, where one of the main aspects relates to energy consumption. This manuscript presents a novel approach to create an energy consumption model for UAVs. The authors prove, based on experimentally collected data using a drone carrying various payloads, that Machine Learning (ML) algorithms allow to sufficiently accurately estimate a power signal. As opposed to the classical approach with mathematical modeling, the presented method does not require any knowledge about the drone’s construction, thus making it a universal tool. Calculated metrics show the Decision Tree is the most suitable algorithm among eight different ML methods due to its high energy prediction accuracy of at least 97.5% and a short learning time which was equal to 2 ms for the largest dataset.

1. Introduction

Over the last years, several papers related to Unmanned Aerial Vehicles (UAVs) have been published. Many of which investigate optimization techniques, especially in the package delivery task, proving system cost reduction [1,2,3] by utilizing drones that are more environmentally friendly [4,5,6] when compared to alternative solutions.
The popularity of investigating drones relates to their unlimited use cases. For example, the authors of [7] discussed UAV use cases in, among others, construction inspection, investigation and treatments in agriculture, transport and delivery applications, security supervising, and entertainment and filming. The authors argued that the energy consumption model should be based on the type of drone (whether it is a fixed-wing or a rotorcraft), altitude (propellers have to rotate faster at higher altitudes because of lower air density causing an increase in energy consumption), type of flight (hovering or forward flight), climbing speed, payload, and weather conditions (wind speed and direction).
Another interesting field of UAV usage relates to 5G technology. In [8], the authors utilized UAVs as flying base stations to improve transmission power. A similar solution is shown in [9] where drones carrying wireless network cards provide WiFi access to ground users. The authors of [10] extended functionalities by considering also the impact of renewable energy on creating a recharging schedule.
Zhang et al. in [11], based on a literature overview, summarized previous investigations and highlighted the fact that, in most papers, power estimation is based on simple, often linear, mathematical models, and there is little consideration of the nonlinear wind impact, which when omitted can cause the predicted energy to be even two times lower than the real consumption.
We can observe an increasing amount of papers proposing methods of minimizing UAV power consumption. The authors of [12] proposed optimizing the UAV flight time by using not only batteries as a power supply but also utilizing additional fuel cells and super-capacitors. In [13], the authors showed that public buses carrying recharge stations can be used by surveillance UAVs in the city to extend the operational time. The importance of considering power aspects in UAV forces the researchers to be looking for convenient methods of UAV charging [14,15].
The reason for simplifying UAV’s energy model is the high complexity of the task and the fact that an accurate modeling approach is not often necessary during consideration of drone use cases. Most mathematical models solve the power consumption forecast challenge by using linear models that can depend only on the drone’s payload [4,16,17,18,19], or even by expressing the energy consumption as unit cost per traveled distance [1,5,20,21]. Some models consider the impact of flying altitude [22], especially for the surveillance use cases as a trade-off between consumed energy and a supervised area [23,24].
The linearity assumptions are valid for simplification when considering some use cases as optimal path planning for the fleet of UAVs delivering packages or in surveillance tasks using simulation. Nevertheless, the solution implementation can be infeasible in the real world. The existing nonlinearities can cause safety issues when power consumption is underestimated, resulting in an earlier battery’s full discharge as shown in [25].
There are a few papers considering more input parameters such as a UAV payload and a varying velocity [26] in addition to the lift-to-drag ratio [27]. Only a fraction of methodologies utilize the wind impact on the drone due to uncommon wind measurement units, rarely available on commercial UAVs [3], and parameters describing the drone’s rotors [28,29]. The authors of [30] also considered the power consumed by electronics, differentiating states when the drone is idle or armed. These models prove that the characteristic of power consumed in the function of total drone mass is nonlinear, similar to exponential. Moreover, considering the impact of wind, the power function is convex, with a local minimum. When the airspeed is low, the consumed power can be higher than in conditions of mild wind [11,26,28,29]. Unfortunately, the stronger wind has to be countered during flying causing an increase in energy demand. The main drawback of including information about wind in the energy model is the necessity of calibration using the anemometer’s real data. This means there is a need of conducting tests in an unpredicted outside environment or in controllable form, using aerodynamic tunnels which can be unavailable for larger drones. However, the data from anemometers can be estimated based on the so-called wind triangle. The calculation is created by a flight vector v, a ground vector (from GPS (Global Positioning System)) w, and a wind vector u. When only w is given, v is estimated based on roll and pitch angles collected from the Inertial Measurement Unit (IMU) as shown in [31,32]. In [33], the authors proved that the Machine Learning (ML) algorithms can accurately estimate wind speed and direction utilizing this approach.
Concerning the present literature and investigations, we spotted the problem that researchers who do not want to examine deeply the relations between drone construction and its power consumption have to use simple analytical models which can be infeasible during real-world tests. We are aware that even the simplest models need to be properly identified so that the necessity of collecting power consumption data is unavoidable. For this reason, we verified available alternative methodologies for modeling energy consumption.
We decided to consider energy as a result of integrating the power signal. In [34], the authors claimed that the Artificial Neural Network (ANN) can outperform classical statistical forecasting approaches when a sufficient amount of data is available and can be as good when less data are delivered. On the other hand, the authors of [35], comparing 28 studies where ANN and regression models were used, asserted that ANN outperforms regression in 36%, outperformed in 14%, and had similar results in 50%. Nevertheless, the results show that both approaches can be used as they have similar performance, especially for large datasets. We chose to get a wider perspective and instead of using only ANN, we inspected different ML algorithms.
A justified usage of ML for energy forecasting is well described for smart buildings. In [36], the authors used three machine learning methods: K-Nearest Neighbors (KNN), Support Vector Machine (SVM), and Artificial Neural Network (ANN) to predict the energy consumption in smart buildings in Malaysia. The results show the SVN had the highest accuracy, but the training lasted 18 h. On the contrary, the training of KNN lasted only 40 s and the results were not significantly worse. Both methods outperformed the ANN. On the other hand, in [37], the authors used linear regression, SVM, and different configurations of multi-layer ANN to predict building energy consumption in Greece. The researchers obtained the smallest energy cost prediction error for the ANN method. Unfortunately, the performance of ANN is highly correlated with the size and quality of collected data. In [38], the authors predicted the building energy consumption based on the time of the day using ANN; the final error oscillated between 2% and 36% which makes it unpredictable. In [39], the authors examined 12 ML methods for predicting water and energy consumption in buildings again proving that is possible to acquire highly precise forecasts using artificial intelligence.
In the robotics field, there are still gaps in utilizing ML for energy consumption estimation. We already proved in [40] that the ANN can be utilized exchangeably with complex, analytical models for energy prediction of Unmanned Ground Vehicles. In this paper, we propose substituting a default mathematical modeling with a more universal ML algorithm to predict a drone’s power consumption. The utilization of our approach is easier and faster because it does not demand knowledge about UAV construction. This is a significant advantage, especially for multi-robot system owners which do not have the resources for creating an analytical energy model for each robot. To prove the high performance of our original approach, we decided to collect power consumption data using a drone carrying different payloads in a real environment. Additionally, we investigated how choosing an ML algorithm impacts the final solution. We decided to compare the performance of eight algorithms by calculating the Root Mean Squared Error (RMSE) of the forecast power signal, the relative error of predicted energy, and the computational effort by measuring learning time.
The paper is divided as follows. Section 2 contains a description of test equipment and methodology. In Section 3, the research results are presented. Section 4 and Section 5 show a discussion of the outcomes and conclusions of conducted research with directions for developing our research, respectively.

2. Materials and Methods

In this paper, we investigate energy consumption algorithms based on data gathered using one of our hexacopter presented in Figure 1.
The drone has six 18-inch propellers, weighs 6 kg, and has a Maximum Takeoff Mass (MTOM) of 13 kg. The custom-made construction has a carbon fiber frame and aluminum legs, with elements made in the Selective Laser Sintering process.
The power data were collected using a voltage and current Hall sensor Mauch HS-200- LV/HV capable to measure a current up to 200 A with 10 Hz frequency. To decrease the noise impact, each of ten consecutive power samples was averaged, resulting in the frequency reduction to 1 Hz.
Due to rarely available equipment for wind speed and direction on the drone’s board, we used an indirect method for wind estimation based on UAV’s orientation. Although, the approach described in the literature requires calibration. We were not interested in the designation of exact wind parameters but we want to know the impact on the power consumption; so, we assumed passing the drone’s orientation as an input of the ML algorithm should be sufficient.
We collected data during automatic and more sophisticated manual mission execution by UAV without any and with additional payload weights of 2, 4, and 6 kg. The automatic measurements were collected for the hourglass shape trajectory with a goal velocity equal to 4 m/s. The path shape was chosen to check if the wind direction has a significant influence on the UAV flight. Additionally, during that shape, we turn in clockwise and counterclockwise directions equally; so, we could compare if the direction of turn is important. The hourglass-shaped path provides various training data. There are recorded fragments with acceleration, deceleration, and constant speed flight. Moreover, the UAV is turning in both directions around the yaw axis. The purpose of the manual fly was to validate the training model during flying at different speeds.
We gathered the following data:
  • The altitude of the drone z g (m);
  • The linear drone’s velocities ( v x , v y , v z ) (m/s);
  • The angular drone’s velocities ( ω x , ω y , ω z ) (rad/s);
  • The orientation of the drone: roll, pitch, yaw ( γ , θ , ψ ) (rad);
  • The total drone mass m (kg);
  • The power consumption of the drone P (W).
We decided to calculate a correlation matrix to optimize the number of required inputs using the Pearson correlation coefficient. The approach allows sorting data importance and deciding which inputs can be reduced without significant influence on the algorithm accuracy.
The collected data were synchronized with power signal samples (1 Hz) and were divided into eight training and testing datasets, as shown in Figure 2.
1.
We divided all of the data logs into two groups: collected during automatic and manual flights.
2.
From the set containing automatic data logs, we have chosen a few data logs which had been shuffled. The rest of the logs from this set were merged with the other group containing manual test information.
3.
The single training dataset contained from 10% up to 80% with a 10% step of the shuffled data logs.
4.
The testing dataset contained the rest samples.
Each separate dataset was named as Division X%, which should be understood as X% of the samples from the colorful group (see Figure 2), is merged into the test data, and the rest is used as training data.
In our research, we used implementations available in scikit-learn Python’s package. In the preprocessing, we scaled the collected data to unit variance and removed the mean. This provides the best performance when using methods requiring standard normally distributed data. To find the scaling formula z, we used (1):
z = x u s ,
where x is the original value, u is the mean, and s is the standard deviation of the training dataset.
The purpose of this research is to prove that based on known velocities, altitude, orientation, and mass of the drone, a highly accurate energy consumption model can be established. We do not consider any information about UAV’s construction such as the number of rotors, the parameters of motors and blades, etc. As a result, our solution would be compatible with any type of UAV.
In our research, we compared the following ML algorithms:
  • Adaptive Boosting Decision Trees;
  • Decision Tree;
  • Gradient Boosting Decision Trees;
  • K-Nearest Neighbors;
  • Elastic Net Regression;
  • Random Forest;
  • Support Vector Machine;
  • Feed-forward Artificial Neural Network.
To choose the best algorithm configuration, we utilized Grid Search Cross-Validation (CV) on the training dataset containing 50% of shuffled data logs. We were looking for the best solution among configurations created by mixing all of the parameters shown in Table 1. The approach allowed us to fully automatize the learning process. The best-found estimator’s parameters are summarized in the next section.
To assess algorithms’ performance, we used the power signal’s Root Mean Squared Error (RMSE) (2). We integrated the power signal using the trapezoidal rule to calculate real E and estimated energy E ^ as (3) and (4), respectively. The relative error of predicted energy ϵ was calculated as (5). The average algorithm learning time is equal to a mean training time in Grid CV (only performed for the Division 50%) or a total learning time (in the rest of the Divisions).
R M S E = 1 n · i = 0 n 1 ( p i p ^ i ) 2 ,
E = i = 1 n p i 1 + p i 2 ,
E ^ = i = 1 n p ^ i 1 + p ^ i 2 ,
ϵ = 100 · | E E ^ | E ,
where p i is an i-th sample of the real power signal, p ^ i is an i-th sample of the predicted power signal, and n is the total number of samples in both power signals.

3. Results

We collected data during 9 separate automatic tests with different payloads (2 × 0 kg, 2 × 2 kg, 2 × 4 kg, and 3 × 6 kg). During each test, the UAV executed the mission until maximum battery discharge, resulting in up to 20 hourglass-shape paths with a 3 s hover between consecutive loops. An example path is shown in Figure 3.
Additionally, we gathered sophisticated data during 3 manual tests with different payloads where the UAV velocity was randomly varied. An example of linear velocity along the drone’s x-axis during the manual test is presented in Figure 4.
Using all collected datasets, we calculated correlations between collected data and we draw a heatmap presented in Figure 5. The relations between a power (output value) and the rest of the input values can be found in the last row of the heatmap.
Due to the low relevance of angular velocities (wx, wy, wz), we decided to remove them from further research to speed up the computation. The block diagram of the energy consumption model is shown in Figure 6.
The power samples for the complete dataset (training and testing) are shown in Figure 7 where colors correspond to the total mass in kg.
As part of the training set, we choose the four first data logs presented in Figure 7, the rest data logs are included in the testing dataset.
As Grid Search CV (for the Division 50%) results, we acquired the best parameters listed in bold in Table 1 for the investigated algorithms.
The outcome power signals for training and testing datasets for each of the considered ML method are shown in Figure 8, Figure 9, Figure 10, Figure 11, Figure 12, Figure 13, Figure 14 and Figure 15.
The samples up to 1500 s are randomly chosen from the training dataset, as shown in Figure 2, the following samples contain data from testing logs.
Integration of ML algorithms output power signals produces the estimated consumed energy amount in Watt Hour (Wh), as shown in Table 2. The consumed energy calculated for the testing dataset based on measured power is equal to 2358 Wh.
In further research, we compared the relative error of estimated energy for all Divisions. The results are presented in Figure 16.
The RMSE for each Division is shown in Figure 17.
To compare computational efforts, we decided to calculate the average training time for each of the considered algorithms. The outcomes are presented in Figure 18.
Finally, we scored all of the Divisions allocating a maximum of 8 points and a minimum of 1 point for the best and the worst outcome in each category as follows:
  • The maximum 8 points were allocated for the testing set with the lowest RMSE;
  • The maximum 8 points were allocated for the testing set with the lowest relative error;
  • The maximum 8 points were allocated for the testing set with the shortest learning time.
The results are presented in Table 3, and detailed outcomes of research are placed in Appendices for RMSE, the relative error of predicted energy, and average algorithm learning time in Table A1, Table A2 and Table A3, respectively.

4. Discussion

Considering mathematically calculated correlations between consumed power and input parameters, it can be noticed that the most relevant information (correlation equals 0.83) is the total UAV mass. The impact could be also seen based on the collected power samples presented in Figure 7. There is a significant power offset between points corresponding to different weights of the robot.
The high correlation with the yaw angle (−0.3) results from directional wind impact during the tests. For a specific part of the executed trajectory, the yaw angle was constant but power consumption depended on the wind impact which created the correlation. We decided not to remove the yaw angle from model inputs because the difference between heading and flight speed is crucial when considering other flying machines such as airframes.
The next quite large correlation with the drone’s altitude (0.27) relates to power peaks caused by altitude changes during manual test flights (see Figure 19). In the automatic approach, the drone was tested at the same altitude equal to 20 m. The impact of linear velocity along the drone’s z-axis can be considered analogously.
The correlation of the rest of the inputs is relatively small, especially angular velocities which we omitted during the proceeding research.
Observing graphs presented in Figure 8, Figure 9, Figure 10, Figure 11, Figure 12, Figure 13, Figure 14 and Figure 15, it can be noticed that for short periods, the power signal is changing. It indicates that all of the measured inputs have an impact on the power profile. Nevertheless, in the long term, the fluctuations could be replaced by a constant average power value calculated for a specific total drone’s mass. Then, the average power for a specific mass can be calculated and used to estimate an energy cost. It explains why many researchers decide to simplify the UAV model as a function of mass.
Considering the power measurements collected during manual flights, most of the tested methods were reliable. Unfortunately, two of them, KNN and ANN, generated highly unpredictable values.
Investigating RMSE and relative energy prediction errors, we can see a decreasing trend for the simplest algorithms (KNN and Elastic Net) with a decrease in the training set. It highlights the problem during training, causing a loss of approximating abilities of the algorithms. It results in a poor estimation of the testing dataset. Nevertheless, the KNN and Elastic Net algorithms are computationally light approaches.
The Artificial Neural Network is characterized by a low relative energy error, although it contains high RMSE. The ANN is good for predicting learned patterns but generates a high noise signal for the manual part of testing data (Figure 15) which makes this method uncertain. Additionally, it demands a lot of computation time, which increases for larger datasets.
More stable, but still not the best results are produced by the SVM algorithm. The training process is quite fast due to the simple linear kernel chosen in the Grid Search CV process. The disadvantage of the chosen SVM configuration is a linearization of the power model.
The best outcomes are generated by decision-tree-based methods. The learning time can vary depending on the size of creating a set of trees, for a single tree, the time is almost equal to zero, but for ensemble methods, it can be longer, sometimes unreasonable long as shown for Adaptive Boosting in Figure 18 for a 0.2 test size. The predicted power profiles are stable, working as well for learning hourglass-shaped pattern as for sophisticated manual flights.
Sorting the algorithms based on the obtained results from the best to the worst for the UAV energy consumption prediction task, we obtain the following list:
1.
Decision Tree;
2.
Adaptive Boosting Decision Trees;
3.
Gradient Boosting Decision Trees;
4.
Random Forest;
5.
K-Nearest Neighbors;
6.
Elastic Net Regression;
7.
Support Vector Machine;
8.
Feed-forward Artificial Neural Network.
Referring to Table 2, most of the algorithms overestimated consumed energy (the predicted energy value was higher than the real). Unfortunately, KNN and Elastic Net underestimated it which can cause serious problems. Overestimation can only decrease the system’s performance as the drone will not use the whole available energy. In case of underestimation, the battery can fully discharge earlier than assumed and as a result, the drone will fall with a high probability of system destruction.

5. Conclusions

The Machine Learning algorithms are capable of properly estimating UAV energy consumption. The chosen algorithm for a specific application should consider the CPU (Central Processing Unit) computational power, especially when computer resources are limited. Although more advanced algorithms such as ANN and SVM have poor performance where training data are not diverse enough. One advantage of Neural Networks is that they can be easily calibrated online, thus improving prediction performance.
The main reason for the best accuracy of the decision tree is a high impact of only one input, i.e., the robot’s weight. It means that the power signal could be well estimated using just a simple “if-else” statement considering only the mass. Due to that fact, the mathematical model simplifications used in other papers could be valid for simple applications in a stable environment, where the robot’s mass is not changing and wind conditions do not change rapidly.
The utilization of Machine Learning is not a perfect solution for solving energy prediction tasks. The risk of underestimating energy disqualifies the approach for standalone usage in safety-critical systems. Nevertheless, it still can be considered when combined with redundancy safety precautions monitoring the battery state of charge. There is a high probability that a complex mathematical model can outperform the introduced approach, but we propose a trade-off solution providing satisfactory results with minimal effort. Designers can easily delegate the problem of modeling dependencies to computers. This universality is one of the advantages of ML over the classical mathematical approach. The ML model treats a robot as an abstract object which moves in the three-dimensional space. It is not necessary to consider the drone’s construction as the methodology allows for calibrating the model automatically. The approach could be used by researchers and commercial users who do not want to create complicated analytical models to receive a highly accurate solution. The competitive edge of ML can be highlighted when it will be utilized in a multi-robot system. For people who use many different robots, the fully automated process of creating energy models could be very convenient as it saves time and money.
It can be observed that a significant part of the total drone’s cost is the power supply subsystem which contains expensive, relatively short-living batteries. Additionally, constantly growing energy prices enlarge the UAV’s costs. We believe that there will be demand for easily integrable energy models in the near future and the proposed approach will not remain only an academic consideration.
As part of our future work, we are planning to integrate the presented research with our previous work to investigate the solution performance in real-world applications. We would like to utilize energy prediction algorithms for a multi-robot system where UAVs realize tasks considering battery capacity constraints and cooperate with Unmanned Ground Vehicles carrying a battery swap station. The purpose of such a system is to provide optimal and long-term mission performance. Thanks to the advantages of the ML-based approach, we can easily implement a unified software package. It will be executed on any type of drone, calibrating estimation model parameters in an automatic manner. The methodology should allow us to create a distributed system where each robot will be a node-providing energy prediction to the system’s supervisor. In the next step, we will investigate how to find an optimal way to generate power consumption model inputs based on the mission plan.

Author Contributions

Conceptualization, K.G.; methodology, K.G. and P.S.; software, K.G. and P.S.; validation, K.G. and P.S.; formal analysis, K.G.; investigation, K.G.; resources, P.S. and M.K.; data curation, K.G.; writing—original draft preparation, K.G.; writing—review and editing, M.K. and G.G.; visualization, K.G.; supervision, G.G.; project administration, M.K.; funding acquisition, M.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research was partially funded by the National Centre for Research and Development in Poland, (grant number LIDER/38/0210/L-10/18/NCBR/2019), and as part of the program “FU2N—Fundusz Udoskonalania Umięjętności Młodych Naukowców” supporting scientific excellence in the Lodz University of Technology (grant number I21/503-2-21-4-1).

Data Availability Statement

Corresponding author will share the data on request.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
UAVUnmanned Aerial Vehicle
MLMachine Learning
ANNArtificial Neural Network
IMUInertial Measurement Unit
CVCross-Validation
RMSERoot Mean Squared Error
KNNK-Nearest Neighbors
SVNSupport Vector Machine
GPSGlobal Positioning System
CPUCentral Processing Unit
MTOMMaximum Takeoff Mass

Appendix A

Table A1. The RMSE value for the test dataset.
Table A1. The RMSE value for the test dataset.
Division [%]1020304050607080
AlgorithmRMSE [W]
Adaptive Boosting Decision Trees207213204219231234238203
Decision Tree281273223221215220229273
Gradient Boosting Decision Trees278269260268241245236220
K-Nearest Neighbors551536527517496488511394
Elastic Net Regression361355347336327320326320
Random Forest235228223224226253225239
Support Vector Machine345335334331331327332342
Feed-forward Artificial Neural Network479402356425335383442438
Table A2. The energy prediction relative error value for the test dataset.
Table A2. The energy prediction relative error value for the test dataset.
Division [%]1020304050607080
AlgorithmRelative Error of Predicted Energy [%]
Adaptive Boosting Decision Trees3.82.62.72.72.74.23.62.1
Decision Tree1.62.51.11.21.41.11.51.7
Gradient Boosting Decision Trees3.33.42.83.72.81.61.73.6
K-Nearest Neighbors32.82.82.62.92.51.81.9
Elastic Net Regression11.310.59.48.66.866.56.5
Random Forest3.42.74.32.83.70.82.70.1
Support Vector Machine5.44.95.25.65.54.95.54.5
Feed-forward Artificial Neural Network2.60.82.430.70.20.71.8
Table A3. The average learning time.
Table A3. The average learning time.
Division [%]1020304050607080
AlgorithmAverage Algorithm Learning Time [ms]
Adaptive Boosting Decision Trees534132,329460456441295297252
Decision Tree22111100
Gradient Boosting Decision Trees28524321919419414512197
K-Nearest Neighbors21111000
Elastic Net Regression00001000
Random Forest30502302184414571299821548324
Support Vector Machine178130101746133198
Feed-forward Artificial Neural Network204,14533,26531,97828,42124,39421,91018,74313,539

References

  1. Ferrandez, S.; Harbison, T.; Weber, T.; Sturges, R.; Rich, R. Optimization of a truck-drone in tandem delivery network using k-means and genetic algorithm. J. Ind. Eng. Manag. 2016, 9, 374. [Google Scholar] [CrossRef]
  2. D’Andrea, R. Guest Editorial Can Drones Deliver? IEEE Trans. Autom. Sci. Eng. 2014, 11, 647–648. [Google Scholar] [CrossRef]
  3. Tseng, C.M.; Chau, C.K.; Elbassioni, K.; Khonji, M. Autonomous Recharging and Flight Mission Planning for Battery-operated Autonomous Drones. IEEE Trans. Autom. Sci. Eng. 2022, 1–13. [Google Scholar] [CrossRef]
  4. Figliozzi, M.A. Lifecycle modeling and assessment of unmanned aerial vehicles (Drones) CO2e emissions. Transp. Res. Part D Transp. Environ. 2017, 57, 251–261. [Google Scholar] [CrossRef]
  5. Chiang, W.C.; Li, Y.; Shang, J.; Urban, T.L. Impact of drone delivery on sustainability and cost: Realizing the UAV potential through vehicle routing optimization. Appl. Energy 2019, 242, 1164–1175. [Google Scholar] [CrossRef]
  6. Rodrigues, T.A.; Patrikar, J.; Oliveira, N.L.; Matthews, H.S.; Scherer, S.; Samaras, C. Drone flight data reveal energy and greenhouse gas emissions savings for very small package delivery. Patterns 2022, 3, 100569. [Google Scholar] [CrossRef]
  7. Otto, A.; Agatz, N.; Campbell, J.; Golden, B.; Pesch, E. Optimization approaches for civil applications of unmanned aerial vehicles (UAVs) or aerial drones: A survey. Networks 2018, 72, 411–458. [Google Scholar] [CrossRef]
  8. Wang, H.; Zhao, H.; Wu, W.; Xiong, J.; Ma, D.; Wei, J. Deployment Algorithms of Flying Base Stations: 5G and Beyond With UAVs. IEEE Internet Things J. 2019, 6, 10009–10027. [Google Scholar] [CrossRef]
  9. Mayor, V.; Estepa, R.; Estepa, A. QoS-Aware Multilayer UAV Deployment to Provide VoWiFi Service over 5G Networks. Wirel. Commun. Mob. Comput. 2022, 2022, 3110572. [Google Scholar] [CrossRef]
  10. Chiaraviglio, L.; D’Andreagiovanni, F.; Liu, W.; Gutierrez, J.A.; Blefari-Melazzi, N.; Choo, K.K.R.; Alouini, M.S. Multi-Area Throughput and Energy Optimization of UAV-Aided Cellular Networks Powered by Solar Panels and Grid. IEEE Trans. Mob. Comput. 2021, 20, 2427–2444. [Google Scholar] [CrossRef]
  11. Zhang, J.; Campbell, J.F.; II, D.C.S.; Hupman, A.C. Energy consumption models for delivery drones: A comparison and assessment. Transp. Res. Part D Transp. Environ. 2021, 90, 102668. [Google Scholar] [CrossRef]
  12. Mahmood, L.S.; Shaaban, M.F.; Mukhopadhyay, S.; Alblooshi, M. Optimal resource selection and sizing for unmanned aerial vehicles. Soft Comput. 2022, 26, 5685–5697. [Google Scholar] [CrossRef]
  13. Trotta, A.; Andreagiovanni, F.D.; Di Felice, M.; Natalizio, E.; Chowdhury, K.R. When UAVs Ride A Bus: Towards Energy-efficient City-scale Video Surveillance. In Proceedings of the IEEE INFOCOM 2018—IEEE Conference on Computer Communications, Honolulu, HI, USA, 16–19 April 2018; pp. 1043–1051. [Google Scholar] [CrossRef]
  14. Mohsan, S.A.H.; Khan, M.A.; Noor, F.; Ullah, I.; Alsharif, M.H. Towards the Unmanned Aerial Vehicles (UAVs): A Comprehensive Review. Drones 2022, 6, 147. [Google Scholar] [CrossRef]
  15. Mohsan, S.A.H.; Othman, N.Q.H.; Khan, M.A.; Amjad, H.; Żywiołek, J. A Comprehensive Review of Micro UAV Charging Techniques. Micromachines 2022, 13, 977. [Google Scholar] [CrossRef]
  16. Liu, Y. An optimization-driven dynamic vehicle routing algorithm for on-demand meal delivery using drones. Comput. Oper. Res. 2019, 111, 1–20. [Google Scholar] [CrossRef]
  17. Chauhan, D.; Unnikrishnan, A.; Figliozzi, M. Maximum coverage capacitated facility location problem with range constrained drones. Transp. Res. Part C Emerg. Technol. 2019, 99, 1–18. [Google Scholar] [CrossRef]
  18. Poikonen, S.; Golden, B. Multi-visit drone routing problem. Comput. Oper. Res. 2020, 113, 104802. [Google Scholar] [CrossRef]
  19. Dorling, K.; Heinrichs, J.; Messier, G.G.; Magierowski, S. Vehicle Routing Problems for Drone Delivery. IEEE Trans. Syst. Man Cybern. Syst. 2017, 47, 70–85. [Google Scholar] [CrossRef]
  20. Shavarani, S.M.; Nejad, M.G.; Rismanchian, F.; Izbirak, G. Application of hierarchical facility location problem for optimization of a drone delivery system: A case study of Amazon prime air in the city of San Francisco. Int. J. Adv. Manuf. Technol. 2018, 95, 3141–3153. [Google Scholar] [CrossRef]
  21. Moore, A.M. Innovative scenarios for modeling intra-city freight delivery. Transp. Res. Interdiscip. Perspect. 2019, 3, 100024. [Google Scholar] [CrossRef]
  22. Li, D.; Wang, X.; Sun, T. Energy-optimal coverage path planning on topographic map for environment survey with unmanned aerial vehicles. Electron. Lett. 2016, 52, 699–701. [Google Scholar] [CrossRef]
  23. Zorbas, D.; Razafindralambo, T.; Luigi, D.P.P.; Guerriero, F. Energy Efficient Mobile Target Tracking Using Flying Drones. Procedia Comput. Sci. 2013, 19, 80–87. [Google Scholar] [CrossRef]
  24. Di Puglia Pugliese, L.; Guerriero, F.; Zorbas, D.; Razafindralambo, T. Modelling the mobile target covering problem using flying drones. Optim. Lett. 2016, 10, 1021–1052. [Google Scholar] [CrossRef]
  25. Cheng, C.; Adulyasak, Y.; Rousseau, L.M. Drone routing with energy function: Formulation and exact algorithm. Transp. Res. Part B Methodol. 2020, 139, 364–387. [Google Scholar] [CrossRef]
  26. Stolaroff, J.K.; Samaras, C.; O’Neill, E.R.; Lubers, A.; Mitchell, A.S.; Ceperley, D. Energy use and life cycle greenhouse gas emissions of drones for commercial package delivery. Nat. Commun. 2018, 9, 409. [Google Scholar] [CrossRef]
  27. Choi, Y.; Schonfeld, P. Optimization of Multi-package Drone Deliveries Considering Battery Capacity. In Proceedings of the 96th Annual Meeting of the Transportation Research Board, Washington, DC, USA, 8–12 January 2017; Available online: https://www.researchgate.net/publication/347485538 (accessed on 31 August 2022).
  28. Kirschstein, T. Comparison of energy demands of drone-based and ground-based parcel delivery services. Transp. Res. Part D Transp. Environ. 2020, 78, 102209. [Google Scholar] [CrossRef]
  29. Langelaan, J.W.; Schmitz, S.; Palacios, J.; Lorenz, R.D. Energetics of rotary-wing exploration of Titan. In Proceedings of the 2017 IEEE Aerospace Conference, Big Sky, MT, USA, 4–11 March 2017; pp. 1–11. [Google Scholar] [CrossRef]
  30. Abeywickrama, H.V.; Jayawickrama, B.A.; He, Y.; Dutkiewicz, E. Comprehensive Energy Consumption Model for Unmanned Aerial Vehicles, Based on Empirical Studies of Battery Performance. IEEE Access 2018, 6, 58383–58394. [Google Scholar] [CrossRef]
  31. Neumann, P.P.; Bartholmai, M. Real-time wind estimation on a micro unmanned aerial vehicle using its inertial measurement unit. Sens. Actuators A Phys. 2015, 235, 300–310. [Google Scholar] [CrossRef]
  32. Palomaki, R.T.; Rose, N.T.; Bossche, M.v.d.; Sherman, T.J.; Wekker, S.F.J.D. Wind Estimation in the Lower Atmosphere Using Multirotor Aircraft. J. Atmos. Ocean. Technol. 2017, 34, 1183–1191. [Google Scholar] [CrossRef]
  33. Crowe, D.; Pamula, R.; Cheung, H.Y.; De Wekker, S.F.J. Two Supervised Machine Learning Approaches for Wind Velocity Estimation Using Multi-Rotor Copter Attitude Measurements. Sensors 2020, 20, 5638. [Google Scholar] [CrossRef]
  34. Hill, T.; O’Connor, M.; Remus, W. Neural Network Models for Time Series Forecasts. Manag. Sci. 1996, 42, 1082–1092. [Google Scholar] [CrossRef]
  35. Sargent, D.J. Comparison of artificial neural networks with other statistical approaches. Cancer 2001, 91, 1636–1642. [Google Scholar] [CrossRef]
  36. Shapi, M.K.M.; Ramli, N.A.; Awalin, L.J. Energy consumption prediction by using machine learning for smart building: Case study in Malaysia. Dev. Built Environ. 2021, 5, 100037. [Google Scholar] [CrossRef]
  37. Ekonomou, L. Greek long-term energy consumption prediction using artificial neural networks. Energy 2010, 35, 512–517. [Google Scholar] [CrossRef]
  38. Bourhnane, S.; Abid, M.R.; Lghoul, R.; Zine-Dine, K.; Elkamoun, N.; Benhaddou, D. Machine learning for energy consumption prediction and scheduling in smart buildings. SN Appl. Sci. 2020, 2, 297. [Google Scholar] [CrossRef]
  39. Emami Javanmard, M.; Ghaderi, S.F.; Hoseinzadeh, M. Data mining with 12 machine learning algorithms for predict costs and carbon dioxide emission in integrated energy-water optimization model in buildings. Energy Convers. Manag. 2021, 238, 114153. [Google Scholar] [CrossRef]
  40. Góra, K.; Kujawinski, M.; Wroński, D.; Granosik, G. Comparison of Energy Prediction Algorithms for Differential and Skid-Steer Drive Mobile Robots on Different Ground Surfaces. Energies 2021, 14, 6722. [Google Scholar] [CrossRef]
Figure 1. The ROCON drone.
Figure 1. The ROCON drone.
Energies 15 06810 g001
Figure 2. The dataset division procedure.
Figure 2. The dataset division procedure.
Energies 15 06810 g002
Figure 3. An example of UAV trajectory during the automatic test.
Figure 3. An example of UAV trajectory during the automatic test.
Energies 15 06810 g003
Figure 4. An example of linear velocity during a manual test.
Figure 4. An example of linear velocity during a manual test.
Energies 15 06810 g004
Figure 5. The correlation heatmap.
Figure 5. The correlation heatmap.
Energies 15 06810 g005
Figure 6. The inputs and output of ML model.
Figure 6. The inputs and output of ML model.
Energies 15 06810 g006
Figure 7. Completed dataset. Dataset contains 9 automatic logs with additional payloads (2 kg, 0 kg, 4 kg, 6 kg, 0 kg, 2 kg, 4 kg, 6 kg, 6 kg) and 3 manual logs with additional payloads (4 kg, 2 kg, 0 kg).
Figure 7. Completed dataset. Dataset contains 9 automatic logs with additional payloads (2 kg, 0 kg, 4 kg, 6 kg, 0 kg, 2 kg, 4 kg, 6 kg, 6 kg) and 3 manual logs with additional payloads (4 kg, 2 kg, 0 kg).
Energies 15 06810 g007
Figure 8. The real power (pink) and estimation (blue) generated by the Adaptive Boosting Decision Trees for the testing dataset.
Figure 8. The real power (pink) and estimation (blue) generated by the Adaptive Boosting Decision Trees for the testing dataset.
Energies 15 06810 g008
Figure 9. The real power (pink) and estimation (blue) generated by the Decision Tree for the testing dataset.
Figure 9. The real power (pink) and estimation (blue) generated by the Decision Tree for the testing dataset.
Energies 15 06810 g009
Figure 10. The real power (pink) and estimation (blue) generated by the Gradient Boosting Decision Trees for the testing dataset.
Figure 10. The real power (pink) and estimation (blue) generated by the Gradient Boosting Decision Trees for the testing dataset.
Energies 15 06810 g010
Figure 11. The real power (pink) and estimation (blue) generated by the K-Nearest Neighbors for the testing dataset.
Figure 11. The real power (pink) and estimation (blue) generated by the K-Nearest Neighbors for the testing dataset.
Energies 15 06810 g011
Figure 12. The real power (pink) and estimation (blue) generated by the Elastic Net Regression for the testing dataset.
Figure 12. The real power (pink) and estimation (blue) generated by the Elastic Net Regression for the testing dataset.
Energies 15 06810 g012
Figure 13. The real power (pink) and estimation (blue) generated by the Random Forest for the testing dataset.
Figure 13. The real power (pink) and estimation (blue) generated by the Random Forest for the testing dataset.
Energies 15 06810 g013
Figure 14. The real power (pink) and estimation (blue) generated by the Support Vector Machine for the testing dataset.
Figure 14. The real power (pink) and estimation (blue) generated by the Support Vector Machine for the testing dataset.
Energies 15 06810 g014
Figure 15. The real power (pink) and estimation (blue) generated by the Feed-forward Artificial Neural Network for the testing dataset.
Figure 15. The real power (pink) and estimation (blue) generated by the Feed-forward Artificial Neural Network for the testing dataset.
Energies 15 06810 g015
Figure 16. Comparison of relative error of predicted energy.
Figure 16. Comparison of relative error of predicted energy.
Energies 15 06810 g016
Figure 17. Comparison of RMSE value.
Figure 17. Comparison of RMSE value.
Energies 15 06810 g017
Figure 18. Comparison of average training time.
Figure 18. Comparison of average training time.
Energies 15 06810 g018
Figure 19. The consumed power for all collected data.
Figure 19. The consumed power for all collected data.
Energies 15 06810 g019
Table 1. The set of configuration parameters considered during Grid Search CV. The bold and underlined parameters have been reported by Grid Search CV as the most suitable.
Table 1. The set of configuration parameters considered during Grid Search CV. The bold and underlined parameters have been reported by Grid Search CV as the most suitable.
ML MethodParameters
Adaptive Boosting Decision Trees
  • The maximum number of estimators at which boosting is terminated: [30, 50, 100, 1000];
  • The loss function used for weight updating: [linear, square, exponential].
Decision Tree
  • The function used for split quality measurement: [MSE, Friedman, MSE];
  • The maximum depth of the tree: [2, 3, 4, 5, 6, 7, 8];
  • The maximum feature considered during split: [all inputsn, n , log 2 n ];
  • Maximum leaf nodes: [2, 3, 4, 5, 6, 7, 8, 9, 10].
Gradient Boosting Decision Trees
  • The maximum number of estimators at which boosting is terminated: [30, 50, 100];
  • The loss function used for weight updating: [least squares, least absolute deviation, combination of two, quantile regression];
  • Learning rate: [0.01, 0.1, 1, 10];
  • The minimum number of samples required to split node: [2, 3, 5, 10];
  • The maximum depth of a single estimator: [2, 3, 4].
K-Nearest Neighbors
  • The number of neighbors: [1, 3, 5, 7, 11, 31, 99];
  • The weight function: [all points weighted equally, weights are proportional to the inverse of their distance];
  • The search algorithm: [ball tree, KD tree, brute force];
  • The power metric: [Manhattan distance, Euclidean distance].
Elastic Net Regression
  • The L1 and L2 regularization mixing parameter: [0, 0.01, 0.1, 0.5, 0.7, 0.9, 0.95, 0.99, 1], where for 0 and 1 only L2 and L1 penalty is used, respectively;
  • The multiply penalty term factor: [0.01, 0.25, 0.5, 0.8, 1].
Random Forest
  • The number of trees in the forest: [50, 99, 120];
  • The quality measure function: [MAE, MSE];
  • The maximum feature considered during split: [all inputs n, n , log 2 n ].
Support Vector Machine
  • The kernel type: [linear, polynomial, radial basis function];
  • The degree of polynomial: [2, 3, 4, 5];
  • The regularization parameter: [0.001, 0.01, 0.1, 0.5, 0.8, 1];
  • The epsilon parameter: [0.05, 0.1, 0.2, 0.5].
Feed-forward Artificial Neural Network
  • Hidden layers: [one with 5 neurons, one with 10 neurons, two with 5 neurons in each, two with 10 neurons in each];
  • Activation functions: [the hyperbolic tangent, the rectified linear unit].
Table 2. The relative energy prediction errors for the Division 50%.
Table 2. The relative energy prediction errors for the Division 50%.
ML MethodEstimated Energy [Wh]Relative Error [%]
Adaptive Boosting Decision Trees24222.7
Decision Tree23911.4
Gradient Boosting Decision Trees24242.8
K-Nearest Neighbors22902.8
Elastic Net Regression21966.8
Random Forest24453.7
Support Vector Machine24875.5
Feed-forward Artificial Neural Network23750.7
Table 3. The score table for the ML algorithm comparison.
Table 3. The score table for the ML algorithm comparison.
Division [%]1020304050607080Sum
AlgorithmScore
Adaptive Boosting Decision Trees1415171715131115117
Decision Tree2018222223202220167
Gradient Boosting Decision Trees1513141214151614113
K-Nearest Neighbors1412131513131415109
Elastic Net Regression1212121213131313100
Random Forest1315121312141416109
Support Vector Machine111111111010101084
Feed-forward Artificial Neural Network1012107111111880
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Góra, K.; Smyczyński, P.; Kujawiński, M.; Granosik, G. Machine Learning in Creating Energy Consumption Model for UAV. Energies 2022, 15, 6810. https://doi.org/10.3390/en15186810

AMA Style

Góra K, Smyczyński P, Kujawiński M, Granosik G. Machine Learning in Creating Energy Consumption Model for UAV. Energies. 2022; 15(18):6810. https://doi.org/10.3390/en15186810

Chicago/Turabian Style

Góra, Krystian, Paweł Smyczyński, Mateusz Kujawiński, and Grzegorz Granosik. 2022. "Machine Learning in Creating Energy Consumption Model for UAV" Energies 15, no. 18: 6810. https://doi.org/10.3390/en15186810

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop