Although the regulatory framework poses requirements on a DAA system, solely fulfilling these mandatory requirements is compulsory but not sufficient to provide enough evidence about the safety of a DAA system. In order to achieve a safe DAA system, different standards have been developed to provide additional requirements and guidelines to promote the development of safe and reliable DAA systems. Complying with such standards is not mandatory but it greatly supports certification efforts. This is why it is common practice to comply with existing standards or define ones. While the full scope of these standards is too extensive to be covered in a paper, an overview of these standards, their key points, and major differences shall be discussed here. The focus is placed on the performance requirements on the DAA logic as it is the central part of the system. By doing so, a basis to select and understand a given standard for a particular DAA system use case is provided. Furthermore, the requirements on the system logic can be used to verify the safety benefit of research algorithms. It shall be mentioned here that, while most of the standards are primarily developed for certified UASs, some of these standards may also be applied within the specific class. However, a direct link between a standard and the applicable Air Risk Class is seldom found. Instead, a matching of requirements, concerning minimum and maximum altitude, vehicle weight, and dimensions, must be performed in order to recognize a standard as suitable for a given application.
In addition to MASPSs and MOPSs, interoperability requirements standards (INTEROPs) are sometimes introduced to ensure compatibility between different systems. For DAA, the interoperability with TCAS II is a major concern. All DAA systems must assure that they are not degrading TCAS II performance in any manner. But such INTEROPs also offer the potential to increase DAA system safety by allowing coordination with TCAS II. By doing so, the risk of a collision can be further mitigated.
3.1. RTCA DO-365C
The RTCA DO-365 “Minimum Operational Performance Standards (MOPSs) for Detect and Avoid (DAA) Systems” was released in 2017 and was the first standard for DAA for UAS. It defines performance requirements for DAA system components. Since then, three new revisions have been released, with the latest being DO-365C [
22] from September 2022. Apart from some minor changes and expansions, these revisions have extended the original content by introducing terminal operations and Airborne Collision Avoidance System (ACAS) Xu compatibility. ACAS Xu will be introduced in the following subchapter. Furthermore, the OSED was moved from Appendix A of DO-365 to the standalone standard DO-398 [
14,
22].
In contrast to other DAA standards, the DO-365C considers only the RWC functionality. Collision avoidance is expected to be provided by a separate system. The standard can be applied when operating a UAS, having a maximum take-off mass (MTOM) above 55 lbs, under instrument flight rules (IFRs) in the airspace classes B–E and G between 400 ft AGL and FL 180. The standard allows for different cooperative and non-cooperative surveillance methods.
A major aspect of the standard is the alerting logic. The definition of the alerting criteria is comparable to the alerting in TCAS, which motivated the coarse overview of its alerting logic found in the preceding chapter. Like TCAS, the defined RWC functionality uses temporal parameters as well as protection volumes for temporal and spatial alerting. However, there are some major differences to the alerting logic of TCAS. First, in contrast to TCAS, DO-365 uses DMOD as a purely horizontal parameter and not as a parameter in the collision plane. Furthermore, the temporal parameter, modified Tau, of this document does not only incorporate the closing speed but also the slant range itself. Although the definition is changed, the threshold values are usually identical to the ones defined by TCAS. While some standards adapt these values with the sensitivity level, like TCAS does, this standard uses a static value of 35 s, which originates from a sensitivity level of 7, the highest level of TCAS. In addition, modified Tau is not directly used for alerting. Instead, it is rearranged for the distance to span a second protection volume. This protection volume is, again, associated with a temporal alerting threshold. Last, this standard defines three types of alerts, which will be introduced later. It can be seen that neither explanations for these decisions nor equations are mentioned here. This is due to the complexity of the logic and its derivation. Rather than describing the logic in detail, only the broad concepts behind the logic shall be explained here. For a comprehensive discussion of these topics, it is recommended to review the standard itself. This also holds true for the different parameter variants. Similar to TCAS, DO-365 adapts some of its parameters to changing conditions. But instead of making these parameters altitude-dependent, they change with the method of detection (cooperative/non-cooperative), the mission state (En-route/Terminal area), the type of alert, and a set of special cases. For example, the DMOD threshold for en route cooperative detection is given as 4000 ft for all types of alerts, while the height threshold is set to 450 ft or 700 ft, depending on the type of alert [
22].
In order to generate appropriate alerts for a given encounter, three types of alerts are defined for RWC: preventive alerts, corrective alerts, and warning alerts. Each alert type is associated with a corresponding alert level according to FAA Advisory Circular (AC) 25.1322-1. While the preventive and corrective alert types are caution-level alerts, the warning alert type is a warning-level alert. These alert types provide detailed requirements on when to alert for a given encounter. This is achieved by defining three volumes: The Hazard Alert Zone (HAZ), the May Alert Zone (MAZ), and the Non-Hazard Zone (NHZ). The Hazard Alert Zone defines a volume where an alert must be issued once this volume is infringed. It is spanned by an HMD threshold, an altitude difference threshold, and a temporal threshold. The NHZ is spanned in an equal manner but with different values. Additionally, while the HAZ volume covers the space below the defined threshold values, the NHZ volume covers the space beyond. Within the NHZ volume, alerts are considered nuisance alerts. Consequently, alerting when operating in this region is prohibited. The remaining space between the HAZ and the NHZ is called the May Alert Zone (MAZ). Within this zone, an alert may be issued. While there are early and late thresholds for alerting within this zone, there is also a minimum average time of alerting defined. It must be proven that the average alerting time of the system is greater than the corresponding threshold. Depending on the operation, there are different tables available that define all required thresholds for en-route and terminal operations as well as for cooperative and non-cooperative detection [
22].
3.6. RTCA DO-396
All of the previously introduced standards are either targeting large UASs to operate within airspace classes where manned aircraft usually fly, or small UASs, which operate in low-level in uncontrolled airspace. In order to enable a UAS with an MTOM < 55 lbs to operate in higher altitudes, the ACAS-sXu standard RTCA DO-396 has been developed. It inherits the working principle of the ACAS-X systems but tailors the system requirements and architectural aspects to smaller UASs. It shall be mentioned here that the standard does not use the term “small UAS”, as it is linked to the definition of 14 CFR §107.3, which incorporates a maximum dimension of 25 ft and an upper MTOM boundary of 55 lbs. Instead, the document introduces a definition of the term “smaller UAS”, which still inhabits a maximum dimension of 25 ft but does not restrict the MTOM. By applying this definition as a use case for the standard, it exceeds the scope of DO-365C. In its place, the ASTM F3442/F3442M standardserves as a reference for ACAS-sXu. Major aspects like the risk ratios, the well clear boundary, vehicle performance requirements, and the absence of an MTOM limit within the DO-396 can be traced back to it. Additionally, the necessity of being capable of hovering is a requirement that is inherited from F3442/F3442M. It shall be mentioned here that the definition of the term “smaller UAS” is limited to this standard. Although ASTM F3442/3442M uses a similar interpretation, the definition of the term itself is not part of any regulation.
As the maximum dimension is still restrained and the MTOM is still limited by efficiency considerations, the capability of a smaller UAS to carry sufficient onboard sensory and computing power for DAA functionality is not guaranteed. Therefore, ACAS sXu does not define a specific architecture. All subsystems associated with ACAS-sXu can be onboard, offboard, or a mixture of both. However, when using offboard components for ACAS-sXu, the standard demands vulnerabilities against link loss to be addressed. While offering a range of approaches concerning the architecture, the choice of surveillance systems is constrained. DO-396 requires an ADS-B In as a cooperative detection method and at least one non-cooperative surveillance method if non-cooperative traffic can be expected. The use of a transponder and ADS-B Out, however, is not permitted. By doing so, other manned traffic and large UASs cannot detect and coordinate with smaller UASs by utilizing active surveillance. This, and the small size of the UAS, is assumed to render the UAS invisible to such traffic. Subsequently, the responsibility for RWC and CA lies solely on the smaller UAS, which is required to always give way to the specified intruder types. Additionally, the UAS is not allowed to receive ATC separation services.
When considering the conflict detection and alerting function, a few deviations can be spotted in comparison to ACAS-Xu. ACAS-sXu provides RWC and CA functionality but does not possess separate functions for these tasks. As it does not comply with the DO-365, additional RWC alerts are not required. Instead, only one type of alert is issued that enables the mitigation of NMACs and loss of DWC (LWC) with the required risk ratios as referenced in F3442/F3442M. An additional difference is the support of ACAS-sXu for terrain awareness. It is assumed that, even though surpassing the 400 ft AGL boundary, sXu-equipped UASs are still operating within ground proximity. As a vertical avoidance maneuver could lead to controlled flight into terrain, it is possible to provide ground information to consider terrain when planning the maneuver. This is achieved by representing the terrain and obstacles as stationary traffic. Although this functionality is provided, the algorithm is not optimized for avoiding it, which is why the functionality is only considered a terrain awareness function and not a terrain avoidance function. Furthermore, real traffic is always prioritized over the stationary pseudo-traffic [
31]. This prioritization differs from ICAO Doc 8168, which requires the inverted prioritization for manned aircraft [
32]. Nonetheless, because a collision of a smaller UAS with the ground is assumed by the standard to be less severe than a collision with a manned aircraft, the prioritization represents a sound conclusion. Finally, the DO-396 is the first standard which suggests CA between smaller UASs. With a defined NMAC volume of 50 ft horizontal distance and 15 ft vertical distance, it allows the system to also avoid small intruders. RWC functionality is said to not be required, due to the decreased severity and likelihood of encounters between smaller UASs. To coordinate these encounters, different aspects are proposed, like incorporating smaller UAS communication, Advanced Air Mobility, Urban Air Mobility, and UAS traffic management concepts. These concepts and the corresponding technologies, however, are rather a broad draft of what could be possible than a utilizable framework. Consequently, the proposals do not provide concrete guidance on how to apply any of these concepts. Although the standard defines objectives for this type of encounters, implementing them is not a hard requirement [
31].
3.7. Operational Services and Environment Description Standards
As the presented standards are tailored to specific applications, it might be reasonable to develop a new standard if the existing ones are not matching the intended operation. To provide guidance during a standard development, so-called Operational Services and Environment Description (OSED) standards have been developed. Like the name suggests, these standards describe operational environments by defining assumptions and deriving requirements and recommendations from them. The approach to define standards to be used for defining new standards may seem strange at first but has proven to be a prolific approach, as it mirrors and accompanies the system engineering approach of requirement breakdown. The most popular OSEDs are the DO-398 “Operational Services and Environment Definition (OSED) for Unmanned Aircraft Systems Detect and Avoid Systems (DAA)” [
33] and the newly released ED-313 “Operational Services and Environment Definition for Detect and Avoid [Traffic] in Class A-G Airspaces under IFR” [
34]. The former was initially a part of DO-365, found in Appendix A. With revision C, the Appendix was removed and released as an independent standard [
22,
33]. The latter supersedes the standards ED-238 “Operational Services and Environment Definition (OSED) for Traffic Awareness and Collision Avoidance (TAACAS) in Class A, B and C Airspace for Remotely Piloted Aircraft Systems (RPAS) operating under Instrument Flight Rules” [
35] and ED-258 “Operational Services and Environment Definition for Detect and Avoid [Traffic] in Class D-G Airspaces under VFR/IFR” [
36]. Both the DO-398 and the ED-313 identify several actors in an encounter: the remote pilot, the DAA systems, the intruder pilot, and the ATC. The interactions between these actors are specified in flow charts within the standards to visualize the process of resolving an encounter. While the overall processes defined in these standards are in line with the ICAO definitions and are, therefore, similar to each other, there are certain differences within the implementation details worth noticing. Foremost, like DO-365, DO-398 does only consider RWC functionality. This has the direct effect that the standard does not consider Class A airspace to be a driver of DAA requirements, as separation services are provided by the ATC. However, operating the system in this airspace class is still allowed [
33]. ED-313, on the contrary, considers CA and RWC functionality, leading to major deviations between ED-313 and DO-398 regarding operational, and interoperability requirements. Additionally, DO-398 inherits warning type alerts for RWC, enabling the remote pilot to perform associated RWC maneuvers without involving the ATC while receiving ATC services. ED-313 follows the ICAO guidance and implements only caution-level alerts for RWC functionality [
34]. Even though there are some further differences between both standards, the decision of choosing one standard over the other can be narrowed down to decide on whether to include CA capabilities within the DAA system or not, as the major differences between both standards are rooted within this design decision.
While ED-313 and DO-398 are both addressing operations within the classic airspace, there is also an OSED for operations within very low-level (VLL), EUROCAE ED-267 “Operational Services & Environment Definition (OSED) for Detect & Avoid in Very Low-Level Operations”. In comparison to the other OSEDs, ED-267 describes the environment in a much broader context. Instead of just focusing on DAA for traffic, fixed and mobile obstacles, terrain, hazardous weather, wildlife, and humans (on the ground) are also considered due to the ground proximity during operations. Even though a lot of hazards are identified, the requirements derived in this standard are less concrete than the requirements of the other OSEDs. Therefore, it is recommended to additionally review ED-313 and/or DO-398 as a guidance for typical DAA procedures when developing a VLL standard for DAA (traffic) [
37]. At the time of writing, there is no standard that uses ED-267 as a basis to define a DAA system.
3.8. Comparison of Important Standard Characteristics
To conclude this section, the most important information, as presented above, shall be summarized and compared. Like mentioned before, the direct comparison between standards is, in many aspects, not desirable as they represent different types of standards (MOPSs, MASPSs, OSEDs, INTEROPs) and suggest different architectures. Nevertheless, these documents have some main characteristics in common that are worth comparing. As with the introduction of the standards, the comparison also focuses on providing an overview of the scope of these standards in order to support the selection of a standard for DAA system development and promote awareness within the DAA research community for requirements and constraints on real systems arising from regulations and standards. The identified similarities and differences are placed into context through comments by the authors based on their experience in developing a certified DAA system for UASs.
Some major characteristics of these standards, as introduced in the preceding subchapters, are gathered in
Table 1. When parameters are inherited from other documents, like the applicable airspace classes for DO-386, the original source is mentioned within the following brackets. Parameters marked with * or
† indicate that the values change for different circumstances. While * mark values, which are only valid for cooperative intruders encountered during en-route operations,
† prerequisites that the intruder does not report ACAS capability. These values have been chosen to demonstrate the order of magnitude of the corresponding parameters. Values, which are not applicable for a certain standard, due to the way the algorithm is implemented, are marked as N.A. For detailed information about these parameters, please refer to the associated document.
The major criteria for selecting DAA standards is the airspace where the system is meant to be operated. As UASs themselves are unmanned, the driver for safety considerations is the risk of an MAC with a manned aircraft. With increasing traffic density, the risk of an MAC increases as well, and the DAA performance requirements become more stringent. Also, the type of aircraft to encounter influences the system requirements. Encountering an airliner comes along with larger closing speeds and therefore requires improved surveillance in order to detect the intruder early enough to complete an avoidance maneuver. The first two sections of the table, “Airspace Classes” and “ARC”, deal with these considerations. The applicable airspace classes, and the altitude in which an aircraft is operating in them, define the risk of encountering different types of traffic. This information can be used to determine the corresponding ARCs. It is worth mentioning that the mapping to initial ARC levels is, except for F3442/F3442M, not part of the official standards. The mapping is performed based on the applicable airspace classes. Furthermore, an initial ARC level being marked as applicable does not guarantee that a system can be operated within this level, but that there is an intersecting set between the standard limitations and the SORA requirements. This is conducted to provide an initial guidance. It is suggested to directly compare a chosen standard with the current, applicable, regulatory documents, including possible strategic mitigation.
While the airspace classes and the ARC are an input to the standards in order to assess the safety of the system under consideration, the definitions of DWC and NMAC protection volumes are outputs of those. One of the major regulatory performance requirements is to achieve the ICAO risk ratios. The standards aid in achieving the necessary performance by defining protection volumes and the associated alerting strategies accompanying them. These volumes and alerting times are usually determined by running millions of fast-time simulations using encounter models and the DAA system to check if the required risk ratios are achieved. The presented values are, therefore, a good guide on how to comply with the regulatory requirements. Nevertheless, the protection volumes and the alerting parameters are not sufficient to guarantee achievement of the risk ratio. The implemented logic, the sensor performance, HMI, and other aspects can affect the performance significantly.
DO-365C, ED-271, and DO-386 are, per definition, allowed to operate in ARC-d, the risk class where one is likely to encounter manned traffic, including airliners. This leads to a significant number of safety requirements that these standards deal with, as a failure to perform a collision avoidance maneuver would be catastrophic. This applies also to DO-365C, although it represents a pure RWC system. Nevertheless, the system must prove that its functionality does not degrade the CA capabilities of the surrounding traffic as well as the CA capabilities of the ownship, which can be provided by a separate system. When defining CA functionality for ARC-d, like ED-271 and DO-386, coordination with TCAS II is required to reduce the risk of a collision. This coordination is described in ED-264/DO-382. It can be seen that all three ARC-d standards have comparable sizes for the DWC protection volume.
Figure 3 visualizes the change of the alerting times Tau-Mod over the altitude, as used by ED-271 and DO-365C. As mentioned before, the alerting times of ED-271 are identical to the ones of ACAS II as defined by ICAO. Here, it can be clearly seen that DO-365C simply uses the maximum value for all altitudes, which reduces the complexity of the algorithm but may lead to an increase in nuisance alerts. Even though nuisance alerts do not seem to be critical, they can be for three reasons. First, if the UAS is piloted or monitored by a remote pilot, issuing many nuisance alerts can lead to pilots starting to ignore the alerts. This is a known issue for TCAS II and needs to be addressed when developing new DAA solutions. Second, every nuisance alert that leads to an execution of an avoidance maneuver may lead to a deviation from the original flight plan. By doing so, it can influence surrounding traffic in an adverse manner and, thus, increase the risk of a collision. Last, starting to maneuver against a non-threat aircraft has the potential of causing a so-called induced collision. This is a type of collision which would not have happened if no DAA system intervention would have taken place. A real-world example for such a collision is the mid-air collision over Überlingen in 2002, where two airliners collided mid-air. Both aircraft were flying at the same altitude, and ATC instructed one aircraft to descend. However, TCAS II triggered for both aircraft and instructed the other one to descend. Although this is an edge case for different reasons, this collision would not have happened if TCAS would not have instructed the other aircraft to descend as well. Simulation studies have shown that a significant part of collision scenarios, where aircraft are DAA system equipped, are due to induced collisions.
It shall be highlighted here that coordination is an important measure to largely reduce the risk of collision. In case of the Überlingen accident, the collision can be considered as uncoordinated. Although both TCAS II devices coordinated their RAs against each other, the aircraft that descended due to the ATC instructions was asked to climb by its TCAS; one crew following the ATC instructions effectively led to an uncoordinated encounter. It has been proven that the collision risk of an uncoordinated encounter where both aircraft are DAA system equipped is larger than the collision risk of an encounter where only one aircraft is DAA system equipped and the other one does simply not react. This also underlines the importance of the interoperability standard.
Summing up, it can be seen that nuisance alerts can have a significant safety impact and, therefore, must be carefully investigated when developing a DAA system. All of these considerations lead to challenging performance requirements for DAA systems and their components, especially sensors. This usually leads to larger system weights which, in turn, require larger UASs to carry the system. Nevertheless, from a standard perspective, there is no limitation on weight for the system.
F3442-23 and DO-396 define DAA systems that are not allowed to be operated in ARC-d. This means that operations in airspace class A are prohibited. This reduces the likelihood of encountering airliners during flight. Strictly speaking, F3442-23 is an MASPS document and DO-396 is an MOPS, implementing the F3442-23 system with a slightly modified applicability. F3442-23 limits the maximum altitude where DAA systems, complying with this standard, are allowed to be operated. By doing so, the likelihood of encountering traffic is further reduced. Their applicability is intentionally limited in order to reduce the requirements on the system. This not only reduces the development efforts but also allows for significant weight reduction, as more capable sensors are usually heavier and require more power. A further limitation can be found within the maximum size of the UAS. As stated above, maneuver coordination is an important aspect of DAA systems but it also poses a lot of requirements. As uncoordinated encounters are more dangerous than encounters, where only one aircraft possesses DAA capabilities, these standards aim for being the only aircraft in an encounter which performs DAA maneuvers. By limiting the size of the UAS to <25 ft, it is assumed that pilots of manned aircraft are not capable of visually detecting the UAS and, thus, cannot perform a DAA maneuver. Consequently, the manned aircraft does not possess DAA capabilities against this type of intruder. For the same reason, DAA systems, complying with these standards, are also not allowed to be transponder or ADS-B out equipped. By doing so, a technical detection of the UAS by manned aircraft is also considered not possible.
Although this approach is considered reasonable and greatly helps to extend the set of possible operations of UASs, caution must be exercised when equipping such DAA systems to UASs. It must be checked that the UASs do not invalidate this assumption by using bright strobe lights or similar measures. Furthermore, future research and operational data must verify that these assumptions are, indeed, true for all circumstances.
The last parameter influencing the applicability of F3442-23 and DO-396 is the speed of the UAS. Assuming low velocities during flight leads to a reduction in closing speed when encountering manned traffic. This allows the usage of sensors with a reduced range, as for an equal time to collision, the intruder is already closer to the ownship if the closing speed is smaller. This is also the reason why both standards do not have a modified Tau parameter. Due to the low closing speeds, a temporal alerting does not add significant value to the system. As DO-396 is implementing F3442-23, both standards share the same protection volumes for DWC and NMAC.
It can be seen that the mass itself does not influence the decision on which standard is applicable. All collisions of UASs with manned aircraft, regardless of the size and weight, are considered lethal. Therefore, only parameters impacting the DAA system performance are considered for selection.
Figure 4 illustrates an overview of the hierarchical structure of the presented documents. It can be recognized that both ED-271 and DO-365 are dependent on an OSED and the joint interoperability standard ED-264/DO-382. DO-396 abstains on interoperability to manned aircraft and ARC-d UAS CA systems, like mentioned before. Additionally, DO-396 possesses a custom OSED in its Appendix A as F3442/F3442M is not considered an OSED, but a performance standard. Both ACAS-X standards for UAS, DO-386 and DO-396, inherit the main system architecture and the probabilistic conflict detection from the ACAS-X variants for manned aircraft, ACAS-Xa and ACAS-Xo. Consequently, they are marked as derived from this standard. It is worth mentioning that additional standards are available that define requirements for sensors which can be used for DAA. These standards are not mentioned here as they do not focus on the core aspects of DAA like the conflict detection and alerting.
It is recognizable that there are currently some gaps in the standardization of UAS DAA systems. Filling these by defining new standards or addressing the gaps in research to develop new technologies to pave the way towards standardization is a desirable objective. However, when doing so, some major challenges have to be addressed. The most important one is to determine the system performance of the suggested solution. Calculating the risk ratios of the system under consideration and demonstrating that they comply with the requirements of ICAO is a necessity for every DAA system in order for it to be operated. The most suitable way to do so is by utilizing encounter models to run millions of fast-time simulations, as the encounter models generate a diverse set of realistic intruder behavior that the DAA system needs to be tested against. Only when sampling the encounter models this often is statistical evidence provided showing that the DAA system is capable of resolving real-world encounters. Due to the huge number of necessary samples, real-time simulations and flight tests are not suited for this task. Too many test cases need to be exercised. Nevertheless, real-time simulations and flight tests are still very important for DAA systems as it is their task to demonstrate that the fast-time simulations are actually representative of the true system behavior and that all assumptions made within the fast-time simulations are true.