Author Contributions
Conceptualization, X.S., S.Z.; methodology, X.S.; software, J.S.; validation, X.S. and J.S.; formal analysis, Z.W.; investigation, X.S. and S.Z.; resources, S.Z.; data curation, X.S., J.S., and K.Y.; writing—original draft preparation, X.S. and J.S.; writing—review and editing, S.Z. and K.Y.; visualization, J.S. and K.Y.; supervision, S.Z.; project administration, S.Z.; funding acquisition, S.Z. All authors have read and agreed to the published version of the manuscript.
Funding
This work was supported in part by the National Natural Science Foundation of China, under Grant 62401277, Grant 62402231, Grant U23B2006, Grant 92370203, Grant 62071233, and Grant 61802202; in part by the Basic Research Program of Jiangsu, under Grant BK20240624; in part by the Jiangsu Province Youth Science and Technology Talent Support Project, under Grant JSTJ-2025-135; in part by the Jiangsu Provincial Innovation Support Program, under Grant BZ2023046; in part by the Jiangsu Provincial Key Research and Development Program, under Grant BE2022065-2; in part by the Jiangsu Provincial Natural Science Foundation of China, under Grant BK20211570; in part by the Natural Science Research Start-up Foundation of Recruiting Talents of Nanjing University of Posts and Telecommunications, under Grant NY224029; and in part by the Natural Science Foundation for Colleges and Universities in Jiangsu Province, under Grant 23KJB520026.
Figure 1.
Visualization of image-level and instance-level features. SF and FF denote the spatial feature and frequency feature, respectively. RPN denotes the region proposal network.
Figure 1.
Visualization of image-level and instance-level features. SF and FF denote the spatial feature and frequency feature, respectively. RPN denotes the region proposal network.
Figure 2.
The overall structure of our dual-level spatial–frequency collaborative detector (DSCDet). The DSCDet contains backbone, neck (FPN), head1 (RPN), RoI Pooling layer and head2 (detector) stages. The proposed generic cross-domain attention fusion (GCDAF) module is integrated into the backbone and detector stages. Cls. and Reg. represent the classification and regression branches, respectively.
Figure 2.
The overall structure of our dual-level spatial–frequency collaborative detector (DSCDet). The DSCDet contains backbone, neck (FPN), head1 (RPN), RoI Pooling layer and head2 (detector) stages. The proposed generic cross-domain attention fusion (GCDAF) module is integrated into the backbone and detector stages. Cls. and Reg. represent the classification and regression branches, respectively.
Figure 3.
Visualization of different wavelet sub-bands and corresponding normalized energy distribution for three typical categories, including PL, LV, and SV.
Figure 3.
Visualization of different wavelet sub-bands and corresponding normalized energy distribution for three typical categories, including PL, LV, and SV.
Figure 4.
Visualizations of our proposed generic cross-domain attention fusion (GCDAF) module. Given the input spatial and frequency features , the final enhanced feature is obtained by sequentially performing operations (a–d). The linear function is employed for instance-level GCDAF, while the image-level GCDAF is modified and implemented via convolutional layer.
Figure 4.
Visualizations of our proposed generic cross-domain attention fusion (GCDAF) module. Given the input spatial and frequency features , the final enhanced feature is obtained by sequentially performing operations (a–d). The linear function is employed for instance-level GCDAF, while the image-level GCDAF is modified and implemented via convolutional layer.
Figure 5.
Visualizations of different methods on the DOTA dataset. Odd rows display detection outputs from the baseline model, while even rows correspond to the predictions yielded by our proposed DSCDet.
Figure 5.
Visualizations of different methods on the DOTA dataset. Odd rows display detection outputs from the baseline model, while even rows correspond to the predictions yielded by our proposed DSCDet.
Figure 6.
Visualizations of different methods on the DIOR-R dataset. The first and second rows show the detection results of baseline method and our proposed DSCDet. The third row shows the visualizations of the ground truth.
Figure 6.
Visualizations of different methods on the DIOR-R dataset. The first and second rows show the detection results of baseline method and our proposed DSCDet. The third row shows the visualizations of the ground truth.
Table 1.
Quantitative comparisons of various detection algorithms on the DOTA-v1.0 benchmark. Here, BB stands for the adopted backbone architecture. * denotes the multi-scale training and testing strategy. All comparative experimental data are reproduced using the publicly released source codes of corresponding approaches. The optimal and suboptimal mAP values for each target category are marked in bold with colored background and underlined format, respectively.
Table 1.
Quantitative comparisons of various detection algorithms on the DOTA-v1.0 benchmark. Here, BB stands for the adopted backbone architecture. * denotes the multi-scale training and testing strategy. All comparative experimental data are reproduced using the publicly released source codes of corresponding approaches. The optimal and suboptimal mAP values for each target category are marked in bold with colored background and underlined format, respectively.
|
Method | BB | PL | BD | BR | GTF | SV | LV | SH | TC | BC | ST | SBF | RA | HA | SP | HC | mAP |
|---|
| DRN [32] | H104 | 88.91 | 80.22 | 43.52 | 63.35 | 73.48 | 70.69 | 84.94 | 90.14 | 83.85 | 84.11 | 50.12 | 58.41 | 67.62 | 68.60 | 52.50 | 70.70 |
| RSDet [33] | R101 | 89.80 | 82.90 | 48.60 | 65.20 | 69.50 | 70.10 | 70.20 | 90.50 | 85.60 | 83.40 | 62.50 | 63.90 | 65.60 | 67.20 | 68.00 | 72.20 |
| SCRDet [34] | R101 | 89.98 | 80.65 | 52.09 | 68.36 | 68.36 | 60.32 | 72.41 | 90.85 | 87.94 | 86.86 | 65.02 | 66.68 | 66.25 | 68.24 | 65.21 | 72.61 |
| Det [35] | R101 | 88.76 | 83.09 | 50.91 | 67.27 | 76.23 | 80.39 | 86.72 | 90.78 | 84.68 | 83.24 | 61.98 | 61.35 | 66.91 | 70.63 | 53.94 | 73.79 |
| ARS-DETR [36] | R50 | 86.61 | 77.26 | 48.84 | 66.76 | 78.38 | 78.96 | 87.40 | 90.61 | 82.76 | 82.19 | 54.02 | 62.61 | 72.64 | 72.80 | 64.96 | 73.79 |
| ANet [37] | R50 | 89.30 | 80.11 | 50.97 | 73.91 | 78.59 | 77.34 | 86.38 | 90.91 | 85.14 | 84.84 | 60.45 | 66.94 | 66.78 | 68.55 | 51.65 | 74.13 |
| SASM [38] | R50 | 86.42 | 78.97 | 52.47 | 69.84 | 77.30 | 75.99 | 86.72 | 90.89 | 82.63 | 85.66 | 60.13 | 68.25 | 73.98 | 72.22 | 62.37 | 74.92 |
| AOPG [39] | R101 | 89.14 | 82.74 | 51.87 | 69.28 | 77.65 | 82.42 | 88.08 | 90.89 | 86.26 | 85.13 | 60.60 | 66.30 | 74.05 | 67.76 | 58.77 | 75.39 |
| ARS-DETR [36] | Swin-T | 87.65 | 76.54 | 50.64 | 69.85 | 79.76 | 83.91 | 87.92 | 90.26 | 86.24 | 85.09 | 54.58 | 67.01 | 75.62 | 73.66 | 63.39 | 75.47 |
| FRED [40] | ReR50 | 89.37 | 82.12 | 50.84 | 73.89 | 77.58 | 77.38 | 87.51 | 90.82 | 86.30 | 84.25 | 62.54 | 65.10 | 72.65 | 69.55 | 63.41 | 75.56 |
| Rotated-DETR [41] | Swin-T | 89.69 | 84.47 | 52.03 | 72.25 | 78.63 | 82.51 | 87.89 | 90.88 | 85.38 | 84.33 | 61.86 | 66.92 | 72.25 | 70.51 | 56.14 | 75.72 |
| O-RCNN [42] | R50 | 89.46 | 82.12 | 54.78 | 70.86 | 78.93 | 83.00 | 88.20 | 90.90 | 87.50 | 84.68 | 63.97 | 67.69 | 74.94 | 68.84 | 52.28 | 75.87 |
| EMO2-DETR * [43] | R50 | 88.25 | 76.88 | 50.80 | 73.33 | 77.66 | 81.21 | 87.26 | 90.48 | 78.62 | 85.00 | 59.88 | 66.02 | 76.84 | 81.11 | 70.11 | 76.23 |
| ReDet [44] | ReR50 | 88.79 | 82.64 | 53.97 | 74.00 | 78.13 | 84.06 | 88.04 | 90.89 | 87.78 | 85.75 | 61.76 | 60.39 | 75.96 | 68.07 | 63.59 | 76.25 |
| O-RCNN [42] | R101 | 88.86 | 83.48 | 55.27 | 76.92 | 74.27 | 82.10 | 87.52 | 90.90 | 85.56 | 85.33 | 65.51 | 66.82 | 74.36 | 70.15 | 57.28 | 76.28 |
| GWD [45] | R50 | 88.82 | 82.94 | 55.63 | 72.75 | 78.52 | 83.10 | 87.46 | 90.21 | 86.36 | 85.44 | 64.70 | 61.41 | 73.46 | 76.94 | 57.38 | 76.34 |
| SANet [46] | R50 | 89.04 | 84.66 | 54.91 | 78.10 | 73.58 | 77.29 | 87.60 | 90.88 | 86.18 | 84.38 | 68.45 | 63.28 | 76.45 | 71.40 | 59.84 | 76.40 |
| DGRL [47] | R101 | 89.35 | 84.90 | 52.58 | 72.32 | 78.10 | 81.90 | 88.15 | 90.90 | 88.48 | 84.52 | 63.78 | 66.17 | 76.44 | 68.58 | 60.95 | 76.48 |
| TSA [48] | R50 | 89.44 | 82.95 | 53.75 | 73.31 | 79.29 | 83.49 | 87.61 | 90.90 | 86.79 | 84.60 | 57.48 | 67.71 | 73.05 | 70.65 | 67.60 | 76.56 |
| DAL [49] | R101 | 89.69 | 83.11 | 55.03 | 71.00 | 78.30 | 81.90 | 88.46 | 90.89 | 84.97 | 87.46 | 64.41 | 65.65 | 76.86 | 72.09 | 64.35 | 76.95 |
| FDOL [9] | ReR50 | 88.82 | 84.15 | 56.25 | 75.04 | 74.89 | 83.88 | 88.14 | 90.91 | 87.97 | 85.42 | 59.44 | 66.36 | 77.05 | 74.11 | 65.89 | 77.22 |
| ARC (Baseline) [50] | ARC50 | 89.40 | 82.48 | 55.33 | 73.88 | 79.37 | 84.05 | 88.06 | 90.90 | 86.44 | 84.83 | 63.63 | 70.32 | 74.29 | 71.91 | 65.43 | 77.35 |
| LSKNet-S [51] | LSK50 | 89.66 | 85.52 | 57.72 | 75.70 | 74.95 | 78.69 | 88.24 | 90.88 | 86.79 | 86.38 | 66.92 | 63.77 | 77.77 | 74.47 | 64.82 | 77.49 |
| FCG-DETR [52] | R101 | 88.35 | 82.92 | 54.83 | 71.97 | 80.75 | 82.26 | 88.81 | 90.35 | 87.05 | 86.09 | 64.93 | 69.98 | 78.07 | 75.04 | 66.82 | 77.51 |
| ARC [50] | ARC101 | 89.39 | 83.58 | 57.51 | 75.94 | 78.75 | 83.58 | 88.08 | 90.90 | 85.93 | 85.38 | 64.03 | 68.65 | 75.59 | 72.03 | 65.68 | 77.70 |
| AO2-DETR [53] | R50 | 89.27 | 84.97 | 56.67 | 74.89 | 78.87 | 82.73 | 87.35 | 90.50 | 84.68 | 85.41 | 61.97 | 69.96 | 74.68 | 72.39 | 71.62 | 77.73 |
| DynaPro [54] | ViT | 89.82 | 80.77 | 56.90 | 73.71 | 80.14 | 85.74 | 88.44 | 90.85 | 86.63 | 85.60 | 62.89 | 70.82 | 76.38 | 67.80 | 71.17 | 77.85 |
| DSCDet (Ours) | ARC50 | 89.61 | 83.28 | 58.64 | 74.54 | 80.53 | 85.57 | 88.48 | 90.90 | 87.94 | 84.52 | 64.79 | 68.44 | 76.36 | 73.33 | 67.27 | 78.28 |
Table 2.
Quantitative comparisons of various detection algorithms on the DOTA-v1.5 benchmark. All comparative experimental data are reproduced using the publicly released source codes of corresponding approaches. The optimal and suboptimal mAP values for each target category are marked in bold with colored background and underlined format, respectively.
Table 2.
Quantitative comparisons of various detection algorithms on the DOTA-v1.5 benchmark. All comparative experimental data are reproduced using the publicly released source codes of corresponding approaches. The optimal and suboptimal mAP values for each target category are marked in bold with colored background and underlined format, respectively.
|
Method | PL | BD | BR | GTF | SV | LV | SH | TC | BC | ST | SBF | RA | HA | SP | HC | CC | mAP |
|---|
| RTN-O [55] | 71.43 | 77.64 | 42.12 | 64.65 | 44.53 | 56.79 | 73.31 | 90.84 | 76.02 | 59.96 | 46.95 | 69.24 | 59.65 | 64.52 | 48.06 | 0.83 | 59.16 |
| EMO2-DETR [43] | 71.81 | 75.36 | 45.09 | 58.70 | 48.19 | 73.26 | 80.28 | 90.70 | 73.05 | 76.53 | 39.36 | 65.31 | 56.96 | 69.29 | 47.11 | 15.64 | 61.67 |
| FR-O [56] | 71.89 | 74.47 | 44.45 | 59.87 | 51.28 | 68.98 | 79.37 | 90.78 | 77.38 | 67.50 | 47.75 | 69.72 | 61.22 | 65.28 | 60.47 | 1.54 | 62.00 |
| Mask R-CNN [57] | 76.84 | 73.51 | 49.90 | 57.80 | 51.31 | 71.34 | 79.75 | 90.46 | 74.21 | 66.07 | 46.21 | 70.61 | 63.07 | 64.46 | 57.81 | 9.42 | 62.67 |
| HTC [58] | 77.80 | 73.67 | 51.40 | 63.99 | 51.54 | 73.31 | 80.31 | 90.48 | 75.12 | 67.34 | 48.51 | 70.63 | 64.84 | 64.48 | 55.87 | 5.15 | 63.40 |
| Rotated-DETR [41] | – | – | – | – | – | – | – | – | – | – | – | – | – | – | – | – | 64.71 |
| RoI-T [59] | 71.70 | 82.70 | 53.00 | 71.50 | 51.30 | 74.60 | 80.60 | 90.40 | 78.00 | 68.30 | 53.10 | 73.40 | 73.90 | 65.60 | 56.90 | 3.00 | 65.50 |
| AO2-DETR [53] | 79.55 | 78.14 | 42.41 | 61.23 | 55.34 | 74.50 | 79.57 | 90.64 | 74.76 | 77.58 | 53.56 | 66.91 | 58.56 | 73.11 | 69.64 | 24.71 | 66.26 |
| ReDet [44] | 79.20 | 82.81 | 51.92 | 71.41 | 52.38 | 75.73 | 80.92 | 90.83 | 75.81 | 68.64 | 49.29 | 72.03 | 73.36 | 70.55 | 63.33 | 11.53 | 66.86 |
| O-Reps [60] | 75.52 | 82.60 | 51.24 | 70.21 | 57.81 | 73.82 | 86.25 | 90.86 | 78.30 | 76.47 | 53.61 | 72.78 | 66.68 | 69.48 | 53.66 | 11.09 | 66.90 |
| SANet [46] | 72.29 | 76.87 | 53.25 | 77.58 | 52.19 | 76.34 | 81.00 | 90.85 | 79.36 | 69.37 | 68.01 | 74.07 | 74.32 | 66.71 | 56.44 | 13.08 | 67.61 |
| FDOL [9] | 79.95 | 83.10 | 53.13 | 66.73 | 54.74 | 76.75 | 88.36 | 90.80 | 82.31 | 72.81 | 50.74 | 71.24 | 74.72 | 71.15 | 60.54 | 0.91 | 67.88 |
| FCG-DETR [52] | – | – | – | – | – | – | – | – | – | – | – | – | – | – | – | – | 67.89 |
| ARC (Baseline) [50] | 79.86 | 79.93 | 55.47 | 72.61 | 52.35 | 76.20 | 87.95 | 90.84 | 82.93 | 68.89 | 56.90 | 73.75 | 72.69 | 71.76 | 63.96 | 2.6 | 68.04 |
| SHIFT [61] | 79.08 | 82.53 | 56.28 | 71.28 | 51.96 | 75.90 | 81.05 | 90.81 | 76.77 | 70.39 | 50.26 | 72.25 | 75.06 | 71.83 | 70.33 | 14.23 | 68.19 |
| FRED [40] | 79.60 | 81.44 | 52.60 | 72.57 | 58.07 | 74.82 | 86.12 | 90.81 | 82.13 | 74.84 | 53.37 | 72.93 | 69.51 | 69.91 | 54.82 | 19.27 | 68.30 |
| LSKNet-S [51] | 72.05 | 84.94 | 55.41 | 74.93 | 52.42 | 77.45 | 81.17 | 90.85 | 79.44 | 69.00 | 62.10 | 73.72 | 77.49 | 75.29 | 55.81 | 42.19 | 70.26 |
| SOOD [62] | 80.32 | 84.41 | 52.59 | 74.77 | 58.48 | 76.90 | 86.97 | 90.87 | 78.62 | 76.56 | 62.93 | 71.16 | 74.64 | 76.04 | 55.97 | 25.09 | 70.39 |
| DSCDet (Ours) | 79.05 | 84.42 | 59.38 | 74.26 | 58.03 | 77.70 | 87.44 | 90.82 | 83.25 | 74.45 | 61.85 | 70.20 | 75.01 | 75.03 | 67.17 | 17.13 | 70.95 |
Table 3.
Quantitative comparison of various detection algorithms on the DIOR-R benchmark. All comparative experimental data are reproduced using the publicly released source codes of corresponding approaches. The optimal and suboptimal mAP values for each target category are marked in bold with colored background and underlined format, respectively.
Table 3.
Quantitative comparison of various detection algorithms on the DIOR-R benchmark. All comparative experimental data are reproduced using the publicly released source codes of corresponding approaches. The optimal and suboptimal mAP values for each target category are marked in bold with colored background and underlined format, respectively.
|
Method | APL | APO | BF | BC | BR | CH | DAM | ETS | ESA | GF | GTF | HA | OP | SH | STA | STO | TC | TS | VE | WM | mAP |
|---|
| RTN-O [55] | 61.49 | 28.52 | 73.57 | 81.17 | 23.98 | 72.54 | 19.94 | 72.39 | 58.20 | 69.25 | 79.54 | 32.14 | 44.87 | 77.71 | 67.57 | 61.09 | 81.46 | 47.33 | 38.01 | 60.24 | 57.55 |
| FR-O [56] | 62.79 | 26.80 | 71.22 | 80.91 | 34.20 | 72.57 | 18.95 | 66.45 | 65.75 | 66.63 | 79.24 | 34.95 | 48.79 | 81.14 | 64.34 | 71.21 | 81.44 | 47.31 | 50.46 | 65.21 | 59.54 |
| GV [63] | 65.35 | 28.87 | 74.96 | 81.33 | 33.88 | 74.31 | 19.58 | 70.72 | 64.70 | 72.30 | 78.68 | 37.22 | 49.64 | 80.22 | 69.26 | 61.13 | 81.49 | 44.76 | 47.71 | 65.04 | 60.06 |
| RoI-T [59] | 63.34 | 37.88 | 71.78 | 87.53 | 40.68 | 72.60 | 26.86 | 78.71 | 68.09 | 68.96 | 82.74 | 47.71 | 55.61 | 81.21 | 78.23 | 70.26 | 81.61 | 54.86 | 43.27 | 65.52 | 63.87 |
| IBBR [64] | 63.22 | 41.39 | 71.97 | 88.55 | 41.23 | 72.63 | 28.82 | 78.90 | 69.00 | 70.07 | 83.01 | 47.83 | 55.54 | 81.23 | 72.15 | 62.66 | 89.05 | 58.09 | 43.38 | 65.36 | 64.20 |
| AOPG [39] | 62.39 | 37.79 | 71.62 | 87.63 | 40.90 | 72.47 | 31.08 | 65.42 | 77.99 | 73.20 | 81.94 | 42.32 | 54.45 | 81.17 | 72.69 | 71.31 | 81.49 | 60.04 | 52.38 | 69.99 | 64.41 |
| DODet [65] | 63.40 | 43.35 | 72.11 | 81.32 | 43.12 | 72.59 | 33.32 | 78.77 | 70.84 | 74.15 | 75.47 | 48.00 | 59.31 | 85.41 | 74.04 | 71.56 | 81.52 | 55.47 | 51.86 | 66.40 | 65.10 |
| GCL [15] | 63.08 | 48.87 | 72.03 | 81.33 | 45.38 | 80.01 | 34.16 | 70.38 | 80.42 | 78.41 | 83.12 | 47.13 | 59.42 | 81.23 | 73.40 | 62.47 | 81.45 | 56.77 | 43.85 | 66.16 | 65.45 |
| DGRL [47] | 69.37 | 40.99 | 77.65 | 89.42 | 43.97 | 72.65 | 30.25 | 79.25 | 67.28 | 76.53 | 83.13 | 45.12 | 58.01 | 81.29 | 79.55 | 62.56 | 89.80 | 55.71 | 47.13 | 64.96 | 65.73 |
| ARC (Baseline) [50] | 70.12 | 51.05 | 71.26 | 87.34 | 45.42 | 77.68 | 34.25 | 70.31 | 76.89 | 70.12 | 81.47 | 51.83 | 56.79 | 79.86 | 67.64 | 68.52 | 87.76 | 57.38 | 46.85 | 65.06 | 65.88 |
| ARS-DETR [36] | 68.00 | 54.17 | 74.43 | 81.65 | 41.13 | 75.66 | 34.89 | 73.07 | 81.92 | 76.10 | 78.62 | 36.33 | 55.41 | 84.55 | 70.09 | 72.23 | 81.14 | 61.52 | 50.57 | 70.28 | 66.12 |
| ReDet [44] | 71.03 | 51.88 | 71.81 | 87.92 | 46.07 | 78.39 | 34.90 | 70.98 | 77.40 | 70.88 | 81.99 | 52.54 | 57.34 | 80.32 | 68.28 | 69.09 | 88.24 | 57.90 | 47.21 | 65.19 | 66.47 |
| DDQ-O [66] | 66.71 | 54.14 | 73.11 | 81.80 | 45.25 | 77.60 | 33.37 | 70.09 | 79.18 | 72.24 | 75.42 | 47.18 | 58.27 | 89.50 | 70.98 | 74.62 | 82.83 | 55.03 | 56.23 | 66.61 | 66.51 |
| DCFL [14] | 68.60 | 53.10 | 76.70 | 87.10 | 42.10 | 78.60 | 34.50 | 71.50 | 80.80 | 79.70 | 79.50 | 47.30 | 57.40 | 85.20 | 64.60 | 66.40 | 81.50 | 58.90 | 50.90 | 70.90 | 66.80 |
| OrientedFormer [11] | 65.65 | 48.69 | 78.79 | 87.17 | 41.90 | 76.34 | 34.37 | 72.14 | 81.40 | 75.37 | 79.83 | 45.15 | 56.12 | 88.66 | 67.59 | 72.68 | 87.32 | 60.31 | 56.54 | 69.56 | 67.28 |
| RQFormer [10] | 67.31 | 55.23 | 74.19 | 82.74 | 44.49 | 78.56 | 39.85 | 70.27 | 79.84 | 75.10 | 80.38 | 45.64 | 58.51 | 88.91 | 68.10 | 75.73 | 85.52 | 57.17 | 53.54 | 65.05 | 67.31 |
| FCG-DETR [52] | 68.17 | 53.31 | 73.00 | 86.91 | 45.25 | 75.02 | 34.96 | 74.24 | 81.92 | 77.10 | 78.32 | 48.00 | 54.86 | 85.50 | 73.32 | 69.69 | 86.20 | 60.04 | 56.23 | 68.47 | 67.85 |
| DSCDet (Ours) | 68.67 | 56.39 | 71.58 | 88.79 | 40.89 | 78.29 | 38.78 | 70.61 | 81.92 | 76.18 | 82.97 | 46.07 | 58.31 | 89.47 | 67.99 | 74.73 | 89.37 | 55.19 | 56.06 | 70.34 | 68.13 |
Table 4.
Quantitative results of our image-level GCDAF with different frequency tools on the DOTA-v1.0 benchmark. Parameters (M), FLOPs (G), mAP75 and mAP50 are used for evaluation.
Table 4.
Quantitative results of our image-level GCDAF with different frequency tools on the DOTA-v1.0 benchmark. Parameters (M), FLOPs (G), mAP75 and mAP50 are used for evaluation.
|
Method | Frequency Tools | Parameters (M) | FLOPs (G) | mAP75 | mAP50 |
|---|
| ReDet | – | 31.65 | 134.08 | 50.84 | 76.25 |
| +SE | – | 31.81 | 135.01 | 51.20 | 76.90 |
| +GCDAF (Ours) | FFT | ≈32.16 | 139.35 | 51.27 | 76.68 |
| DCT | 139.10 | 51.45 | 76.85 |
| Daubechies | 138.92 | 51.71 | 77.12 |
| Symlets | 138.95 | 51.68 | 77.08 |
| Haar WT | 138.70 | 51.83 | 77.22 |
| ARC | – | 74.83 | 180.38 | 51.94 | 77.35 |
| +SE | – | 74.99 | 181.31 | 52.01 | 77.48 |
| +GCDAF (Ours) | FFT | ≈75.34 | 185.64 | 51.83 | 77.38 |
| DCT | 185.39 | 51.97 | 77.52 |
| Daubechies | 185.21 | 52.15 | 77.75 |
| Symlets | 185.24 | 52.12 | 77.71 |
| Haar WT | 184.99 | 52.24 | 77.86 |
Table 5.
Ablation study on frequency sub-bands of the image-level GCDAF on the DOTA-v1.0 benchmark. We adopt the removal-based strategy to quantify the contribution of each sub-band.
Table 5.
Ablation study on frequency sub-bands of the image-level GCDAF on the DOTA-v1.0 benchmark. We adopt the removal-based strategy to quantify the contribution of each sub-band.
|
Method | Sub-Bands Used | Parameters (M) | FLOPs (G) | mAP75 | mAP50 |
|---|
| ARC | – | 74.83 | 180.38 | 51.94 | 77.35 |
| +GCDAF (Ours) | LL + LH + HL + HH | ≈75.34 | ≈184.99 | 52.24 | 77.86 |
| w/o LL | 52.17 | 77.79 |
| w/o LH | 52.06 | 77.67 |
| w/o HL | 52.03 | 77.64 |
| w/o HH | 51.97 | 77.52 |
Table 6.
Influence of , , and in our proposed image-level GCDAF with different baseline methods on the DOTA-v1.0 benchmark. mAP75 and mAP50 are used for evaluation.
Table 6.
Influence of , , and in our proposed image-level GCDAF with different baseline methods on the DOTA-v1.0 benchmark. mAP75 and mAP50 are used for evaluation.
|
Method | Backbone | Arrangement | | | | mAP75 | mAP50 |
|---|
| ReDet | ReR50 | – | – | 50.84 | 76.25 |
| Single | ✓ | | | 51.20 | 76.90 |
| | ✓ | | 51.49 | 77.04 |
| | | ✓ | 50.83 | 76.31 |
| Multiple | ✓ | ✓ | | 51.67 | 77.12 |
| ✓ | | ✓ | 51.17 | 76.92 |
| | ✓ | ✓ | 51.52 | 77.03 |
| ✓ | ✓ | ✓ | 51.83 | 77.22 |
| ARC | ARC50 | – | – | 51.94 | 77.35 |
| Single | ✓ | | | 52.01 | 77.48 |
| | ✓ | | 52.14 | 77.65 |
| | | ✓ | 52.06 | 77.39 |
| Multiple | ✓ | ✓ | | 52.21 | 77.73 |
| ✓ | | ✓ | 52.12 | 77.50 |
| | ✓ | ✓ | 52.19 | 77.70 |
| ✓ | ✓ | ✓ | 52.24 | 77.86 |
Table 7.
Quantitative results of our instance-level GCDAF with different frequency tools on the DOTA-v1.0 benchmark. Parameters (M), FLOPs (G), mAP75 and mAP50 are used for evaluation.
Table 7.
Quantitative results of our instance-level GCDAF with different frequency tools on the DOTA-v1.0 benchmark. Parameters (M), FLOPs (G), mAP75 and mAP50 are used for evaluation.
|
Method | Frequency Tools | Parameters (M) | FLOPs (G) | mAP75 | mAP50 |
|---|
| ReDet | – | 31.65 | 134.08 | 50.84 | 76.25 |
| +SE | – | 61.64 | 185.36 | 51.35 | 77.24 |
| +GCDAF (Ours) | FFT | ≈67.95 | 194.70 | 51.82 | 77.45 |
| DCT | 194.45 | 51.96 | 77.62 |
| Daubechies | 194.27 | 52.21 | 77.88 |
| Symlets | 194.30 | 52.18 | 77.85 |
| Haar WT | 194.05 | 52.38 | 78.01 |
| ARC | – | 74.83 | 180.38 | 51.94 | 77.35 |
| +SE | – | 104.82 | 231.66 | 52.30 | 77.82 |
| +GCDAF (Ours) | FFT | ≈111.13 | 241.30 | 51.90 | 77.50 |
| DCT | 241.05 | 52.05 | 77.68 |
| Daubechies | 240.87 | 52.26 | 77.92 |
| Symlets | 240.90 | 52.23 | 77.89 |
| Haar WT | 240.35 | 52.33 | 78.09 |
Table 8.
Ablation study on frequency sub-bands of the instance-level GCDAF on the DOTA-v1.0 benchmark. We adopt the removal-based strategy to quantify the contribution of each sub-band.
Table 8.
Ablation study on frequency sub-bands of the instance-level GCDAF on the DOTA-v1.0 benchmark. We adopt the removal-based strategy to quantify the contribution of each sub-band.
|
Method | Sub-Bands Used | Parameters (M) | FLOPs (G) | mAP75 | mAP50 |
|---|
| ARC | – | 74.83 | 180.38 | 51.94 | 77.35 |
| +GCDAF (Ours) | LL + LH + HL + HH | ≈111.13 | ≈240.35 | 52.33 | 78.09 |
| w/o LL | 52.27 | 78.02 |
| w/o LH | 52.18 | 77.91 |
| w/o HL | 52.15 | 77.88 |
| w/o HH | 52.07 | 77.75 |
Table 9.
Influence of , , and in our proposed instance-level GCDAF with different baseline methods on the DOTA-v1.0 benchmark. mAP75 and mAP50 are used for evaluation.
Table 9.
Influence of , , and in our proposed instance-level GCDAF with different baseline methods on the DOTA-v1.0 benchmark. mAP75 and mAP50 are used for evaluation.
|
Method | Backbone | Arrangement | | | | mAP75 | mAP50 |
|---|
| ReDet | ReR50 | – | – | 50.84 | 76.25 |
| Single | ✓ | | | 51.35 | 77.24 |
| | ✓ | | 52.09 | 77.65 |
| | | ✓ | 50.97 | 76.41 |
| Multiple | ✓ | ✓ | | 52.13 | 77.96 |
| ✓ | | ✓ | 51.37 | 77.24 |
| | ✓ | ✓ | 51.96 | 77.83 |
| ✓ | ✓ | ✓ | 52.38 | 78.01 |
| ARC | ARC50 | – | – | 51.94 | 77.35 |
| Single | ✓ | | | 52.30 | 77.82 |
| | ✓ | | 52.13 | 77.93 |
| | | ✓ | 52.06 | 77.52 |
| Multiple | ✓ | ✓ | | 52.18 | 77.80 |
| ✓ | | ✓ | 52.09 | 77.49 |
| | ✓ | ✓ | 51.35 | 77.96 |
| ✓ | ✓ | ✓ | 52.33 | 78.09 |
Table 10.
Gains of image-level and instance-level GCDAF in our method on the DOTA-v1.0 benchmark. Parameters (M), FLOPs (G), mAP75 and mAP50 are used for evaluation.
Table 10.
Gains of image-level and instance-level GCDAF in our method on the DOTA-v1.0 benchmark. Parameters (M), FLOPs (G), mAP75 and mAP50 are used for evaluation.
|
Method | Backbone | Image-Level | Instance-Level | Parameters (M) | FLOPs (G) | mAP75 | mAP50 |
|---|
| ReDet | ReR50 | | | 31.65 | 134.08 | 50.84 | 76.25 |
| ✓ | | 32.16 | 138.70 | 51.83 | 77.22 |
| | ✓ | 67.95 | 194.05 | 52.38 | 78.01 |
| ✓ | ✓ | 68.46 | 198.67 | 52.37 | 78.12 |
| ARC | ARC50 | | | 74.83 | 180.38 | 51.94 | 77.35 |
| ✓ | | 75.34 | 184.99 | 52.24 | 77.86 |
| | ✓ | 111.13 | 240.35 | 52.33 | 78.09 |
| ✓ | ✓ | 111.64 | 244.96 | 52.51 | 78.28 |
Table 11.
Influence of different fusion coefficient strategies for , , and in our DSCDet. ReR50 and ARC50 backbones are adopted, and mAP75 & mAP50 are used for evaluation.
Table 11.
Influence of different fusion coefficient strategies for , , and in our DSCDet. ReR50 and ARC50 backbones are adopted, and mAP75 & mAP50 are used for evaluation.
|
Backbone | Strategy | mAP75 | mAP50 |
|---|
| ReR50 | – | 50.84 | 76.25 |
| Fixed | 52.37 | 78.12 |
| Normalized | 50.46 | 77.32 |
| Learnable | 52.33 | 78.15 |
| ARC50 | – | 51.94 | 77.35 |
| Fixed | 52.47 | 78.22 |
| Normalized | 52.29 | 77.94 |
| Learnable | 52.51 | 78.28 |
Table 12.
Comparisons between other spatial–frequency feature fusion and attention-based feature interaction methods. CNN- and Transformer-based [
27] approaches are involved for comparison.
Table 12.
Comparisons between other spatial–frequency feature fusion and attention-based feature interaction methods. CNN- and Transformer-based [
27] approaches are involved for comparison.
|
Method | Parameters (M) | FLOPs (G) | mAP50 |
|---|
| Frequency-Aware, Multi-Scale Feature Refinement |
| FADL [21] | 34.32 | – | 74.80 |
| Twins-SVT-L [28] | 108.56 | 443.32 | 75.78 |
| SpectFormer-L [19] | 98.88 | 390.50 | 76.03 |
| Swin-L [27] | 206.70 | 879.46 | 77.41 |
| WaveViT-L [24] | 62.33 | 417.16 | 76.40 |
| PVTv2-b5 [25] | 90.34 | 323.70 | 77.11 |
| CFBA-FPN [2] | – | – | 78.03 |
| Attention-Based Feature Interaction |
| MSFN [13] | – | – | 76.20 |
| FDOL [9] | 32.16 | 138.69 | 77.22 |
| SE [18] | 61.64 | 185.36 | 77.24 |
| UniFormer-L [26] | 108.23 | 535.37 | 77.54 |
| WTHA-ViT-M [8] | 53.69 | 286.12 | 77.60 |
| DFGFNet [30] | 35.59 | 194.96 | 77.75 |
| SFFD [12] | 67.95 | 194.05 | 78.01 |
| DSCDet (Ours) | 111.64 | 244.96 | 78.28 |
Table 13.
Accuracy–complexity trade-off comparisons of different methods on the DOTA-v1.0 benchmark. All methods are built on the ReDet baseline with ReR50 backbone, and the resolution of input sample is fixed as 1024 × 1024. All efficiency metrics are measured on a single NVIDIA GTX 1080ti GPU. Our method is trained three times with different random seeds, and we report the mean and standard deviation of mAP.
Table 13.
Accuracy–complexity trade-off comparisons of different methods on the DOTA-v1.0 benchmark. All methods are built on the ReDet baseline with ReR50 backbone, and the resolution of input sample is fixed as 1024 × 1024. All efficiency metrics are measured on a single NVIDIA GTX 1080ti GPU. Our method is trained three times with different random seeds, and we report the mean and standard deviation of mAP.
|
Method | mAP50 | Parameters (M) | FLOPs (G) | Train Time | Test FPS | GPU Memory |
|---|
| ReDet [44] | 76.25 | 31.65 | 134.08 | 23.5 h | 7.8 | 4.3 |
| FDOL [9] | 77.22 | 32.16 | 138.69 | 39.2 h | 4.4 | 5.6 |
| SHIFT [61] | 77.95 | 34.83 | 197.18 | 28.7 h | 4.3 | 6.0 |
| MAC [67] | 77.95 | 47.81 | 246.59 | 46.2 h | 1.7 | 7.9 |
| SFFD [12] | 78.01 | 67.95 | 194.05 | 38.6 h | 4.9 | 6.2 |
| ORSR [68] | 78.03 | 31.68 | 206.59 | 41.7 h | 5.5 | 8.1 |
| DSCDet (Ours) | | 68.46 | 198.67 | 39.0 h | 3.9 | 7.7 |