Histogram-Based Edge Detection for River Coastline Mapping Using UAV-Acquired RGB Imagery

Abstract

This paper presents a new approach for delineating river coastlines in RGB close-range nadir aerial imagery acquired by unmanned aerial vehicles (UAVs), aimed at facilitating waterline detection through the reduction of the dimensions of a colour space and the use of coarse grids rather than pixels. Since water has uniform brightness, expressed as the value (V) component in the hue, saturation, value (HSV) colour model, the reduction in question is attained by extracting V and investigating its histogram to identify areas where V does not vary considerably. A set of 30 nadir UAV-acquired photos, taken at five different locations in Poland, were used to validate the approach. For 67% of all analysed images (both wide and narrow rivers were photographed), the detection rate was above 50% (with the false hit rate ranged between 5.00% and 61.36%, mean 36.62%). When the analysis was limited to wide rivers, the percentage of images in which detection rate exceeded 50% increased to 80%, and the false hit rates remained similar. Apart from the river width, land cover in the vicinity of the river, as well as uniformity of water colour, were found to be factors which influence the waterline detection performance. Our contribution to the existing knowledge is a rough waterline detection approach based on limited information (only the V band, and grids rather than pixels).

1. Introduction

1.1. Context

Rapid climate changes have been observed in recent years, which are manifested by, among others, increasing frequency of extreme weather and fluvial phenomena, such as droughts, water shortages or floods [1,2]. In this context, flood management and management of limited water resources are very important. In order to effectively warn the population against flooding, it is necessary to conduct regular research in the field of extreme hydrological and meteorological events, as well as to issue accurate hydrological forecasts [3].

Effective forecasting requires access to regularly obtained hydrological measurements. For the purpose of geomorphological mapping, however, spatial data on rivers is necessary. Acquisition of such datasets is often difficult because of limited access to river banks, linear character of rivers and spatial pattern of river system. Though in situ water level measurements are widespread around the world, they offer pointwise data. If spatial distribution of gauges is sparse, predicting water levels along the river can be a challenge. In order to overcome drawbacks of pointwise measurements, remote sensing platforms are utilized, such as for instance unmanned aerial vehicles (hereinafter referred to as UAVs), which are capable of collecting spatial information of high resolution for extensive areas in a simple and cheap way. UAVs are important and well-known research tools that can measure and observe rivers and their dynamics. They have been used to create digital terrain models of river channels [4], analyse morphodynamic changes after flood [5,6], observe river stages [7], and monitor channel morphology [8]. Due to climate change and the associated increase in the intensity and frequency of flooding, overbank flow should be monitored in near-real time [9]. One of the rapidly growing technologies to observe inundation is UAV [10] which—when equipped with water detection tools—can lead to rapid mapping of water surface area [11]. Thus, methods for rough determination of waterline based on most popular RGB photos taken by UAVs may potentially increase flood awareness.

1.2. Related Work

UAVs may also be useful for delineating river coastlines or measuring water levels. There exist many approaches for delineating waterlines, determining water extents or estimating water levels (Table 1). Satellite data has been used to extract water bodies based on transformation from RGB to HSV colour space [12], as well as to investigate changes in lake water extent [13]. Landsat images have been processed to automatically detect coastlines [14]. Unmanned ground vehicles (UGVs) [15] as well as unmanned surface vehicles (USVs) [16,17] may also be useful for water body and waterline detection. Also, it is possible to conduct hydrological measurements by means of simple and inexpensive devices. Smartphones have been used to determine shorelines [18], and water stages have been estimated using a low-cost camera [19,20,21]. In addition, UAVs have helped scientists to observe stages of rivers [7,22], water levels in dams [23], and to identify water body extent [24]. Among the above-mentioned papers, there are approaches that detect river coastlines based on RGB images. Not uncommonly, other sensors [24] or equipment [19] were found to be necessary to support such a detection. There is shortage of papers on delineating river coastline solely based on RGB UAV-acquired imagery, particularly targeted at facilitating computations through the reduction in dimensions of colour space.

The concept of our approach resides in projecting the close-range RGB aerial imagery into the hue, saturation, value (HSV) colour space, and consequently in limiting the scrutiny to the V component (reducing the model dimension and, thus, facilitating computations). There exist papers in which HSV was utilized for water detection, classification and segmentation. Namely, all three components (H, S and V) were analysed in [25] to detect clean and polluted water images. Yu et al. [26] used H to detect the shadow area of the river surface. Also, the S component was used in [27], where the flooded area in a city environment was detected, based on crowdsourced images. In our work, we used the V component, which was selected on a basis of the study by Rankin and Matthies [15], who found that it reveals small variability for water. Unlike other studies, we do not classify imagery at the pixel scale, but we carry out statistical inference instead. Indeed, we consider the probability distribution of V, particularly looking at kurtosis and the variability around the modal value, leading to a classification of grids of size 250 × 250 px into ones that include river coastline or not. The gridwise approach is, along with the reduction of the colour space, yet another feature that facilitates our waterline detection method (also known hereinafter as a detector). In other words, the strength of our method resides in its simplicity, namely that the waterline can be rapidly reconstructed in a rough way based on limited data (image parts corresponding to a superimposed grid lattice with information on V band).

Table 1. A review of papers considering waterline detection.

No.	Reference	Platform 1|Sensor	Method	Note
1	Rankin and Matthies (2010) [15]	UGV|RGB	Thresholding, segmentation	Water extent
2	Namikawa et al. (2016) [12]	S|RGB	Unsupervised classification, thresholding	Water extent
3	Niedzielski et al. (2016) [7]	UAV|RGB	Manual digitization, statistical analysis	Water stages
4	Wei and Zhang (2016) [16]	USV|RGB	Structure extraction, texture analysis
5	Deng et al. (2017) [13]	S|RGB, NIR, SWIR	Random forest	Water extent
6	Kröhnert and Meichsner (2017) [18]	P|RGB	Spatio-temporal histogram analysis, segmentation
7	Witherow et al. (2017) [27]	LCC|RGB	Threshold-based segmentation	Water extent
8	Zhan et al. (2017) [17]	USV|RGB	RANSAC algorithm
9	Eltner et al. (2018) [19]	LCC|RGB	Spatio-temporal texture, seeded region growing, Canny edge detection	Water stages
10	Kröhnert and Eltner (2018) [20]	P, LCC|RGB	Spatio-temporal histogram analysis, segmentation
11	Ridolfi and Manciola (2018) [23]	UAV|RGB	Pixel classification, Canny edge detection	A dam
12	Tymków et al. (2019) [24]	UAV|RGB, LiDAR, TIR, RGB+TIR	Supervised classification, thresholding of pixel values, image transforms	Water extent
13	Viaña-Borja and Ortega-Sanchez (2019) [14]	S|RGB, NIR, SWIR	New water index
14	Bandini et al. (2020) [22]	UAV|Radar, LiDAR, RGB	Altimetric measurements, water level extraction of point clouds	Water stages
15	Xue et al. (2020) [25]	LCC|RGB	Eigen value analysis, gradient distributions	Water images classification
16	Yu et al. (2020) [26]	LCC|RGB	Improved Local Binary Pattern	Water extent
17	Eltner et al. (2021) [21]	LCC|RGB	Neural networks

¹ LCC—low-cost camera, P—smartphone, S—satellite, UAV—unmanned aerial vehicle, UGV—unmanned ground vehicle, USV—unmanned surface vehicle.

Table 1. A review of papers considering waterline detection.

No.	Reference	Platform 1|Sensor	Method	Note
1	Rankin and Matthies (2010) [15]	UGV|RGB	Thresholding, segmentation	Water extent
2	Namikawa et al. (2016) [12]	S|RGB	Unsupervised classification, thresholding	Water extent
3	Niedzielski et al. (2016) [7]	UAV|RGB	Manual digitization, statistical analysis	Water stages
4	Wei and Zhang (2016) [16]	USV|RGB	Structure extraction, texture analysis
5	Deng et al. (2017) [13]	S|RGB, NIR, SWIR	Random forest	Water extent
6	Kröhnert and Meichsner (2017) [18]	P|RGB	Spatio-temporal histogram analysis, segmentation
7	Witherow et al. (2017) [27]	LCC|RGB	Threshold-based segmentation	Water extent
8	Zhan et al. (2017) [17]	USV|RGB	RANSAC algorithm
9	Eltner et al. (2018) [19]	LCC|RGB	Spatio-temporal texture, seeded region growing, Canny edge detection	Water stages
10	Kröhnert and Eltner (2018) [20]	P, LCC|RGB	Spatio-temporal histogram analysis, segmentation
11	Ridolfi and Manciola (2018) [23]	UAV|RGB	Pixel classification, Canny edge detection	A dam
12	Tymków et al. (2019) [24]	UAV|RGB, LiDAR, TIR, RGB+TIR	Supervised classification, thresholding of pixel values, image transforms	Water extent
13	Viaña-Borja and Ortega-Sanchez (2019) [14]	S|RGB, NIR, SWIR	New water index
14	Bandini et al. (2020) [22]	UAV|Radar, LiDAR, RGB	Altimetric measurements, water level extraction of point clouds	Water stages
15	Xue et al. (2020) [25]	LCC|RGB	Eigen value analysis, gradient distributions	Water images classification
16	Yu et al. (2020) [26]	LCC|RGB	Improved Local Binary Pattern	Water extent
17	Eltner et al. (2021) [21]	LCC|RGB	Neural networks

¹ LCC—low-cost camera, P—smartphone, S—satellite, UAV—unmanned aerial vehicle, UGV—unmanned ground vehicle, USV—unmanned surface vehicle.

2. Motivation

It is apparent from Table 1 that there exists a considerable number of methods for delineating waterline using sensors different than RGB. For instance, thermal or hyperspectral imagery are known to provide a better signal than RGB for extracting coastlines. However, the motivation for our work is inspired by the availability of drones equipped with RGB cameras. Statistically, they are most widely available throughout the world and, most importantly, RGB images are most widely analysed UAV-based data in scientific papers.

Table 2. Popularity of RGB-based UAV platforms in scientific and business activities.

Reference	Location in Text	Information on RGB
Kucharczyk and Hugenholtz [28]	Table 5 in [28]	86.77% articles (from among 635 papers) use RGB sensors
Zhang and Zhu [29]	SubSection 2.2.1 in [29]	RGB cameras are prevailing type of remote sensing sensor mounted onboard UAVs
Rao et al. [30]	SubSection 2.2 in [30]	Aerial photography is the most common usage of consumer and hobbyist UAVs
Aydin [31]	Section Background in [31]	Based on Federal Aviation Administration Aerospace Report 2017, 3.55–4.47 million hobbyist drones were predicted to 2021 (following [30], hobbyist drones are used mainly for photography—see previous row in this Table)
Maddikunta et al. [32]	Paragraph II C 4) (a) in [32]	RGB cameras are the most popular sensors in precision agriculture and smart agro applications

presents the use of RGB cameras on UAVs, and confirms the widest popularity of these sensors in the light of qualitative and quantitative characteristics.

Given the aforementioned superiority of RGB sensors in terms of their availability and widespread use, the coastline detection method presented in this paper may be an offer for users of UAVs equipped with visible light sensors.

It is worth noting that there is a research gap in rapid coastline mapping [33]. The simple (V band and coarse grid), and therefore rapid, approach outlined in this paper fits the problem in question.

3. Materials and Methods

3.1. UAV Data Acquisition and Preprocessing

To find out whether our approach is versatile, we used a set of 30 nadir UAV-acquired close-range photos, presenting different types of river channels (lowland and upland rivers as well as mountain streams). The aerial images were acquired at five different locations in Poland: (a) middle Odra river, (b) upper Odra river, (c) West Sudetes (Izera and Kwisa rivers), (d) Kłodzko County (Biała Lądecka, Bystrzyca Dusznicka, Nysa Kłodzka and Ścinawka rivers), and (e) lower Bug river (Figure 1).

Images were collected during different flight conditions. Two fixed-wing UAVs (eBee and swingletCAM by SenseFly), equipped with RGB cameras (Canon S110 and Canon IXUS 220HS, respectively), flying at altitudes from 75 m to 148 m above take-off (ATO) were used to capture photos. Ground sampling distance ranged from 2.67 cm/px to 5.27 cm/px. The extensive data collection period between 2012 and 2022 was taken into account. We chose these specific cameras to ensure data consistency over such a long period of image acquisition. In order to provide a broad range of environmental conditions, various morphological (wide and deep rivers as well as narrow and shallow streams) and hydrological (low and high stages as well as low and high discharges) features were considered during the image selection process. River characteristics, indicating the presence of diverse environment on analysed photos, are juxtaposed in

Table 3. River characteristics at dates when specific images were acquired. Mean water level corresponds to an average value of water levels recorded over the hydrological year (in Poland, this lasts from 1 November to 31 October) in which a given photo was taken. The hydrological characteristics juxtaposed in this table refer to the gauge stations located closest to the image locations.

No.	Image Name	Type 1	Min. Width 2 [m]	Max. Width [m]	Length [m]	Water Level [cm]	Mean Water Level [cm]	Discharge [$\frac{{\mathbf{m}}^3}{\mathbf{s}}$]
1	Bug_1	lowland	83	98	165	240 b	302	49.30
2	Bug_2	lowland	90	100	140	230 b	296	42.20
3	Bug_3	lowland	80	90	150	230 b	296	42.20
4	Biała_1	upland	11	16	115	42 b	55	2.78
5	Biała_2	upland	11	16	130	67 a	52	4.04
6	Bystrzyca_1	upland	0	9	165	19	19	1.88
7	Bystrzyca_2	upland	9	11	200	19	19	1.88
8	Bystrzyca_3	upland	6	11	175	4 b	19	0.91
9	Bystrzyca_4	upland	1	10	115	12 b	19	1.44
10	Bystrzyca_5	upland	7	11	225	${190}_{\mathrm{a}}^{*}$	121	5.67
11	Izera	mountain	0	11	95	No data	No data	0.15
12	Kwisa	mountain	7	20	200	107 b	115	No data
13	Nysa_1	upland	23	38	135	98 a	96	20.50
14	Nysa_2	upland	5	25	180	89 b	101	4.37
15	Nysa_3	upland	5	25	190	88 b	112	5.08
16	Nysa_4	upland	19	34	135	80 b	96	10.50
17	Odra_1	lowland	NA	NA	NA	165 b	178	105.00
18	Odra_2	lowland	75	130	125	133 b	178	77.10
19	Odra_3	lowland	70	78	115	167 b	245	107.00
20	Odra_4	lowland	NA	NA	NA	175 b	178	115.00
21	Odra_5	lowland	93	100	145	230 b	232	No data
22	Odra_6	lowland	115	120	165	230 b	232	No data
23	Odra_7	lowland	90	105	150	229 b	232	No data
24	Odra_8	lowland	95	125	160	225 b	240	No data
25	Odra_9	lowland	100	235	115	189 a	167	204.00
26	Odra_10	lowland	83	130	140	164 b	179	108.00
27	Odra_11	lowland	96	145	85	187 b	242	136.00
28	Odra_12	lowland	66	153	160	218 b	233	101.00
29	Odra_13	lowland	75 O;25 B	145 O;55B	145 O;125 B	${251}_{\mathrm{a}}^{\mathrm{O}};{221}_{\mathrm{a}}^{\mathrm{B}}$	233 O;177 B	135.00 O;17.30 B
30	Ścinawka	upland	0	20	140	221a	51	46.30

¹ Refers to the section of the river where the photo was taken; ² 0 may indicate fully covered river channel; * river channel has been regulated and water gauge has been rebuilt (zero of water gauge has been changed); ^O/B Odra/Barycz; _a/b above/below mean water level.

. Minimum and maximum widths, as well as lengths, were measured on a basis of ortophotomaps, with resolutions ranging from 2.6 cm/px to 5.2 cm/px. Water stage and discharge data were acquired courtesy of the Institute of Meteorology and Water Management—National Research Institute (Instytut Meteorologii i Gospodarki Wodnej—Państwowy Instytut Badawczy, IMGW-PIB), except the discharge dataset for Izera, which was based on flow meter measurements. Natural rivers were selected for the study, without considerable human interventions within the channel (e.g., without groynes, retaining walls, rip-raps). In some images, the river banks were clearly visible, thus it should be easy for the detector to recognize the river coastline. In other situations under study, the banks were partially covered by vegetation, which may affect the detector efficiency (

Table 4. Descriptions of images analysed in the study.

No.	River	Region	Image Name	Date	Coverage Water Class 1	Land Cover	Channel Characteristic	Detection Disturbances
1			Bug_1	27/07/2017	2	coniferous forest, scrub, meadow	visible two banks	shadows, sunlight reflections
2	Bug	Binduga	Bug_2	26/06/2018	3	scrub	visible two banks	–
3			Bug_3	26/06/2018	3	coniferous forest, scrub	partially covered two banks	shadows, reflections
4	Biała Lądecka	Żelazno	Biała_1	27/11/2012	1	scrub, meadow, arable land, discontinuous building, roads	visible two banks	visible riverbed forms and submerged vegetation
5			Biała_2	21/05/2015	1	scrub, meadow, arable land, discontinuous building, roads	partially covered two banks; submerged bars	shadows, visible riverbed forms and submerged vegetation
6			Bystrzyca_1	08/01/2013	1	broad-leaved forest, coniferous trees, meadow, discontinuous building	defence; partially covered two banks	–
7			Bystrzyca_2	08/01/2013	1	broad-leaved and coniferous trees, meadow, roads	defence; visible two banks	local hydraulic disturbances; white water
8	Bystrzyca Dusznicka	Szalejów Dolny	Bystrzyca_3	21/08/2013	1	broad-leaved trees, meadow, arable land, roads	defence; partially covered two banks; sand bars	visible riverbed forms; local hydraulic disturbances; white water
9			Bystrzyca_4	27/09/2013	1	broad-leaved trees, scrub, meadow, arable land, discontinuous building, roads	defence; partially covered two banks	surface waves; visible riverbed forms; submerged vegetation
10			Bystrzyca_5	29/06/2020	1	broad-leaved trees, scrub, meadow, arable land, roads	defence; partially covered two banks	surface waves; white water
11	Izera	Hala Izerska	Izera	30/08/2019	1	coniferous forest and trees, meadow	partially covered two banks; bars (mostly submerged)	visible riverbed forms
12	Kwisa	Gryfów Śląski	Kwisa	29/06/2016	1	coniferous forest, scrub, meadow	partially covered two banks	shadows; reflections; surface waves; local hydraulic disturbances; visible riverbed forms and submerged vegetation
13		Byczeń	Nysa_1	30/03/2021	2	broad-leaved trees, meadow, gravel-sand bar	visible two banks; bars (partially submerged)	surface waves; visible riverbed forms
14	Nysa Kłodzka	Ławica	Nysa_2	04/07/2019	1	broad-leaved forest, meadow	partially covered two banks; bars (partially submerged); submerged vegetation	shadows; reflections; surface waves; local hydraulic disturbances; visible riverbed forms and submerged vegetation
15			Nysa_3	04/12/2019	1	broad-leaved forest, meadow, arable land	partially covered two banks	shadows; surface waves; visible riverbed forms and submerged vegetation
16	Odra	Śrem	Nysa_4	22/06/2021	1	broad-leaved forest, scrub, meadow	partially covered two banks	shadows
17			Odra_1	09/12/2021	4	broad-leaved forest, meadow	visible one bank; groynes	shadows
18		Dąbrowa	Odra_2	10/11/2021	4	broad-leaved forest, scrub, sand bars	visible two bank; groynes; sand bars	shadows; visible riverbed forms
19			Odra_3	26/07/2021	3	broad-leaved trees, meadow, arable land	visible two banks	shadows, reflections
20			Odra_4	27/03/2022	2	broad-leaved forest, scrub	visible one bank; groyne	–
21		Gogolin	Odra_5	21/11/2020	2	broad-leaved trees, scrub, arable land, roads	visible one bank	surface waves
22			Odra_6	21/11/2020	3	broad-leaved trees, scrub, arable land, road	partially covered two banks; river regulation structures	shadows; white water
23			Odra_7	22/11/2020	4	broad-leaved forest, scrub	partially covered two banks	sunlight reflections; surface waves
24			Odra_8	17/02/2020	3	broad-leaved forest, scrub, road	partially covered two banks	visible riverbed forms
25		Kunice	Odra_9	24/03/2022	3	broad-leaved trees, scrub, building	visible one bank; groyne	shadows; white water
26		Pomorsko	Odra_10	06/12/2021	3	broad-leaved trees, scrub	visible one bank; groynes; submerged bars	shadows; visible riverbed forms
27			Odra_11	28/06/2021	4	scrub	visible one bank	–
28		Wyszanów	Odra_12	07/12/2021	3	broad-leaved trees, scrub	visible one bank; groynes; submerged bars	visible riverbed forms
29	Odra/Barycz		Odra_13	31/01/2022	3	broad-leaved trees, meadow	partially covered three 2 banks	shadows
30	Ścinawka	Gorzuchów	Ścinawka	14/10/2020	1	broad-leaved trees, scrub, meadow, arable land, road, water body	almost all covered banks (both river and water body)	shadows; surface waves; white water

¹ percentage of photo covered by water: 1—0–25%, 2—25–50%, 3—50–75%, 4—75–100%; ² one bank is Oder, two banks are Barycz mouth.

). Thirty JPG images processed in this paper are included in Supplementary Material so that the comparison with other methods for river coastline delineation is possible.

Images were processed in two stages (Figure 2). The first stage (preprocessing) consisted of three steps. In the first step, RGB photos were split into grids of size 250 × 250 px (hereinafter also known as slices), which was assumed to be the initial size. The choice of such a grid size was determined by image dimensions. Namely, each photo was divided into the integer number of 250 × 250 px grids, without bottom and right stripes. Moreover, such a grid size was earlier used in preprocessing RGB photographs in order to keep standard pixel intensity and to reduce computational time [34]. In this step, PIL library for Python and crop method were used. Subsequently, each slice was projected into the HSV colour space and a single band V was extracted, using skimage package and rgb2hsv method. Water bodies usually have uniform brightness, also called value [15], ranging from 0 to 1. Each pixel within the grid has its own value representing V. The next step was to convert values recorded in each grid from raster to numeric format, and to write them in a separate .csv file. In each file, one record corresponded to the V value in a single pixel. This step was conduced using the PIL library and getdata method. We also tested grids of size 125 × 125 px, to which the aforementioned three-step procedure was also applied.

3.2. Edge Detection

Although it is rather uncommon to detect river coastlines based solely on RGB imagery (i.e., without thermal or hyperspectral information), we attempted to roughly (at the lattice level) identify coastlines in visible-light UAV-acquired aerial images. We adopted the aforementioned concept of Rankin and Matthies [15], who noticed that water has uniform brightness in imagery, which corresponds to small variability of the V band in the HSV colour scale. Our approach is based on projecting RGB images into the HSV scale, and extracting the V band for further scrutiny. Hence, we do not seek specific colours which, in fact, may vary considerably for water (water can be expressed in RGB aerial imagery as a blue, green, brown, or even black feature). Instead of doing so, we consider the empirical probability distribution (histogram) of V, attempting to describe cases in which a histogram or its part corresponds to generation of pixels that do not vary considerably in terms of V.

In our approach, the key distinction is based on a number of modes a given histogram reveals. The following situations may occur: (1) unimodal distribution of V, and (2) multimodal distribution of V. To test for unimodality against multimodality we use the method of Silverman [35] and its R implementation in the modetest function with 100 bootstrap samples.

In the first case (point 1 above), we probably face land cover of uniform or similar characteristics over the entire image grid (Figure 3). According to Rankin and Matthies [15], water reveals a small variability of V, therefore leptokurtic histograms are likely to correspond to water bodies. Mesokurtic or platykurtic histograms do not represent a small variability of V, thus they are not considered as representing water. Although there are statistical tests for kurtosis (e.g., the Anscombe–Glynn test), they mainly help to identify statistically significant departures from mesokurtisity and do not measure the strength of such departures. Therefore, to detect if a given histogram is leptokurtic, we adopted the commonly known criterion that meaningfully non-normal distributions occur when kurtosis exceeds 7 [36,37], after [38]. Note that Curran et al. [36] call the conditions with kurtosis of 7 (and skewness of 2) as moderately departing from multivariate normality, and they also claim that “[…] it seems clear that obtained univariate values approaching at least 2.0 and 7.0 for skewness and kurtoses are suspect”. Also, Kim [38] referred to West et al. [37], and claimed that kurtosis greater than 7 indicates non-normality, with positive excess kurtosis being leptokurtic. Although kurtosis is a good measure of peakedness around the mean, in the case of asymmetric distributions, the mode can depart from mean and the additional measure of concentration around the mode is needed. Therefore, we produced the additional simple empirical test for measuring concentration around mode, known hereinafter as the concentration test. It considers the interval ranging from “mode minus 25% of standard deviation” to “mode plus 25% of standard deviation”, and calculates the percentage of values falling into it. We assume that there exists concentration of values around the mode if the above-mentioned percentage is considerably greater than 19.74% (percentage probability that values fall between–0.25 and 0.25 quantiles of the standard normal distribution), plus some empirical excess value $\delta$ responsible for a considerable excess from 19.74%. In other words, the concentration test checks if the underlying empirical distribution is narrower around the mode than the standard normal distribution.

In the second case (point 2 above), more than two modes in the empirical probability distribution of V correspond to variable land cover within an image grid, i.e., a number of modes is likely to correspond to a number of prevailing (dominant) land cover types (Figure 4). In such cases, we face a mixture of probability distributions (histograms). In order to check if a given multi-modal histogram may consist of a signal of water, we again apply the above-mentioned concentration test. If the V values of pixels are grouped around the most frequently occurring mode (narrow V band), it may indicate water. Note that kurtosis is not used in the multi-modal case, since the mixture of distribution produces spread around the overall mean (not corresponding to a specific component of a histogram) and, therefore, kurtosis does not measure how values are gathered near modes.

A given 250 × 250 px grid receives flag 1 (water coastline detected) if:

• In the case of one mode (situation 1 above), kurtosis is greater than 7 and concentration of values around the mode is detected using the concentration test with $\delta$ = 0.15;
• In the case of several modes (situation 2 above), the concentration test with $\delta$ = 0.1 suggests a considerable concentration of values around the most frequently occurring mode.

A summary of the edge detection process is presented in Figure 5.

3.3. Accuracy Assessment

Since our approach is solely based on RGB aerial images, the problem of detecting river coastlines occurs when vegetation or shadows prevent the view. This concerns both the automated detection of coastline and human vectorization of coastline, the latter being used for validation. Figure 6 presents examples of such problems, which—in case of vegetation overhanging the channel—may be driven by a nadir position of camera.

In order to validate the automatically detected coastline, reference data were manually produced by assessing each image grid separately and assigning the following flags into each grid: 0 (no coastline) or 1 (coastline). As a result, thirty .csv files (one file for each image), in which one record corresponds to one slice, were produced. Subsequently, we compared the “waterline/no-waterline” grids indicated by the detector with the corresponding grids evaluated visually.

Accuracy assessment was carried out with the use of two statistics, detection rate (DR) and false hit rate (FHR), calculated as follows:

$$\begin{array}{c}\hfill \begin{array}{c}\hfill DR=\frac{TP}{TP+FN}\ast 100\%,\end{array}\end{array}$$

(1)

$$\begin{array}{c}\hfill \begin{array}{c}\hfill FHR=\frac{FP}{TP+FP}\ast 100\%,\end{array}\end{array}$$

(2)

where TP—true positive (both detector and human analyst assessed a grid as coastline); FN—false negative (detector indicated a grid as no coastline but human analyst interpreted it as coastline); and FP—false positive (detector indicated a grid as coastline but human analyst evaluated it as no coastline). The DR and FHR accuracy indices are also known in the literature as the producer accuracy and error of commission, respectively.

3.4. Calibration of Detector

In order to check which set of parameters works best while detecting river coastlines, we tested nine scenarios (S1–S9) in which we took into account three variables: kurtosis threshold, concentration around mode (determined by the empirical value $\delta$), and the logical relationship between them (

Table 5. Parameters of detector.

1	2	3
Scenario	Kurtosis	$\mathit{\delta }$ * for One of Distribution		2 OR/AND 3
		Unimodal	Multimodal
S1	6	0.1	0.05	OR
S2	7	0.1	0.05	OR
S3	7	0.1	0.05	AND
S4	7	0.15	0.1	OR
S5	7	0.15	0.1	AND
S6	20	0.1	0.05	OR
S7	20	0.1	0.05	AND
S8	20	0.15	0.1	OR
S9	20	0.15	0.1	AND

* see Section 3.2.

).

The experiment was conducted on the basis of seven images covering rivers and small lakes (

Table 6. Detector calibration results. S1–S9 described in Table 5.

Scenario	Odra_6		Ścinawka		Bystrzyca_1		Bystrzyca_2		Lake_1 1		Odra_7		Bug_1
	DR	FHR	DR	FHR	DR	FHR	DR	FHR	DR	FHR	DR	FHR	DR	FHR
S1	72.88	39.44	38.64	66.67	82.93	55.26	96.00	63.36	88.89	82.42	72.73	64.18	80.77	75.58
S2	71.19	34.38	38.64	64.58	82.93	52.11	96.00	52.94	88.89	81.18	72.73	62.50	80.77	74.70
S3	66.10	25.00	38.64	63.04	75.61	43.64	96.00	52.94	77.78	80.82	60.61	44.44	69.23	66.04
S4	62.71	32.73	31.82	56.25	68.29	48.15	92.00	58.18	66.67	77.36	48.48	69.23	73.08	72.46
S5	62.71	22.92	31.82	53.33	65.85	32.50	92.00	44.58	61.11	74.42	42.42	39.13	65.38	61.36
S6	71.19	30.00	38.64	63.83	82.93	47.69	96.00	57.14	88.89	80.49	72.73	54.72	73.08	72.86
S7	55.93	21.43	38.64	62.22	78.05	33.33	94.00	46.59	55.56	84.62	54.55	28.00	69.23	63.27
S8	62.71	26.00	31.82	53.33	68.29	34.88	92.00	47.73	66.67	73.91	48.48	56.76	65.38	69.64
S9	50.85	21.05	31.82	54.84	65.85	27.03	90.00	40.79	38.89	81.58	39.39	27.78	61.54	58.97

¹ One additional image was used for detector calibration, not analysed in this paper.

). The aim of the calibration was to achieve the most considerable decrease in false hit rate (FHR) and, concurrently, the lowest possible decrease in detection rate (DR). We assumed that DR should be at least 60%. We calculated the differences of DR and FHR with respect to the original S1 scenario for each image. Then, we checked which scenario returned the best values in comparison with S1. Consequently, 30 images juxtaposed in Table 4 were processed using parameters adopted from S5.

4. Results

4.1. Detection Performance Statistics

Table 7. Waterline detection statistics.

No.	River	Region	Image Name	250 × 250 px		125 × 125 px
				DR	FHR	DR	FHR
1	Bug	Binduga	Bug_1	65.38	61.36	55.32	81.02
2			Bug_2	65.38	26.09	51.22	54.35
3			Bug_3	44.12	6.25	41.27	31.58
4	Biała Lądecka	Żelazno	Biała_1	40.00	82.76	54.55	81.25
5			Biała_2	39.39	62.86	31.82	76.67
6	Bystrzyca Dusznicka	Szalejów Dolny	Bystrzyca_1	65.85	32.50	70.93	53.44
7			Bystrzyca_2	92.16	43.37	89.69	57.14
8			Bystrzyca_3	72.09	40.38	61.18	49.02
9			Bystrzyca_4	54.84	5.56	59.38	25.49
10			Bystrzyca_5	36.36	15.79	34.07	44.64
11	Izera	Hala Izerska	Izera	42.86	25.00	40.00	36.84
12	Kwisa	Gryfów Śląski	Kwisa	22.22	0.00	24.42	51.16
13	Nysa Kłodzka	Byczeń	Nysa_1	88.57	48.33	57.61	53.10
14		Ławica	Nysa_2	57.45	42.55	42.42	53.33
15			Nysa_3	51.28	28.57	42.67	65.22
16		Śrem	Nysa_4	54.55	45.45	34.85	62.90
17	Odra	Dąbrowa	Odra_1	60.87	41.67	45.24	70.77
18			Odra_2	46.67	41.67	42.86	53.45
19			Odra_3	60.60	28.57	67.24	23.53
20			Odra_4	63.30	5.00	60.42	19.44
21		Gogolin	Odra_5	47.62	65.52	50.00	71.01
22			Odra_6	62.71	22.92	40.68	48.39
23			Odra_7	42.42	39.13	35.38	70.89
24			Odra_8	78.57	15.38	59.26	42.86
25		Kunice	Odra_9	61.90	38.10	65.12	41.67
26		Pomorsko	Odra_10	59.09	50.00	56.10	70.89
27			Odra_11	55.56	56.52	53.12	83.00
28		Wyszanów	Odra_12	66.67	60.78	57.14	66.97
29			Odra_13	61.90	38.10	43.18	50.65
30	Ścinawka	Gorzuchów	Ścinawka	31.82	53.33	37.35	71.03
			std	15.34	19.80	13.53	17.09
			range	69.78	82.76	65.27	63.56

presents the detection performance statistics. Two threshold values for detection rate (DR) were assumed: (1) 50% and (2) 60%. Subsequently, we checked how many cases (expressed in percentage) were found above these values. Considering 250 × 250 px grids, threshold (1) was exceeded for 67% of all 30 images (80% for wide and 40% for narrow rivers). Higher threshold (2) was exceeded for 47% of all images (55% for wide and 30% for narrow rivers). Detection skills were therefore better for wide rivers. As DR is not a standalone measure for detection performance, we also calculated FHR and found that, for cases that exceeded threshold (1), FHR varied between 5.00% and 61.36%, with mean of 36.63%. In order to check the impact of grid size on the detection skills, a division into smaller slices (125 × 125 px) was carried out. However, there was no considerable improvement in the detection performance. Higher DR was obtained only for eight out of thirty cases: five for narrow and three for wide rivers. Simultaneously, an increase in DR and a decrease in FHR was achieved for 2 out of 30 cases (images Biała_1 and Odra_3). Thus, the bigger grid size was chosen for further analysis. All thirty analysed images presenting results visually are included in Supplementary Material.

4.2. Image-Specific Observations

The highest detection rate (DR) was achieved for Bystrzyca_2 (Figure 7a), which presents a narrow channel of Bystrzyca Dusznicka. The image was taken in winter when sky was overcast. It resulted in colours that were very similar to grey scale. Uniform, black water, which was distinguished from the white neighbourhood, resulted in high DR (92%). However, there also occurred false positive hits (red squares) driven by other black features, like trees protruding from snow cover. For images presenting narrow, natural rivers without regulation structures, and with the occurrence of shadows and reflections from water surface, the detection performance was found to be much worse. In those situations, there were few false positives, but DR was low and the detector did not resolve real coastlines; that is, there were a considerable number of false negatives (yellow squares). In contrast, the waterline detection in Kwisa (Figure 7b) ended up with a lack of false positive hits (FHR was equal to 0%); however, the DR was as low as 22%, possibly due to an extremely high error of omission (above 78%). The reasons for low accuracy in such cases were: sunlight reflection from the water surface and visible submerged riverbed forms. The detection performance was also affected by the river neighbourhood. Roads, buildings, and regularly shaped crop fields—characterized by homogeneous colours and being located close to the river channel—formed local disturbances responsible for increasing the FHR (Biała_1, Figure 7c). The detector treated the boundaries of roads, buildings and crop fields as coastlines, therefore a lot of false positive indications (red squares) resulted in the highest FHR.

4.3. Visual Assessment

In addition to the accuracy assessment, the images can also be evaluated visually to observe whether true positives tend to create linear elements, which may indicate the approximate course of the river coastline. In Odra_8, it could be noticed that green squares (TP) showed the course of the river coastline well (Figure 8a). On the other hand, there were a few yellow squares (FN) that made the detection rate (DR) lower. A similar situation was presented in Odra_4. Although there was only one red square (FP), which led to one of the lowest false hit rates (FHRs), the occurrence of FNs also decreased the DR (Figure 8b). The detection results for Bystrzyca_4 seemed to be good. However, Bystrzyca Dusznicka is a narrow river, and therefore the green grids were too big and touched each other (Figure 8c). Indicating one or two separate river coastlines was impossible, so the detection performance was not satisfactory in this case. Visually the worst detection occurred for Biała_1 (Figure 8d). There were a lot of FPs, which resulted in a high FHR, and a lot of FNs, which led to a small DR. The stream in this picture was shallow and some riverbed forms were visible because of high transparency and small depth of water. The detector did not recognize water as a surface with uniform colours, and was not able to resolve the coastline.

4.4. Factors Affecting Detection

The coverage water class (Table 4, including its definition in a footnote) plays an important role, since there exists a visible relationship between features recorded in an image and detection rate (DR). For lower class (1,2), which means that small part of the entire image is covered by water, the DR is low. For higher class (3,4), the DR is high. Moreover, in the cases presented in this paper, the coverage water class refers to width of a river. The lower class occurs in case of narrow rivers and streams, while the higher class corresponds to wide rivers. For most of the analysed images, the detection performance is better for wide rivers than for narrow rivers.

In cases with easily detectable coastline, for instance when banks are clearly visible as a result of regulation works and the presence of retaining walls (e.g., Bystrzyca_2 and Bystrzyca_4), the detector works well. The performance can also be improved when contrast between water and its surrounding is enhanced, for instance due to snow cover in the vicinity of a channel. The skills of the coastline detector deteriorates when river becomes narrow. Indeed, one or two separate coastlines of a narrow river cannot be resolved, either with 250 × 250 px or 125 × 125 px grids (Table 7).

Visibility of the river coastline through vegetation is yet another factor that affects the detector performance. When river banks are visible, not covered by vegetation, the detector works better and, in most cases, the DR is high. The presence of trees or scrubs above the river banks is the reason why the detected coastline is shifted from the real coastline position. According to Figure 6 and the description in Section 3.3, the detector resolves a boundary between water and “no-water" fragments within the image, therefore it cannot delineate real coastline hidden by vegetation.

The occurrence of uniformly coloured human-made structures, such as roads and buildings, may cause the detector to misinterpret such places as water and, as a consequence, produce a boundary between them and their neighbourhood. Detecting edges that are not associated with water may lead to additional errors (false positives) to the decrease in false hit rate (FHR). Also, local structures associated with one land unit could lead to false positive hits.

We identified a few factors controlling the performance of the elaborated waterline detection method. Below, they are grouped according to false responses (FP/FN).

• Factors which lead to the incorrect detection of river coastlines in places where there are no coastlines (FP):

  −

  The occurrence of linear objects and objects with uniform colours (like roads, buildings) in the vicinity of a river (Figure 7c and Figure 8d). The detector interprets these areas as water due to the presence of edges. For the detector, there is no difference between a water edge and the edge of a different uniformly coloured object.

  −

  The presence of continuous and homogeneous snow surface in a photo. If there exist visible natural or artificial objects (such as scrubs, crop field without snow, trees) with colours different than snow and also revealing a linear character, the detector indicates borderline at places other than coastline (Figure 7a).

  −

  Vegetation protruding from water. There is only one false positive in Figure 8b, where an edge was detected between the water surface and vegetation protruding from the water.

• Factors which lead to omitting river banks in places where there are coastlines (FN):

  −

  There occurred cases where the river coastline was clearly visible in the imagery, but the detector did not resolve it, leading to the occurrence of FNs. When river is shallow, underwater bedforms may be visible, thus limiting the waterline detection performance (Figure 8c,d).

  −

  False negative indications appear where only a small part of river coastline falls within the grid (Figure 7 and Figure 8).

  −

  When the edge of a grid overlaps with the real coastline (but any part of river falls into the grid), our method does not resolve the coastline in question (Figure 7c and Figure 8d). In order to reduce this type of error, shifted grids may be employed [39].

5. Discussion

In the literature, there exist several approaches to delineate river coastline or estimate water stages. However, usually, additional survey devices, sensors, or data are necessary, e.g., a total station, a GNSS receiver, or extra spectral bands other than RGB. The advantage of our approach is that we use only RGB images acquired by UAVs (no other equipment or data are required), and also that we reduce the image colour dimension from 3 to 1 in order to work on the V component (which is possibly faster and a simpler computation). Focusing on papers which uses only RGB images, their advantages, in general, are revealed as simple, cheap and fast data acquisition. On the other hand, they are sensitive to water surface disturbances (e.g., reflections, waves, shadows). In our approach, we also encountered these constraints, which affected detection accuracy.

Table 8. Strengths and weaknesses of RGB-based coastline and water body detection methods.

Reference	Strength	Weakness
Namikawa et al. (2016) [12]	Simple method without user intervention and with little computational power	Noisy pixels must be eliminated
Niedzielski et al. (2016) [7]	Highly available (RGB consumer-grade camera mounted on UAV needed)	Manual digitization needed
Wei and Zhang (2016) [16]	Effective and robust method	Shadow sensitive method
Kröhnert and Meichsner (2017) [18]	Highly available (smartphone needed)	Method sensitive on users motions and vegetation moving in the wind
Eltner et al. (2018) [19]	Highly available (low-cost camera needed)	Direct access to river vicinity needed, GCPs and total station required
Ridolfi and Manciola (2018) [23]	Rapid and inexpensive procedure	GCPs required
Tymków et al. (2019) [24]	High overall accuracy	Additional sensor required (best results obtained for RGB+TIR combination)
Eltner et al. (2021) [21]	Highly available (low-cost camera needed)	Direct access to river vicinity needed, GCPs and total station required

presents advantages and disadvantages of different waterline detection methods that use mainly RGB images.

Ridolfi and Manciola [23], as well as Tymków et al. [24], captured RGB images by means of UAVs, and the collected material was subsequently processed to obtain coastline or water body extent.

In [23], the pixel-based classification was carried out and, in addition, the edge detection procedure was employed in accordance with the Canny method [40] to delineate coastline. On the contrary, our method uses a coarse lattice (grids of size 250 × 250 pixels) as an indivisible domain, which is a conceptually different approach from the one described in [23]. The similarity resides in that both methods aim at edge detection as a tool for delineating waterlines. However, the applied edge detection methods are unlike each other—Ridolfi and Manciola [23] consider local maximum values of a gradient of a grey scale, while in this study, we explore empirical probability distributions (histograms) of V bands extracted from the HSV colour space. Also, unlike our study, GCPs were required in the approach of Ridolfi and Manciola [23].

Tymków et al. [24] claimed that “On average, the best was obtained for combined, four-bands ortho mosaic created from RGB and TIR images”, so the additional sensor (thermal camera) is necessary to obtain the best results. Our method is conceptually different, since it accepts the compromise between coastline detection performance and universality. Namely, the universality in question is associated with access to RGB cameras (most drones have them onboard) which—if used separately from other sensors and devices—may offer sufficient data to very accurately reconstruct coastlines (but lower accuracy is attained).

As stated above, we reduced the dimension of colour space of aerial images (RGB → HSV → V) following the finding of Rankin and Matthies [15] that water has uniform brightness, and therefore V remains stable when representing water. Similarly, Namikawa et al. [12] detected the water extent in RGB satellite images by transferring them into HSV and reducing the dimension by extracting hue (the H component in the HSV colour space), which differs from our approach. The concept was adopted from [41], where the H component was found to enable good visual separability between water and other features, and the separability in question was found to be even better than for Normalized Difference Water Index (NDWI) using either near-infrared or shortwave-infrared.

It is also worth comparing the waterline detector presented in this study with the coastline detection method elaborated by Wei and Zhang [16] to be applied in an unmanned surface vehicle (USV). Such vehicles flow on water surface and, therefore, the photos they take are not nadir images, but are horizontal or oblique. This forms a different view, since reflections from the water are different, the terrain is visible from a different perspective, and most images observe the sky as well. In [16], the structure and texture analysis of photographs was employed, and the mean error was 1.84 px. Since our detector works on a coarse lattice of 250 × 250 px, a quantitative comparison with the method of Wei and Zhang [16] is impossible. However, a visual analysis of case studies indicates similar constraints: both approaches are sensitive to shadows, depend on illumination, and are vulnerable to the presence of vegetation. Similarly to [16], a non-nadir camera pose was studied by Kröhnert and Meichsner [18], who detected coastlines in close-range photographs taken by smartphones. Visually, waterlines were resolved well in [18]; however, non-nadir frames presented waterlines located close to lens (5–35 m), which makes the results difficult to compare with our findings.

Eltner et al. [19,21] focused on a similar problem from a different perspective. Namely, these authors mounted a low-cost camera locally onto a lantern pole, bridge or tree. The camera captured several RGB images in certain time intervals, and time-lapse image sequences were created. In our case, UAVs moved and photos were taken with spatial overlap, thus their centres of projection were different. In general, during a photogrammetric flight, there is no possibility to acquire image sequences in the same, static location. Thus, our data acquisition procedure differs from the approach proposed by Eltner et al. [19,21].

Niedzielski et al. [7] utilized RGB aerial images to detect significant changes in water levels on the basis of variations in water surface areas. One form of input data was the water body extent determined by time-consuming manual digitization. Our method, as well as other RGB-based approaches outlined above, may serve the purpose of determining such extents, which may be a step towards making the method described in [7] unsupervised.

6. Conclusions

In this paper, a histogram-based method for delineating river coastlines in UAV-acquired nadir RGB images was presented. Unlike other methods, which resolve waterlines on the basis of RGB imagery, our approach operates on a coarse lattice superimposed on a photo (grid size of 250 × 250 px). The reason behind this is twofold. Firstly, the detector analyses a probability distribution of the V component in the HSV colour space, which is doable when the variability of V is available (not single values, but samples extracted from many grids). Secondly, the gridwise (and thus spatially coarse) domain facilitates computations, which is important when coastline should be rapidly resolved during floods. The computation time is also saved due to the reduction in the dimension of input data, attained through projecting photos from RGB to HSV and, subsequently, selecting V as a band, which is said to be stable for water.

Our approach was tested and validated on a diversified set of 30 nadir aerial images collected by UAV-mounted cameras at 14 sites along nine rivers in Poland, revealing dissimilar fluvial characteristics (Table 3). We identified several factors limiting the method: (1) the river width, (2) the land cover, (3) shadows, (4) vegetation, and (5) the characteristics of the water. Firstly, we found that the performance of our detector was better for wide rivers than for narrow channels. This may refer to the fact that the detector is efficient when water covers the majority of an image area. This means that the water coverage class (Table 4) plays an important role in controlling the detection performance. Secondly, land cover (more precisely, the homogeneity of its colour) in the vicinity of a river is also a significant factor that influences the performance in question. When the image includes objects with heterogeneous colours, thus revealing a heterogeneous V value in the HSV colour model, there exist favourable conditions to delineate river coastlines. On the other hand, if there are uniformly coloured objects, like roads or buildings, the detector may incorrectly classify such areas as coastlines. Moreover, shadows and vegetation were found to impede waterline determination. As is presented in Figure 5, shadows cast by trees are likely to be incorrectly recognized as a coastline and, consequently, classified as a false positive indication. Also, the characteristics of water itself were found to impact the performance of detection skills. Our method works well primarily for water of uniform colours. Such a feature is present when a river is wide and deep (no or limited signal from underwater bedforms).

Despite the above-mentioned limitations, our approach provides quick, cheap, and rough detection of waterlines. It may be utilized to analyse the diversified water environment, especially where water is deep. Detecting river or lake coastlines, as well as monitoring their changes, are potential applications of the method presented in this paper. It is solely based on RGB imagery, and both satellite and low-altitude photos can be used as input data.

Further studies should focus on migrating from coarse grids to lines, and correct detection errors. To increase the detection accuracy, spatial filtering could be applied. Namely, based on the analysis of neighbouring grids, errors could be eliminated. If we assume that the river coastline is linearly continuous, isolated positives are artefacts, and should be changed to negatives, and isolated negatives may become positives, for example through the process of interpolation.