Multi-Modular Network-Based Retinex Fusion Approach for Low-Light Image Enhancement

Abstract

Current low-light image enhancement techniques prioritize increasing image luminance but fail to address issues including loss of intricate distortion of colors and image details. In order to address these issues that has been overlooked by all parties, this paper suggests a multi-module optimization network for enhancing low-light images by integrating deep learning with Retinex theory. First, we create a decomposition network to separate the lighting components and reflections from the low-light image. We incorporated an enhanced global spatial attention (GSA) module into the decomposition network to boost its flexibility and adaptability. This module enhances the extraction of comprehensive information from the image and safeguards against information loss. To increase the illumination component’s luminosity, we subsequently constructed an enhancement network. The Multiscale Guidance Block (MSGB) has been integrated into the improvement network, together with multilayer extended convolution to expand the sensing field and enhance the network’s capability for feature extraction. Our proposed method out-performs existing ways in both objective measures and personal evaluations, emphasizing the virtues of the procedure outlined in this paper.

1. Introduction

Digital image processing technology is becoming increasingly prevalent in electronic information devices, with applications ranging from traffic management to medical imaging, criminal investigation, remote sensing, and other extensive fields [1,2]. However, in some cases, the obtained image may not be ideal due to issues such as low brightness, resolution, contrast, and other problems. Nighttime photo recognition, real-time video surveillance, nighttime face recognition, and other applications require a solution for low image/video brightness. Improving the brightness and contrast of low-light images is of great research significance for enhancing the efficiency of computer vision work.

Enhancing low-light images can be classified into conventional techniques and deep learning methods. Conventional techniques include histogram equalization (HE) [3] and Retinex theory methods [4]. Many improved conventional techniques have been developed based on HE and Retinex theory. Improved methods based on HE includes local histogram equalization. This method processes the image locally using a sliding window to operate on the image in chunks, making image detail processing more obvious. Improved algorithms based on Retinex theory include Single Scale Retinex (SSR) [5], Multi Scale Retinex (MSR) [6], and Multi-Scale Retinex with Color Restoration (MSRCR) [7]. SSR and MSR are image processing methods that aim to retain the essential characteristics of an object by suppressing the influence of the incident image. MSR is an improvement on SSR, as it simultaneously preserves the image’s high fidelity and reduces its dynamic range. MSR can be used to enhance color, maintain color consistency, compress local dynamic range and compress global dynamic range. MSRCR is a method based on MSR that aims to eliminate color distortion in images caused by contrast enhancement in local areas. It brings out information in relatively dark areas while restoring the original colors of the image.

In 2017, Lore et al. proposed LLNet [8]. LLNet is trained using pairs of low light image datasets and can adaptively enhance image brightness by recognizing image features from the low illumination image. However, the use of Stacked Sparse Denoising Autoencoder (SSDA) as the core of LLNet may have limitations in processing high-resolution images or capturing image details. While this structure is effective at denoising and enhancing the brightness and contrast of images, it can lead to the loss of high-frequency data., which often contains detailed features of the image, during the coding phase of the network. Wei et al. [9] (2018) proposed RetinexNet. The method effectively demonstrates the Retinex decomposition effect, but the resulting images may contain noise. EnlightenGAN [10] is an image enhancement method that utilizes Generative Adversarial Networks (GANs) with U-Net structured generators and discriminators. The network is trained using adversarial loss, content loss, and illumination loss to produce images with more natural illumination. The method improves image detail retention but lacks in enhancing image brightness and removing shadowed portions. R2RNet [11] is an improved version of RetinexNet, proposing a specialized noise reduction network that is deeper and provides excellent results on the dataset used. Zhu et al. proposed RRDNet [12], a zero-sample learning method that does not rely on paired image datasets and achieves enhancement through iterative minimization of the loss function. However, the enhancement effect of RRDNet is limited by underexposure and requires a large amount of device hardware and long running time. Sci [13] introduces an auxiliary process during training, enhancing the capability of the basic unit model to better capture and process image features. Additionally, Sci [13] proposes a self-correcting weight sharing module that effectively reduces computation time and improves stability. However, the enhancement process may over-smooth or alter certain details of the image, which can negatively affect the final image quality. Existing low-light picture enhancing techniques can efficiently enhance image luminosity. However, some methods overlook image details, resulting in color distortion, noise, and other issues.

In order to address the aforementioned issues that have been overlooked by existing methodologies, this paper integrates deep learning with Retinex theory to propose a multimodular network for optimising low-light images. The network structure consists of two modules: Decom-Net and Enhance-Net. The Decom-Net module separates the low light image and normal light image into independent illumination components and smooth reflectance components. The reflectance components obtained from both should be the same, and the illumination components obtained should be free from noise interference. In the Decom-Net module, we have included the proposed global spatial attention (GSA) module to obtain more detailed global information during the Decom-Net process. Additionally, the Enhance-Net module is used to adjust the illumination component. We have employed multiscale connectivity to maintain regional consistency. In the Enhance-Net module, we have introduced the proposed Multi-Scale Guidance Block (MSGB) to better extract the multiscale feature components by expanding the receptive field. The proposed method was evaluated on a range of low-light image datasets using objective metrics and subjective visual comparisons. The study showed that the suggested technique surpasses previous methods for enhancing low-light images. Our main contributions are:

(1)

A multi-module low light image enhancement network is proposed, which is founded upon the Retinex theory. The network is divided into two main components: a Decom-Net module and an Enhance-Net module. Two networks are used to decompose the input image and to enhance the illumination component.

(2)

In the Decom-Net and augmentation modules, we added a global spatial attention (GSA) module and a Multi-Scale Guidance Block (MSGB). The global spatial attention module aims to obtain more detailed global information during the Decom-Net process. The MSGB aims to better preserve the detailed features of the illumination components.

(3)

Our suggested strategy outperforms existing methods in enhancing image characteristics and structure, as demonstrated by both subjective and objective evaluation metrics. Additionally, it is capable of improving image brightness and contrast while effectively reducing image noise, outperforming other methods.

2. Related Work

2.1. Total Network Structure

Low-light image enhancement methods often introduce more noise and severe color distortion. To tackle these issues, we propose a multi-module low-light image enhancement method based on Retinex. The network comprises two sub-networks: a Decom-Net module and an Enhance-Net module. During the training process, the paired image dataset is input into the Decom-Net module. The loss function constrains the output to obtain the same reflectance component of the low-light image and the normal light image, resulting in the illumination component of the low-light image. The Enhance-Net takes the illumination component and reflectance component of the low light image as inputs, with the primary objective of increasing the brightness of the illumination component. Figure 1 depicts the architecture of our proposed network.

2.2. Decom-Net

To boost the brightness of dim images using Retinex theory, it is crucial to effectively distinguish the high-quality illumination part from the reflection component. The result of the decomposition will have a direct impact on the subsequent improvement of the network, the specific decomposition of the network structure is shown in Figure 2. Residual concatenation has demonstrated excellent performance in the field of image processing, which can reduce the model complexity, the risk of overfitting, and so on. We incorporate the proposed Global Spatial Attention Mechanism (GSA) module into the decomposition network. The GSA module enhances the ability of the decomposition network to focus on key regions in the image and improves the feature representation by combining the Global Spatial Attention Mechanism (GSA) and feature fusion techniques. The GSA network structure is shown in Figure 3. The main feature is the ability to adaptively adjust the importance of different spatial locations, while better preserving the original image feature information. The GSA module utilized in the decomposition network employs multiple steps to achieve enhanced decomposition outcomes. Initially, the GSA module conducts adaptive pooling to extract both maximum and average features from each channel. Subsequently, these features are merged and up-sampled to the original dimensions. Following this, a convolutional layer is applied to further process the features, introducing spatial attention to amplify key region information. Finally, the original features are fused with the attention-enhanced features to derive the final feature representation. This structured process ensures effective enhancement of feature representations within the network. The Decom-Net employs four GSA modules.

The Decom-Net utilizes paired datasets of low illumination/normal luminance images to decompose low illumination images and normal luminance images based on obtaining the same reflectance component according to Retinex theory. Therefore, it is only necessary to work with appropriate loss functions such as reflectance consistency loss and illumination smoothing loss, and no additional normal reflectance components and illumination need to be provided in the training process.

2.3. Enhance-Net

After acquiring the illumination and reflectance components from the Decom-Net, the next step is to improve the visual effect of the enhancement results by adjusting the contrast of the illumination components. The U-Net has an excellent structural design, and a significant number of enhancement networks in the field of low-light image enhancement have adopted the U-Net as the main framework for their networks, achieving excellent results. Nevertheless, the utilization of multiple maximum pooling layers within the fundamental U-Net network has the potential to significantly impact the extraction of image features, which is contrary to the intended objective. In this paper, we utilize the improved U-Net network to construct the augmented network. Figure 4 shows the layout of the enhancement network. In this approach, the pooling layer of the original network is replaced by an adjustment to the convolutional step size. This operation increases the number of parameters, yet the resulting enhancement effect is optimal. The receptive field is the range of influence of neurons in a certain layer on the input data. The size of the receptive field is affected by the size of the convolution kernel. This directly impacts the network’s capacity to extract input information. Stacking multiple convolutional layers can be more effective in obtaining high-level information from the feature component. However, this operation may significantly increase the number of network parameters, leading to a higher risk of overfitting. To address this issue, DRNet [14] modifies the network structure connections, effectively resolving overfitting and training instability. Building on this approach, we propose a Multi-Scale Guidance Block (MSGB). The Guidance Block incorporates a dilation convolution with a variable dilation factor, illustrated in Figure 5. The Multi-Scale Guidance Block utilizes multilevel dilated convolutions, connected layer by layer. A self-guided approach is employed to utilize the dilation convolution with a larger dilation factor to guide the dilation convolution with a lower one. This approach has the potential to enhance the feature extraction ability. The enhancement network consists of 10 convolutional layers in which MSGB is inserted.

The network for Enhance utilizes the illumination component and reflectance component obtained from the Decom-Net to produce an improved illumination component. Finally, the reflectance component ${(R}_{low})$ obtained from the Decom-Net and the illumination component (${\tilde{I}}_{low}$) obtained from the Enhance-Net are multiplied element by element ($\circ$) to acquire the ultimate improved image ($\tilde{S}$), which can be described as:

$$\tilde{S}=R_{low}\circ {\tilde{I}}_{low}$$

(1)

2.4. Loss Function

The loss function consists of two components: decomposition loss and illumination smoothing loss, defined below.

Decomposition loss is defined as the sum of image fidelity loss ($L_{rec}$) and reflection component consistency loss ($L_r$):

$$L_{Decom}={{\lambda }_1\ast L}_{rec}+{\lambda }_2\ast L_r$$

(2)

where $L_{rec}$ is the image fidelity loss and ${\lambda }_1$ is its corresponding coefficient. We set it to 1. $L_r$ is the reflection component consistency loss and ${\lambda }_2$ is its corresponding coefficient, which we set to 0.001.

Image fidelity loss:

$$L_{rec}=\sum _i\sum _j{\Vert R_i·I_j-S_j\Vert }_1$$

(3)

in the aforementioned equation, $i,j\in (low,normal)$.

The Retinex theory posits that the reflection image of a low-light image and a normal-brightness image are essentially similar, yet the difference between the two illumination images is considerable. In order to facilitate the decomposition of the reflection component and the illumination component by the model, with the objective of reconstructing the corresponding original image as accurately as possible, we establish an image fidelity loss.

Reflected component consistency loss is defined as:

$$L_r=\sum _i\sum _j{‖R_i-R_j‖}_1$$

(4)

in the aforementioned equation, $i,j\in (low,normal)$.

The Retinex theory states that the reflection component is independent of the original image and illumination components. Consequently, the reflection component, when decomposed from the low luminance image and the normal luminance image, should exhibit consistency. To achieve this, we set the reflection component consistency loss $L_r$.

Illumination Smoothing Loss is composed of three terms:

$$\begin{gathered} L_{right}={‖R_{low}·\widehat{I}-S_{normal}‖}_1+{\lambda }_3\ast L_{PSNR} \\ +{\lambda }_4\ast L_{to} \end{gathered}$$

(5)

The symbol $\widehat{I}$ denotes the enhanced illumination component. ${‖R_{low}·\widehat{I}-S_{normal}‖}_1$ denotes the reconstruction loss in the augmentation-adjusted $\widehat{I}$ and $R_{low}$ vs. $S_{normal}$. $L_{PSNR}$ represents the PSNR loss, and ${\lambda }_3$ is its corresponding coefficient. We set it to 1.5. The smoothing loss is represented by $L_{to}$, and ${\lambda }_4$ is its corresponding coefficient. We set it to 0.001.

PSNR loss:

$$L_{PSNR}=-PSNR\left(\left(R_{low}·\widehat{I}\right),S_{normal}\right)$$

(6)

The PSNR loss, which is the value obtained during PSNR calculation, reflects the difference between the reconstructed image and the original image. The aim is to obtain a higher quality image.

Smoothing loss:

$$L_{to}=\sum _{k=1}^N\sum _{m\in \mathcal{M}\left(i\right)}{‖X_k-X_m‖}_1$$

(7)

where $N$ denotes the total number of pixels. $k$ denotes the k-th pixel. $\mathcal{M}(i)$ denotes the neighboring pixels of the i-th pixel in its 5 × 5 window. The smoothing loss function draws upon the concept of a pixel neighborhood, wherein there are 24 neighboring pixels in addition to the center pixel k in a 5 × 5 window. The pixel difference around pixel k is calculated as the loss value.

The paper presents the total loss function of the proposed method:

$$L_{loss}=L_{Decom}+L_{right}$$

(8)

3. Comparison of Experimental Results

3.1. Experimental Setup

This research uses the LOL dataset [9] and VE-LOL dataset [15] for training. The LOL dataset contains 500 pairs of low and normal brightness images. The image resolution is 400 × 600. The VE-LOL dataset is a large-scale dataset that contains 2500 pairs of low/normal brightness images, which is more diverse than the LOL scenarios. The methods proposed in our paper were tested and trained on an Intel i9 processor with 32G RAM and an NVIDIA GeForce RTX4070 GPU.

3.2. Comparison of Enhancement Effects

We use existing publicly available datasets, including LOL, VE-LOL, DICM [16] and LIME [17] datasets, to compare the method proposed with other existing low-light image enhancement methods (Retinex, MSRCR, RetinexNet, LightenNet [18], EnlightenGAN [10], DSLR [19], ExCNet [20], MBLLEN [21], ZeroDCE [22], R2RNet [11], RRDNet [12], Sci, RUAS [23]) are compared subjectively and objectively. To guarantee a fair comparison, we are using additional methods from pre-trained models provided by the authors for validation without making any modifications to the published code. For subjective comparison, we use the MOS scoring system in this paper and for objective comparison, we use commonly used image evaluation metrics (PSNR, SSIM, NIQE, Entropy, BRISQUE).

3.2.1. Subjective Evaluation

To demonstrate specific effects, we selected single images from the LOL, VE-LOL, and LIME datasets for subjective evaluation. We chose comparison methods from the 13 mentioned above, and their results are presented in Figure 6, Figure 7 and Figure 8.

Figure 6 illustrates the efficacy of the method proposed and other algorithms on the LOL dataset. It is evident that all the methods successfully enhance the brightness of the image. However, some methods are less effective than others in enhancing image brightness, such as LightenNet, DSLR, RRDNet, Sci, and RUAS. Among the remaining methods, R2RNet is known to cause noticeable color distortion. On the other hand, Retinex and MSRCR are effective in enhancing image brightness, but they tend to lose a significant amount of image detail in the process. The proposed method outperforms RetinexNet and EnlightenGAN in terms of image quality. The enhanced images are visually clearer and less noisy, resulting in a more natural and realistic feel. The preservation of details further contributes to the overall clarity of the image. In contrast, images generated by RetinexNet and EnlightenGAN may exhibit more noise or distortion, particularly at the edges or detailed parts of the image. The proposed method demonstrates superior performance and quality in the field of image enhancement.

Figure 7 demonstrates the enhancement achieved by the strategy suggested in this paper when compared to other methods on the VE-LOL dataset. Thereinto, the enhancement effect of Retinex can be seen as a distortion of the whole image color. Same as the LOL dataset, the luminance enhancement including LightenNet, DSLR, ExCNet, RRDNet, Sci and RUAS are not as effective as the method mentioned in this paper. The colors of the objects in R2RNet’s enhanced image appear to be less vibrant. This can be seen in the green hanger in the enhanced R2RNet image in Figure 7, where the color of the hanger in the enhanced image is bluish instead of the green it should be. The brightness of the enhancement effect produced by MSRCR and MBLLEN is more noticeable. However, upon closer inspection, it can be observed that dense white-dot noise is present in the improved images generated by these two methods. The experimental comparison shows that the proposed method in this research produces enhancement results that closely resemble the true brightness image. This is apparent not only in image brightness but also in image color consistency, detail retention, and noise reduction.

The improvement observed on the LIME dataset as a result of various algorithms is illustrated in Figure 8. It is pertinent to highlight that the LIME dataset is a reference-free image dataset and lacks a normal brightness image for reference. The results show that enhancement using classical methods such as Retinex and MSRCR results in overexposure and general distortion of the image colors. The RUAS method resulted in poor subjective visual improvement. LightenNet and RRDNet did not improve luminance as well as the other methods. The ExCNet method leads to a severe loss of detail in the enhanced image. On the contrary, the method proposed in this research improves the image’s brightness and contrast without compromising its detail and color constancy.

To ensure a fair comparison, we completed a user study. For the comparison of various validation methods, we randomly selected an image of a real scene. We invited 50 students to score each method using the MOS metrics approach. Our scores contain 5 points from 1–5, with higher scores indicating that the student had a better sensory visualization of the method. The invited students gave due consideration to image brightness, noise, color and detail features. The distribution of scores for all comparison methods is shown in Figure 9. Among the various methods, the approach was proposed and R2RNet did not achieve the lowest score of 1. In contrast, the method proposed achieved the highest number of scores, exceeding that of R2RNet. The sum of the number of scores of 5 and 4 obtained by the method of this paper is the highest, indicating that the method proposed is more suited to the visual effect of the human eye under the same environment. In order to provide a more accurate representation of the advantages of subjective vision, we compare the mean values of the ratings of all methods. The data indicates that the mean of the methods presented in this paper (3.82) is superior to that of the second-place R2RNet (3.76). The remaining methods are as follows: Retinex (1.86), MSRCP (3.56), RetinexNet (2.74), EnlighenGAN (3.24), LightenNet (2.24), DSLR (2.14), ExCNet (3.02), MBLLEN (3.52), Zero-DCE (3.06), R2RNet (3.76), RRDNet (2.4), Sci (3.12), RUAS (2.5).

3.2.2. Objective Evaluation

The LOL dataset and VE-LOL dataset are paired image datasets with low illumination and normal brightness. Therefore, we use objective evaluation metrics such as PSNR and SSIM to evaluate reference images. Additionally, non-reference image evaluation metrics like NIQE can also be used for paired image dataset evaluation. The PSNR indicator is inversely proportional to the image distortion. The SSIM indicator varies between 0 and 1, with values nearing 1 suggesting improved images that closely resemble normal brightness. The NIQE value is indicative of better image quality when it is smaller. Please refer to

Table 1. The evaluation results of the LOL dataset and the VE-LOL dataset on PSNR, SSIM, and NIQE metrics are presented objectively. (The best results are shown in red, the second best in green and the third best in blue).

Method	PSNR↑	LOL SSIM↑	NIQE↓	PSNR↑	VE-LOL SSIM↑	NIQE↓
Input	7.773	0.122	9.015	9.812	0.267	5.172
Retinex	10.781	0.616	6.869	11.583	0.538	6.347
MSRCP	13.173	0.462	8.114	14.790	0.682	5.822
RetinexNet	16.744	0.673	5.102	15.609	0.449	4.793
EnlightenGAN	17.575	0.719	4.716	18.682	0.726	4.375
RRDNet	11.032	0.518	4.603	16.177	0.636	4.952
LightenNet	10.301	0.402	5.542	11.307	0.629	4.724
DSLR	15.050	0.597	4.965	16.204	0.582	5.034
ExCNet	16.432	0.708	4.498	18.694	0.733	4.495
Zero-DCE	14.788	0.731	4.592	14.071	0.369	4.807
R2RNet	18.203	0.734	4.899	18.179	0.765	4.523
RUAS	11.309	0.435	4.420	12.386	0.357	4.824
MBLLEN	17.092	0.715	4.722	16.039	0.691	4.455
Sci	15.457	0.666	4.323	12.542	0.373	4.717
Ours	18.345	0.733	4.338	18.708	0.773	4.200

and

Table 2. A Comparison of DICM Dataset Evaluations on NIQE, Entropy and BRISQUE Metrics. (The best results are shown in red, the second best in green and the third best in blue).

Method	NIQE↓	Entropy↑	BRISQUE↓
Input	8.568	11.668	53.265
Retinex	6.645	11.016	44.749
MSRCP	5.235	12.135	28.265
RetinexNet	5.709	12.334	22.877
EnlightenGAN	5.270	11.932	28.473
RRDNet	5.357	12.512	35.649
LightenNet	6.232	11.525	36.153
DSLR	5.614	12.321	33.092
ExCNet	5.066	11.827	38.747
Zero-DCE	5.739	12.183	27.573
R2RNet	5.362	12.367	25.574
RUAS	5.945	11.524	42.344
MBLLEN	5.390	11.437	35.365
Sci	4.958	12.835	28.853
Ours	4.908	12.571	21.566

for further details.

Table 1 shows that the proposed method outperforms most of the methods on the LOL dataset in terms of PSNR, SSIM, and NIQE metrics. which exceeded second place by 0.142 dB (18.345–18.203) in PSNR. While finishing second in the SSIM and NIQE metrics, the difference from first place was less than 0.1 in both cases, and the PSNR, SSIM and NIQE indicators on the VE-LOL dataset are in the leading position. The proposed method’s effectiveness is fully demonstrated in this study.

The DICM is an unreferenced dataset of 69 images. Table 2 shows the results of comparing various methods using NIQE, Entropy, BRISQUE, and LOE metrics for the DICM dataset. This method is the best on the DICM dataset for the NIQE and BRISQUE metrics. It obtains the second position in the Entropy metric, with a small difference from the first place.

3.2.3. Time Analysis

We selected images from three different sized image datasets and selected some of the deep learning methods for runtime comparison. The specific results are presented in

Table 3. Runtime comparisons (in seconds).

Method	$500 \times$375 (LIME)	$640 \times$480 (LOL)	$960 \times$640 (LSRW)
RetinexNet	0.103	0.127	0.234
RRDNet	132.872	167.260	211.383
ExCNet	17.034	23.280	31.738
Zero-DCE	0.110	0.126	0.139
R2RNet	0.288	0.312	0.474
RUAS	0.027	0.044	0.076
MBLLEN	11.033	13.995	17.328
Ours	0.112	0.131	0.275

. One of the fastest ways to run a speed test is RUAS. However, it is found that the running speed of the 640 $\times$ 480 image size still does not meet the requirements of 25 frames per second, while the requirements of general industrial cameras are 120 frames per second. Therefore, how to improve the running speed is currently one of the research hotspots. In contrast, the running time of the proposed method is not much different from that of other faster methods when obtaining the best objective indicators and the best subjective visual effects.

4. Ablation Experiments

As a first step, we carry out a subjective visual comparison with the naked eye. Demonstrate the effectiveness of our proposed module, we selected an image from the LIME dataset for the ablation experiment comparison, as shown in Figure 10.

Figure 10 shows the effect of the missing GSA and MSGB modules and the improved effect of the method proposed. It is clear that the lack of two modules results in a noisier decomposition of the reflection component, while the illumination component loses more detail. The second and fourth rows, highlighted in green, demonstrate that our proposed method has richer detailed features compared to the method lacking the GSA module, and it effectively avoids image color distortion. The reflectance component obtained from the Decom-Net of the proposed method retains a more stereoscopic image in the red boxes of the third and fourth rows. Additionally, the comparison of the enhanced illuminated image shows that the method lacking MSGB appears to overexpose the local area and lacks image information. The proposed module is necessary and effective, as shown by subjective visual comparison.

We compared the ablation experiments of the approach without the module in Figure 10 with our suggested method using an objective image evaluation metric. We compare our complete method to networks that lack only the SGA module or only the MSGB module. The specific results are presented in

Table 4. Ablation Experiment Indicators Evaluation.

GSA	MGDB	PSNR↑	SSIM↑	NIQE↓
×	×	17.362	0.772	4.404
√	×	17.974	0.778	4.353
×	√	18.755	0.784	4.340
√	√	19.122	0.789	4.338

.

Table 4 demonstrates that networks lacking the GSA or MGDB module exhibit inferior performance compared to the technique introduced in this paper based on PSNR, SSIM, and NIQE metrics. This demonstrates the effectiveness of the network modules and loss functions introduced.

5. Discussion

Our study indicates that, when compared with other methods using objective evaluation metrics and subjective visual perception scores, our proposed method for low-light images demonstrates superior performance in objective metrics. Furthermore, it achieves the highest rankings subjective visual perception scores, which corroborates the efficiency of our proposed method. However, in practice, the use of low-light image enhancement methods is primarily employed for the purpose of facilitating higher visual tasks, such as nighttime task recognition, nighttime road monitoring, and so forth. Following experimental analysis, it was found that the method proposed in this paper is unable to meet the requirement of 25 frames per second for ordinary video when dealing with night-time video enhancement. Furthermore, it was observed that when dealing with part of the video obtained through video splicing techniques, some distortion occurs at the splicing place. It is our intention to conduct further research into the light weighting of our method, and to produce spliced image datasets with the intention of optimising the applicability of our proposed method.

6. Conclusions

This paper presents a deep learning-based multi-module network that employs Retinex theory to enhance low-light photos. The network comprises Decom-Net and Enhance-Net. Decom-Net decomposes images into illumination and reflectance using weight sharing, enhanced by a GSA module for global information capture. The Enhance-Net module enhances the illumination, with the assistance of an MSGB module that performs multi-stage convolution and improves feature extraction. This technique has been demonstrated to outperform other low-light enhancement algorithms in both subjective and objective evaluations.