Volume 32, Issue 5 pp. 1604-1614
RESEARCH ARTICLE
Open Access

Lung CT image enhancement based on total variational frame and wavelet transform

Hongfei Wang

Corresponding Author

Hongfei Wang

Key Laboratory of Adaptive Optics, Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu, China

School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing, China

Correspondence

Hong Fei Wang, Key Laboratory of Adaptive Optics, Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu, 610209, China.

Email: [email protected]

Search for more papers by this author
Ping Yang

Ping Yang

Key Laboratory of Adaptive Optics, Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu, China

University of Chinese Academy of Sciences, Beijing, China

Search for more papers by this author
Chuan Xu

Chuan Xu

School of Medicine, Integrative Cancer Center & Cancer Clinical Research Center, Sichuan Cancer Hospital & Institute Sichuan, Cancer Center, School of Medicine University of Electronic Science and Technology of China, Chengdu, China

Search for more papers by this author
Lei Min

Lei Min

University of Chinese Academy of Sciences, Beijing, China

Search for more papers by this author
Shuai Wang

Shuai Wang

University of Chinese Academy of Sciences, Beijing, China

Search for more papers by this author
Bing Xu

Bing Xu

University of Chinese Academy of Sciences, Beijing, China

Search for more papers by this author
First published: 11 March 2022
Citations: 2

Funding information: This work was supported in part by the National Natural Science Foundation of China (62005285) and Youth Innovation Promotion Association CAS (2017429). The authors would like to thank the Cancer center of Sichuan province for the permission to use data.

Abstract

Benefitting from the development of computer vision, computed tomography (CT) images have been used for assisting doctor's clinical diagnosis and improving the diagnostic efficiency. However, there exist some issues in medical images, such as low contrast, obscure detail, and complex noise due to the restriction of the system and the equipment in the process of imaging, medical images. To resolve these issues, a novel lung CT image enhancement method based on total variational framework combined with wavelet transform is proposed. Firstly, low-frequency structure layer with low contrast and high-frequency details layer with complex noise signals are acquired by decomposing the original image using total variational framework. Then, through the analysis of the histogram distribution characteristics of CT image, structure layer requires contrast enhancement; at the same time, the detail layer performs wavelet transform adaptive threshold denoising to remove noise. Finally, weight fusion of processed structure layer and details layer is performed to obtain the final fusion enhancement CT images. Experimental results show that the proposed method can enhance the contrast of clinical lung CT images, improve the clarity of details, and effectively suppress artifacts and complex noises. Contrast and sharpness—objective indicators—prove the proposed method's advantages. Subjectively, the proposed method performs superior over other existing CT enhancement methods, which achieves a better visual recognition.

1 INTRODUCTION

Due to the inherent properties of medical imaging and the restrictions of system equipment, there are several prominent features of lung computed tomography (CT) images, such as low contrast, noisy mask, and blurred details, which are not conducive to the recognition and analysis of clinicians. As a consequence, clinicians suffer from image noise for a long time. Hence, the improvement of the human visual perception of the lung CT image is conducive for doctor to carry out more accurate clinical diagnosis of lesions and reduce the misdiagnosis rate. Consequently, lung CT image enhancement acting as a preprocessing procedure can increase the accuracy and efficiency in actual medical applications, and has important clinical application value. Many scholars have conducted extensive research in this field.1-10

This paper reviews mainstream image enhancement methods, including traditional histogram stretch methods,11-14 image domain transformed methods,15, 16 image enhancement methods based on joint framework, and so on. Traditional image enhancement methods are mainly divided into spatial enhancement and frequency enhancement, which are used to enhance simple binary image. Existing image domain transformed enhancement methods, for instance, wavelet transform, have no conspicuous enhancement effect on lung CT images. Hence, this paper has a conclusion that single framework was unable to resolve the problem well of blurred details caused by complex noise. Meanwhile, this work finds joint frameworks received more and more attention in recent years, for its capability of integrating the advantages of several algorithms and better solution for complex noise model.

Complex noise is defined by integrating the multiplicative noise and the additive noise, including environment noise, equipment noise, transmitted noise, artificial artifacts, and so on, which contribute to CT image noisy mask, blur tissue boundary, low contrast, and unclear details.17-19

Existing CT image enhancement methods that deal with noise models are insufficient, such as only considering single noise model, or taking no account of artifacts produced by contrast enhancement unintentionally.18 Thus, a novel enhancement algorithm based on total variational framework and wavelet transform is proposed in this paper. The proposed framework has considered several noise models, such as environment noise, equipment noise, and artificial artifacts, and those noise models are the so-called complex noise uniformly. Experiments show that the proposed algorithm suppresses the complex noise effectively, improves the sharpness and clarity of details, and enhances the contrast of lung CT images. The objective indicators prove the proposed method is superior compared with other existing CT enhancement techniques.

Contributions of this work are presented as follows: a more complete noise model than existing medical image enhancement methods; proposes a new adaptive polarization adjustment method; applies total variation with wavelet transform on the CT image enhancement.

The details of the proposed algorithm as well as comparisons with other methods are discussed in the following sections. Then, comparing the experimental results of the proposed method with other recent algorithms. Conclusion and discussion about this work in the end.

2 RELATED WORK

The related work reviews and discusses relevant work in the area of image enhancement methods.

2.1 Spatial enhancement methods

In 2020, Yuebin Zhou et al. proposed a new improved optimized method for medical image enhancement, based on global and local enhancement. The algorithm achieves great contrast enhancement but ignores medical image noise.5 In 2020, Julio et al. proposed a medical image enhancement method using multiscale top-hat transform by reconstructing multilevel features. The method improves contrast and detail, but performs poor generalization ability on some images with abundant details.7 In 2021, Acharya U K et al. proposed a genetic algorithm based adaptive histogram equalization (GAAHE) technique for medical image enhancement. The algorithm gave better results on enhancing contrast than other histogram equalization techniques, but without the consideration of any noise model.3

2.2 Frequency enhancement method

The frequency-domain enhancement method is a kind of method that performs the Fourier transform on image and then uses the filter to handle it. Wavelet transform (WT) is a widely used enhancement method in the frequency domain. It takes advantage of multiscale transformation and good time-frequency analysis characteristics.15 In 2020, Zhi Li et al. proposed an efficient and high-quality medical CT image enhancement algorithm, which utilizes a two-dimensional WT. Though the algorithm performs better visual effect on some fuzzy medical images, it has a simple denoising part.4 In 2020, Ullah Z et al. proposed a hybrid image enhancement method based on two-dimensional WT and feature reduction using color moments. The approach is not friendly to image details due to applying median filter and histogram equalization.9

2.3 Joint framework

In recent years, the combination of multiple image enhancement techniques has become one of the research hotspots in the field of image processing. The joint framework can effectively solve complex problems.

In 1992, Rudin and Osher et al. proposed a nonlinear partial differential algorithm model based on noise removal,20 which was also known as the ROF model. This model introduced total variation into the field of image denoising for the first time and was able to separate most of the noise while preserving the majority of image details.

In 2017, a multi-channel block-matching denoising algorithm for spectral photon-counting CT images was proposed, which had consideration for a photon multiplicative noise model.21 In 2018, Wending Xiang et al. proposed an underwater image enhancement method based on red channel weighted compensation and gamma correction model, which effectively corrected the image distortion caused by serious attenuation of red channel information in underwater images.22 In 2019, Zhang Hong et al. proposed an image denoising method based on wavelet threshold and total variational model, which could overcome the problem of image edge blurriness while removing image noise.23 In 2019, Chunyan Li et al. proposed a non-convex regularization method based on total variation and wavelet framework to remove the multiplicative noise, which could preserve the edges and details of the image more effectively than any single regularization method.24 In 2021, Janan et al. proposed a method for quantitative mammographic image enhancement from the perspective of density. This algorithm might perform better combined with more precise denoising method.6

3 METHODOLOGY

3.1 Characteristics analysis of lung CT image

According to the CT imaging process, there are two common types of noise: the impulsive noise introduced during the transmission process, and the Gaussian noise introduced during the acquisition process.25 Let u(•) denote an image, u0(•) denote the observed image, n(•) denote additive noise component, and k(•) denote multiplicative noise component. Then, lung CT images noise model can be defined as:
u 0 x , y = k x , y * u x , y + n x , y (1)
Where, u(x,y) represents the real image, u0(x,y) represents the image containing noise, u(x,y) and u0(x,y) represent the pixel value of the image at the point (x,y) on the image domain Ω, where k(x,y) represents the multiplicative noise, and n(x,y) represents the additive noise respectively.

3.2 Total variational framework

Total variational image denoising model represents the image as an energy functional; denoising is realized by subtraction of the energy of the image noise under the constraint conditions. Therefore, the image denoising problem is transformed into an energy minimization problem under the total variational framework. The image denoising algorithm based on the total variational framework can not only process the additive noise of the image26 but also be suitable for processing the multiplicative noise of the image.24

The denoising steps of the ROF model are mainly as follows: First, the initial constraint conditions are obtained according to the physical imaging model of the image, and the corresponding energy functional is established; Then, the total variational framework is used to solve the Euler–Lagrange equation corresponding to the energy functional. Finally, according to the initial constraint conditions, the solution of Euler–Lagrange equation satisfying the constraint conditions is obtained. The total variation of the image can be defined as follows:
TV u = Ω u x 2 + u y 2 dxdy (2)
Where ux and uy represent the gradients of the image in the X and Y directions, respectively, Ω represents total image domain. Therefore, the energy minimization problem of the image is transformed into:
min Ω u x 2 + u y 2 dxdy (3)
And the above-mentioned formula must satisfy the following two constraints:
Ω udxdy = Ω u 0 dxdy (4)
Ω 1 2 u u 0 2 dxdy = σ 2 (5)
Where σ > 0 is given. It well known that the denoising process is an inverse problem, which may lead to non-unique solutions. In mathematics, regularization is usually used to constrain the solution space to solve such problems.27 As a result, the minimum energy functional based on the total variational model is expressed as follows:
min E u = λ 2 Ω u u 0 2 dxdy + Ω u 2 dxdy (6)

Where the first item on the right is the data fidelity item to ensure the approximation degree between the denoised image and the original image. The second term is regularization term, which has the function of denoising and smoothing. λ is the regularization parameter for balancing the data item and the regularization item.

It is well known that a common practice in resolving computational photography problems is to decompose images into different layers and recombine them; total variational framework is good at decomposing image.

Based on the ROF model and regularization, the algorithm in this paper adopts the total variational framework to decompose the input image into the structure layer and the detail layer. The structure layer IS obtained by minimizing the following formula:
min Is i I s i I i 2 + λ I s i 2 (7)

The detail layer ID is obtained by calculating the difference between the input image I and the structure layer IS, ID = IIS. λ is the regularization parameter that controls the separation of structure layer and detail layer, and its value is related to the compression artifact.

As shown in Figure 1, a lung CT image is resolved into the low-frequency structure layer IS and high-frequency detail layer ID through total variational decomposition from the perspective of image decomposition.18 As we can see, the structure layer retains the main structure of the image, while the detail layer reflects a deeper level of detail. The low-frequency structure layer has removed complex noise, but retained the characteristics of low contrast, thus there needs to perform contrast enhancement on the structure layer, which contributes to the recognition of lung CT image well for clinician. Meanwhile, the original detail layer contains the deep level image detail and the entire complex noise, and there needs more refinement manipulation to deal with the detail layer.

Details are in the caption following the image
Image decomposing. (A) Original image. (B) Original structure layer IS. (C) Original detail layer ID

Through the analysis of the histogram of the original CT image, as shown in Figure 2, the reason for low contrast is that pixels are concentrated in the middle of dark and bright regions. An adaptive polarization adjustment method was proposed to improve contrast straightforwardly by referring to studies in the literature,28, 29 and Figure 2 shows its efficiency.

Details are in the caption following the image
F Contrast enhancement on structure layer. (A) Original structure layer. (B) Histogram of original structure layer. (C) Enhanced structure layer. (D) Histogram of enhanced structure layer

3.3 Wavelet transform

Wavelet-based denoising techniques have been recognized as powerful tools for denoising, successful applications including suppression of additive noise and removal of blocking artifacts in DCT-Coded images.30 The key idea of wavelet transform is that the wavelet representation can separate the signal and the noise. Four sub-images can be obtained after a two-dimensional image doing once discrete wavelet transform decomposition:
LL i f x , y = < f x , y , Φ j , n x Φ j , m y > (8)
HH i f x , y = < f x , y , Φ j , n x ψ j , m y > (9)
HV i f x , y = < f x , y , ψ j , n x Φ j , m y > (10)
HD i f x , y = < f x , y , ψ j , n x ψ j , m y > (11)

Where ψ and Φ are wavelet function and scale function, respectively.

As shown in Figure 3, the four sub-images are low-frequency subband map LL1, horizontal high-frequency subband map HH1, vertical high-frequency subband map HV1, and diagonal high-frequency subband map HD1, respectively. Likewise, wavelet decomposition is performed on LL1 again to obtain LL2, HH2, HV2, and HD2. The low-frequency subband image retains the main structural information and the majority of complex noise, while the high-frequency subband map mainly preserves the details of the original image.31

Details are in the caption following the image
Two-level wavelet decomposition

For lung CT images, the different singularities of signal and noise in the wavelet domain indicate that the wavelet coefficient of effective signal is larger than that of noise. Therefore, the noise can be effectively removed by selecting appropriate thresholds of wavelet coefficient for filtering. Thresholding was performed only on the wavelet coefficients that do not correspond to any image features. Wavelet threshold denoising is to set the coefficient whose absolute value is lower than the threshold to zero to obtain the estimated wavelet coefficient after processing, and then use the estimated wavelet coefficient to carry out wavelet signal reconstruction, and the obtained signal is the denoised signal.23

3.4 The proposed method

From the perspective of image decomposition, the proposed frame adopts the total variation model to carry out the decomposition on the original image to obtain high-frequency detail layer and low-frequency structure layer, which reduces the artifacts significantly. Then two-dimensional discrete wavelet transforms and an adaptive threshold denoising are applied to the high-frequency detail layer that suppresses complex noise, and contrast enhancement and Gaussian filter are performed on the low-frequency structure layer, which improves the contrast. Finally, the results of two parallel channels are weighted processed sub-images to acquire the final enhanced image.

In detail, note that complex noise is widely distributed on the original CT image or high frequency the details layer through the analysis of image noise model, while structure layer keeps low contrast, further refined processing is necessary.25, 32 The artificial artifacts produced by contrast enhancement unintentionally can be processed by thresholding and Laplace filtering; complex noise can be suppressed through wavelet transform and adaptive threshold denoising in the meantime.

The specific implementation of the proposed framework is shown in Figure 4.

Details are in the caption following the image
The pseudo-code of the proposed method

The ROF algorithm can filter out any compression artifacts effectively while generating the structure layer, consequently the detail layer retains complex noise.18 Therefore, the low-frequency structure layer can be directly enhanced, while the high-frequency detail layer needs to conduct more refined denoising. As shown in Figure 5, image (C) is obtained by performing wavelet transform adaptive threshold denoising algorithm on the image (B), then image (D) is acquired through denoising and sharpening the image (C).

Details are in the caption following the image
Enhancement processing on detail layer. (A) Original image. (B) Original texture layer. (C) Preliminary enhanced texture layer. (D) Final enhanced texture layer
The enhanced structure layer is expressed as ISE, the denoised detail layer is expressed as IDE, and the final image enhancement result is expressed as IE, IE = ISE + IDE. Parallel processing is performed on each channel as follows:
I S E = GF ( HS I S ) (12)
I D E = ATD DWT I D (13)
I E final = SP I E = I E GF I (14)

Where HS(•) denotes adaptive polarization adjustment, which stretches the dark part and the bright part to polarization. GF(•) denotes Gaussian filter, operator is the Laplacian with parameter zero. DWT(•) denotes two-dimensional discrete wavelet transform where applies the wavelets harr. ATD(•) denotes adaptive threshold denoising, threshold parameter is 0.05. SP(•) denotes sharpen operator, Gaussian filter operator is the Laplacian with parameter zero.

The overview of lung CT image enhancement algorithm is shown in Figure 6; meanwhile, the flowchart of the algorithm is shown in Figure 7.

Details are in the caption following the image
Overview of lung CT image enhancement algorithms based on total variation framework and wavelet transform
Details are in the caption following the image
The total flowchart of the proposed method

4 EXPERIMENT RESULTS AND ANALYSIS

The experimental platform is Intel(R)Core (TM) I7-7700HQ processor, the images are from the open data set LIDC-IDRI. To evaluate and verify the performance of the proposed algorithm, this work selects a few lung CT images and chooses several state-of-art enhancement algorithms as comparison.

The proposed algorithm is compared with genetic algorithm based adaptive histogram equalization technique (GAAHE),3 low-dose lung CT image enhancement algorithm based on image decomposition (IDE),25 and a CT image enhancement algorithm based on wavelet transform and histogram equalization (WTHE).4 In the experiment, the experimental parameters are as follows: the iteration of total variational decomposing is 200, lambda is 0.055, the wavelet basis is harr. The experimental results of the above algorithms are compared and analyzed as follows.

4.1 Subjective evaluation

Medical image enhancement aims to enhance the image information, such as tissue, organ, vessel, and lesions, which doctors ar e interested in. Therefore, the algorithm should retain complete detailed information as much as possible while enhancing human visual perception, to help doctors to reduce the clinical misdiagnosis rate. No matter the image is clear or distorted, the image shall eventually be reviewed by doctors, whose subjective image quality evaluation is necessary.33

Figure 8 shows the results of three different lung CT foreground images processed by image enhancement algorithms, the first column (a) are original images. Through subjective observation and analysis, GAAHE method improves contrast but blurs details, resulting in poor visual effect, whereas the proposed method shows superior on these aspects. Then, IDE method enhances contrast while preserves image detail information as much as possible, but it fails to deal with detail sharpening in the lung region and overall contrast, leaving behind blurriness still, whereas the proposed method does well in removing artifacts.

Details are in the caption following the image
Comparison of lung CT foreground. (A) Original images. (B) GAAHE. (C) IDE. (D)WTHE. (E) Proposed

Next, WTHE method enriches the details, whereas this causes misleading possibly for true information, which doctors need recognition, whereas the proposed method makes the interesting details clearer. According to the subjective observation and true assessment of doctors, the proposed method performs well than three compared algorithms in keeping details clear, removing artifacts, denoising, and global sharpness.

Figure 9 shows the result of the pulmonary nodular region of lung CT image processed by proposed algorithms. The proposed algorithm not only improves the sharpness of details in visual but also greatly restrains the complex noise, eliminates the noise mask, and improves the clarity of the boundary and the overall contrast.

Details are in the caption following the image
Performance on the lung CT region of interest

4.2 Objective evaluation

Because medical image enhancement is an inverse problem, the solutions are not unique, so the full reference image quality evaluation indexes PSNR and SSIM as objective evaluation parameters cannot accurately evaluate the actual image quality. Thus, this paper selected contrast and sharpness among the non-reference image quality evaluation parameters as objective evaluation indexes of the processing results of different algorithms.34

Mostly, the larger contrast denotes the richer image level and the more legible visual perception. The larger sharpness indicates the lower blur, with the larger weight ratio of the high-frequency component of the image. All evaluation indicators reflect the clarity of the image.

As shown in Table 1, GAAHE algorithm improves contrast by 100 percent nearly, which performs well than IDE and WTHE in contrast enhancement. But the proposed algorithm improves the image contrast by an average of 9.906% than GAAHE algorithm, while performs superior in visual. Hence, the performance of the proposed algorithm is better than existing algorithms.

TABLE 1. Contrast of CT images
Images Original image GAAHE IDE WTHE Proposed algorithm
Figure 1 0.3039 0.5945 0.2968 0.4188 0.6602
Figure 2 0.3032 0.6067 0.2967 0.4163 0.6645
Figure 3 0.3065 0.6098 0.3001 0.4224 0.6657

As shown in Table 2, the sharpness of IDE methods is equal to the original image almost, which means IDE has no improvement in image sharpness. GAAHE methods have the highest value in sharpness, whereas extra details can lead to misunderstanding for clinical diagnosis. The proposed algorithm performs better than WTHE methods and IDE from the value and visual effect.

TABLE 2. Sharpness of CT images
Images Original image GAAHE IDE WTHE Proposed algorithm
Figure 1 19.1263 38.5433 18.8214 26.1788 30.8285
Figure 2 18.4171 38.2405 18.1586 26.1967 29.4529
Figure 3 19.4477 41.0696 19.2271 27.1992 31.0159

All experiments show that the proposed algorithm can not only enhance the foreground image but also handle with local image well. Therefore, the proposed method has excellent robustness.

5 CONCLUSION

Considering the defined complex noise model, CT image is decomposed into low-frequency structure layer with poor contrast and high-frequency detail layer with complex noise by using the total variational framework from the perspective of image decomposition.

Aiming at the high-frequency detail layer of the image, the wavelet transform is used to transform it to the wavelet domain. The wavelet coefficient of noise is processed and reconstructed to obtain the enhancement detail layer. In view of the poor contrast of low-frequency structure layer, by means of analyzing the histogram characteristic, the adaptive polarization histogram adjustment and Gaussian filter are carried out to obtain the contrast-enhanced structure layer. Finally, the enhanced detail layer and structure layer are fused and sharpened to obtain the enhanced image.

In view of the characteristics of lung CT images such as poor contrast, complex noise, and artificial artifacts, this paper proposes an image enhancement algorithm that combines variation framework with wavelet transform, which performance is superior to existing algorithms in objective indicators and subjective visual effect. Experiments verify the effectiveness and robustness of the proposed algorithm on lung CT images.

6 DISCUSSION

The experimental results show that the proposed framework suppresses the complex noise, eliminates the artificial artifacts, and improves the contrast and detail clarity. In detail, this framework has considered complex noise model compared with GAAHE and WTHE methods. In fact, the methods GAAHE and WTHE perform poorly on details due to histogram equalization. Compared with the proposed framework, IDE algorithm considers noise model insufficiently, and sharpness is not enough, which verified on visual effect. Overall, the proposed framework has improved the accuracy of lesion identification for clinical imaging workers and lays a good foundation for further analysis or segmentation of lesions.

The proposed framework takes a complex noise model into account, while the compared experiments have given a positive answer. Because medical image processing is an inverse question, it is difficult to measure the difference accurately between the enhanced image and the true image, thus rigorous analysis about image model is still required, and future work shall consider this more carefully.

ACKNOWLEDGMENT

Hongfei Wang did conceptualization, software, formal analysis, data curation, visualization, and wrote the original draft. Ping Yang did review, supervision, funding acquisition, and formal analysis. Lei Min did conceptualization, validation, and methodology. Chuan Xu did investigation and validation. Shuai Wang and Bing Xu did supervision and review. The authors would like to thank the editor and reviewers for their comments and suggestions, which helped to improve the quality of the paper significantly.

    DATA AVAILABILITY STATEMENT

    The data that support the findings of this study are openly available in LIDC-IDRI at https://wiki.cancerimagingarchive.net/display/Public/LIDCIDRI.

      The full text of this article hosted at iucr.org is unavailable due to technical difficulties.