EWT: Efficient Wavelet-Transformer for single image denoising.

Neural Netw

Department of Mathematics, The Chinese University of Hong Kong, New Territories, 999077, Hong Kong, China. Electronic address:

Published: September 2024


Category Ranking

98%

Total Visits

921

Avg Visit Duration

2 minutes

Citations

20

Article Abstract

Transformer-based image denoising methods have shown remarkable potential but suffer from high computational cost and large memory footprint due to their linear operations for capturing long-range dependencies. In this work, we aim to develop a more resource-efficient Transformer-based image denoising method that maintains high performance. To this end, we propose an Efficient Wavelet Transformer (EWT), which incorporates a Frequency-domain Conversion Pipeline (FCP) to reduce image resolution without losing critical features, and a Multi-level Feature Aggregation Module (MFAM) with a Dual-stream Feature Extraction Block (DFEB) to harness hierarchical features effectively. EWT achieves a faster processing speed by over 80% and reduces GPU memory usage by more than 60% compared to the original Transformer, while still delivering denoising performance on par with state-of-the-art methods. Extensive experiments show that EWT significantly improves the efficiency of Transformer-based image denoising, providing a more balanced approach between performance and resource consumption.

Download full-text PDF

Source
http://dx.doi.org/10.1016/j.neunet.2024.106378DOI Listing

Publication Analysis

Top Keywords

image denoising
16
transformer-based image
12
image
5
denoising
5
ewt
4
ewt efficient
4
efficient wavelet-transformer
4
wavelet-transformer single
4
single image
4
denoising transformer-based
4

Similar Publications

Spatial transcriptomics (ST) reveals gene expression distributions within tissues. Yet, predicting spatial gene expression from histological images still faces the challenges of limited ST data that lack prior knowledge, and insufficient capturing of inter-slice heterogeneity and intra-slice complexity. To tackle these challenges, we introduce FmH2ST, a foundation model-based method for spatial gene expression prediction.

View Article and Find Full Text PDF

The human kidneys play a pivotal role in regulating blood pressure, water, and salt homeostasis, but assessment of renal function typically requires invasive methods. Deuterium metabolic imaging (DMI) is a novel, noninvasive technique for mapping tissue-specific uptake and metabolism of deuterium-labeled tracers. This study evaluates the feasibility of renal DMI at 7-Tesla (7T) to track deuterium-labeled tracers with high spatial and temporal resolution, aiming to establish a foundation for potential clinical applications in the noninvasive investigation of renal physiology and pathophysiology.

View Article and Find Full Text PDF

Concurrent recording of electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI) signals reveals cross-scale neurovascular dynamics crucial for explaining fundamental linkages between function and behaviors. However, MRI scanners generate artifacts for EEG detection. Despite existing denoising methods, cabled connections to EEG receivers are susceptible to environmental fluctuations inside MRI scanners, creating baseline drifts that complicate EEG signal retrieval from the noisy background.

View Article and Find Full Text PDF

Mass spectrometry imaging (MSI) is a label-free technique that enables the visualization of the spatial distribution of thousands of ions within biosamples. Data denoising is the computational strategy aimed at enhancing the MSI data quality, providing an effective alternative to experimental methods. However, due to the complex noise pattern inherent in MSI data and the difficulty in obtaining ground truth from noise-free data, achieving reliable denoised images remains challenging.

View Article and Find Full Text PDF

Cervical cancer remains a significant cause of female mortality worldwide, primarily due to abnormal cell growth in the cervix. This study proposes an automated classification method to enhance detection accuracy and efficiency, addressing contrast and noise issues in traditional diagnostic approaches. The impact of image enhancement on classification performance is evaluated by comparing transfer learning-based Convolutional Neural Network (CNN) models trained on both original and enhanced images.

View Article and Find Full Text PDF