Correcting gradient-based interpretations of deep neural networks for genomics.

Genome Biol

Simons Center for Quantitative Biology, Cold Spring Harbor Laboratory, 1 Bungtown Road, Cold Spring Harbor, NY, USA.

Published: May 2023


Category Ranking

98%

Total Visits

921

Avg Visit Duration

2 minutes

Citations

20

Article Abstract

Post hoc attribution methods can provide insights into the learned patterns from deep neural networks (DNNs) trained on high-throughput functional genomics data. However, in practice, their resultant attribution maps can be challenging to interpret due to spurious importance scores for seemingly arbitrary nucleotides. Here, we identify a previously overlooked attribution noise source that arises from how DNNs handle one-hot encoded DNA. We demonstrate this noise is pervasive across various genomic DNNs and introduce a statistical correction that effectively reduces it, leading to more reliable attribution maps. Our approach represents a promising step towards gaining meaningful insights from DNNs in regulatory genomics.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC10169356PMC
http://dx.doi.org/10.1186/s13059-023-02956-3DOI Listing

Publication Analysis

Top Keywords

deep neural
8
neural networks
8
attribution maps
8
correcting gradient-based
4
gradient-based interpretations
4
interpretations deep
4
networks genomics
4
genomics post
4
post hoc
4
attribution
4

Similar Publications

Obsessive-compulsive disorder (OCD) is a chronic and disabling condition affecting approximately 3.5% of the global population, with diagnosis on average delayed by 7.1 years or often confounded with other psychiatric disorders.

View Article and Find Full Text PDF

Use of artificial intelligence for classification of fractures around the elbow in adults according to the 2018 AO/OTA classification system.

BMC Musculoskelet Disord

September 2025

Department of Clinical Sciences at Danderyds Hospital, Department of Orthopedic Surgery, Karolinska Institutet, Stockholm, 182 88, Sweden.

Background: This study evaluates the accuracy of an Artificial Intelligence (AI) system, specifically a convolutional neural network (CNN), in classifying elbow fractures using the detailed 2018 AO/OTA fracture classification system.

Methods: A retrospective analysis of 5,367 radiograph exams visualizing the elbow from adult patients (2002-2016) was conducted using a deep neural network. Radiographs were manually categorized according to the 2018 AO/OTA system by orthopedic surgeons.

View Article and Find Full Text PDF

The mesocorticolimbic system in stimulant use disorder.

Mol Psychiatry

September 2025

Department of Psychiatry and Behavioral Neuroscience, University of Chicago, Chicago, IL, USA.

Stimulant Use Disorder (StUD) is a pervasive and extremely dangerous form of addiction for which there are currently no approved medications. Discovering treatments will require a deep understanding of the neural mechanisms underlying the behavioral effects of stimulant drugs. A major target is the mesocorticolimbic system.

View Article and Find Full Text PDF

Deep learning approaches have improved disease diagnosis efficiency. However, AI-based decision systems lack sufficient transparency and interpretability. This study aims to enhance the explainability and training performance of deep learning models using explainable artificial intelligence (XAI) techniques for brain tumor detection.

View Article and Find Full Text PDF

Two-Step Semi-Automated Classification of Choroidal Metastases on MRI: Orbit Localization via Bounding Boxes Followed by Binary Classification via Evolutionary Strategies.

AJNR Am J Neuroradiol

September 2025

From the Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, New York, United States of America (J.S.S., B.M., S.H., A.H., J.S.), and Department of Aerospace Engineering, Indian Institute of Technology Madras, Chennai, Tamil Nadu, India (H.S.).

Background And Purpose: The choroid of the eye is a rare site for metastatic tumor spread, and as small lesions on the periphery of brain MRI studies, these choroidal metastases are often missed. To improve their detection, we aimed to use artificial intelligence to distinguish between brain MRI scans containing normal orbits and choroidal metastases.

Materials And Methods: We present a novel hierarchical deep learning framework for sequential cropping and classification on brain MRI images to detect choroidal metastases.

View Article and Find Full Text PDF