Statistical significance: p value, 0.05 threshold, and applications to radiomics-reasons for a conservative approach.

Eur Radiol Exp

Radiology Unit, IRCCS Policlinico San Donato, Via Morandi 30, 20097, San Donato Milanese, Italy.

Published: March 2020


Category Ranking

98%

Total Visits

921

Avg Visit Duration

2 minutes

Citations

20

Article Abstract

Here, we summarise the unresolved debate about p value and its dichotomisation. We present the statement of the American Statistical Association against the misuse of statistical significance as well as the proposals to abandon the use of p value and to reduce the significance threshold from 0.05 to 0.005. We highlight reasons for a conservative approach, as clinical research needs dichotomic answers to guide decision-making, in particular in the case of diagnostic imaging and interventional radiology. With a reduced p value threshold, the cost of research could increase while spontaneous research could be reduced. Secondary evidence from systematic reviews/meta-analyses, data sharing, and cost-effective analyses are better ways to mitigate the false discovery rate and lack of reproducibility associated with the use of the 0.05 threshold. Importantly, when reporting p values, authors should always provide the actual value, not only statements of "p < 0.05" or "p ≥ 0.05", because p values give a measure of the degree of data compatibility with the null hypothesis. Notably, radiomics and big data, fuelled by the application of artificial intelligence, involve hundreds/thousands of tested features similarly to other "omics" such as genomics, where a reduction in the significance threshold, based on well-known corrections for multiple testing, has been already adopted.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC7064671PMC
http://dx.doi.org/10.1186/s41747-020-0145-yDOI Listing

Publication Analysis

Top Keywords

statistical significance
8
005 threshold
8
conservative approach
8
significance threshold
8
threshold
5
significance 005
4
threshold applications
4
applications radiomics-reasons
4
radiomics-reasons conservative
4
approach summarise
4

Similar Publications

Background: Owing to the unique characteristics of digital health interventions (DHIs), a tailored approach to economic evaluation is needed-one that is distinct from that used for pharmacotherapy. However, the absence of clear guidelines in this area is a substantial gap in the evaluation framework.

Objective: This study aims to systematically review and compare the economic evaluation literature on DHIs and pharmacotherapy for the treatment of depression.

View Article and Find Full Text PDF

Importance: This study represents a first successful use of a genetic biomarker to select potential responders in a prospective study in psychiatry. Liafensine, a triple reuptake inhibitor, may become a new precision medicine for treatment-resistant depression (TRD), a major unmet medical need.

Objective: To determine whether ANK3-positive patients with TRD benefit from a 1-mg and/or 2-mg daily oral dose of liafensine, compared with placebo, in a clinical trial.

View Article and Find Full Text PDF

Importance: Janus kinase (JAK) inhibitors are highly effective medications for several immune-mediated inflammatory diseases (IMIDs). However, safety concerns have led to regulatory restrictions.

Objective: To compare the risk of adverse events with JAK inhibitors vs tumor necrosis factor (TNF) antagonists in patients with IMIDs in head-to-head comparative effectiveness studies.

View Article and Find Full Text PDF

Importance: Survivors of critical illness often have ongoing issues that affect functioning, including driving ability.

Objective: To examine whether intensive care unit (ICU) delirium is independently associated with long-term changes in driving behaviors.

Design, Setting, And Participants: This multicenter, longitudinal cohort study included 151 survivors of critical illness residing within 200 miles of Nashville, Tennessee.

View Article and Find Full Text PDF

Syringomyelia is a common and heritable disorder in Cavalier King Charles Spaniels (CKCS), characterised by fluid accumulation within the spinal cord that may result in pain and neurological dysfunction. The prevalence of syringomyelia in CKCS in Australia has not previously been reported. The goal of this study was to assess the prevalence and severity of syringomyelia in magnetic resonance imaging (MRI)-screened breeding CKCS in New South Wales, Australia, from 2008 to 2024, and to evaluate changes over time.

View Article and Find Full Text PDF