Category Ranking
98%
Total Visits
921
Avg Visit Duration
2 minutes
Citations
20
Article Abstract
In complex dynamic environments, robotic arms face multiple challenges such as real-time environmental changes, high-dimensional state spaces, and strong uncertainties. Trajectory planning tasks based on deep reinforcement learning (DRL) suffer from difficulties in acquiring human expert strategies, low experience utilization (leading to slow convergence), and unreasonable reward function design. To address these issues, this paper designs a neural network-based expert-guided triple experience replay mechanism (NETM) and proposes an improved reward function adapted to dynamic environments. This replay mechanism integrates imitation learning's fast data fitting with DRL's self-optimization to expand limited expert demonstrations and algorithm-generated successes into optimized expert experiences. Experimental results show the expanded expert experience accelerates convergence: in dynamic scenarios, NETM boosts accuracy by over 30% and safe rate by 2.28% compared to baseline algorithms.
Download full-text PDF |
Source |
|---|---|
| http://www.ncbi.nlm.nih.gov/pmc/articles/PMC12349172 | PMC |
| http://dx.doi.org/10.3390/s25154681 | DOI Listing |
Publication Analysis
Top Keywords
Similar Publications
Threats to the Aquatic Arthropods of Freshwater Wetlands in a Changing Global Environment.
Annu Rev Entomol
September 2025
5Department of Entomology, University of Georgia, Athens, Georgia, USA; email:
Wetlands and their aquatic arthropods are threatened by climate change (temperature, precipitation). In this review, we first synthesize the literature on environmental controls on wetland arthropods (hydroperiod, temperature, dissolved oxygen) and then assess how these controls operate across freshwater wetlands from different global biomes (tropical/subtropical, temperate, high latitude/altitude, and dry climates) and how changes in climates alter arthropod fauna with consequent modifications to wetland ecosystem functions (decomposition, food web dynamics). We also describe ways to develop bioassessment of climate change impacts on wetlands.
View Article and Find Full Text PDFSolvation Structure of Np in a Noncomplexing Environment.
Inorg Chem
September 2025
Pacific Northwest National Laboratory, Richland, Washington 99352, United States.
The solvation structure of an Np ion in an aqueous, noncomplexing and nonoxidizing environment of trifluoromethanesulfonic (triflic) acid was investigated with X-ray absorption spectroscopy (XAS) combined with ab initio molecular dynamics (AIMD) and time-dependent density functional theory (TDDFT) calculations. Np L-edge X-ray absorption near-edge structure (XANES) and extended X-ray absorption fine structure (EXAFS) data were collected for Np in 1, 3, and 7 M triflic acid using a laboratory-scale spectrometer and separately at a synchrotron facility, producing data sets in excellent agreement. TDDFT calculations revealed a weak pre-edge feature not previously reported for Np L-edge XANES.
View Article and Find Full Text PDFSmart load balancing in cloud computing: Integrating feature selection with advanced deep learning models.
PLoS One
September 2025
College of Business Administration, Northern Border University (NBU), Arar, Kingdom of Saudi Arabia.
The increasing dependence on cloud computing as a cornerstone of modern technological infrastructures has introduced significant challenges in resource management. Traditional load-balancing techniques often prove inadequate in addressing cloud environments' dynamic and complex nature, resulting in suboptimal resource utilization and heightened operational costs. This paper presents a novel smart load-balancing strategy incorporating advanced techniques to mitigate these limitations.
View Article and Find Full Text PDFThe Salmonella phage shock protein system is required for defense against host antimicrobial peptides.
PLoS Pathog
September 2025
Department of Biochemistry and Biomedical Sciences, McMaster University, Hamilton, Ontario, Canada.
Macrophages are professional phagocytes that play a major role in engulfing and eliminating invading pathogens. Some intracellular pathogens, such as Salmonella enterica serovar Typhimurium, exploit macrophages as niches for their replication, which requires precise and dynamic modulation of bacterial gene expression in order to resist the hostile intracellular environment. Here, we present a comprehensive analysis of the global transcriptome of S.
View Article and Find Full Text PDFUnveiling additive effects on molecular packing and charge transfer in organic solar cells: an AIMD and DFT study.
Phys Chem Chem Phys
September 2025
School of Chemistry and Chemical Engineering, Key Laboratory of Theoretical Organic Chemistry and Function Molecule of Ministry of Education, Hunan University of Science and Technology, Xiangtan, 411201, P. R. China.
Additive assisted strategies play a crucial role in optimizing the morphology and improving the performance of organic solar cells (OSCs), yet the molecular-level mechanisms remain unclear. Here, we employ molecular dynamics (AIMD) and density functional theory (DFT) to elucidate the influence of typical additives of 1,8-diiodooctane (DIO) and 3,5-dichlorobromobenzene (DCBB) on molecular packing, electronic structures, and charge transport. It can be observed that both additives can enhance the stacking properties of the donor and acceptor materials, yet they have different effects on the local electrostatic environment.
View Article and Find Full Text PDF