Category Ranking

98%

Total Visits

921

Avg Visit Duration

2 minutes

Citations

20

Article Abstract

Motion retargeting is an active research area in computer graphics and animation, allowing for the transfer of motion from one character to another, thereby creating diverse animated character data. While this technology has numerous applications in animation, games, and movies, current methods often produce unnatural or semantically inconsistent motion when applied to characters with different shapes or joint counts. This is primarily due to a lack of consideration for the geometric and spatial relationships between the body parts of the source and target characters. To tackle this challenge, we introduce a novel spatially-preserving Skinned Motion Retargeting Network (SMRNet) capable of handling motion retargeting for characters with varying shapes and skeletal structures while maintaining semantic consistency. By learning a hybrid representation of the character's skeleton and shape in a rest pose, SMRNet transfers the rotation and root joint position of the source character's motion to the target character through embedded rest pose feature alignment. Additionally, it incorporates a differentiable loss function to further preserve the spatial consistency of body parts between the source and target. Comprehensive quantitative and qualitative evaluations demonstrate the superiority of our approach over existing alternatives, particularly in preserving spatial relationships more effectively.

Download full-text PDF

Source
http://dx.doi.org/10.1109/TVCG.2024.3423426DOI Listing

Publication Analysis

Top Keywords

motion retargeting
16
skinned motion
8
spatial relationships
8
body parts
8
parts source
8
source target
8
rest pose
8
motion
6
retargeting
4
retargeting preservation
4

Similar Publications

Bio-inspired joints play a pivotal role in legged robots, directly determining their motion capabilities and overall system performance. While shape memory alloy (SMA) actuators present superior power density and silent operation compared to conventional electromechanical drives, their inherent nonlinear hysteresis and restricted strain capacity (typically less than 5%) limit actuation range and control precision. This study proposes a bio-inspired joint integrating an antagonistic actuator configuration and differential dual-diameter pulley collaboration, achieving amplified joint stroke (±60°) and bidirectional active controllability.

View Article and Find Full Text PDF

Shoulder girdle plays a dominant role in coordinating the natural movements of the upper arm. Inverse kinematics, optimization, and data-driven approaches are usually used to conduct motion retargeting. However, these methods do not consider shoulder girdle movement.

View Article and Find Full Text PDF

We retarget video stitching to an emerging issue, named warping shake, which unveils the temporal content shakes induced by sequentially unsmooth warps when extending image stitching to video stitching. Even if the input videos are stable, the stitched video can inevitably cause undesired warping shakes and affect the visual experience. To address this issue, we propose StabStitch++, a novel video stitching framework to realize spatial stitching and temporal stabilization with unsupervised learning simultaneously.

View Article and Find Full Text PDF

The creation of 4D avatars (i.e., animated 3D avatars) from text description typically uses text-to-image (T2I) diffusion models to synthesize 3D avatars in the canonical space and subsequently animates them with target motions.

View Article and Find Full Text PDF

Human-robot interaction (HRI) is a key technology in the field of humanoid robotics, and motion imitation is one of the most direct ways to achieve efficient HRI. However, due to significant differences in structure, range of motion, and joint torques between the human body and robots, motion imitation remains a challenging task. Traditional retargeting algorithms, while effective in mapping human motion to robots, typically either ensure similarity in arm configuration (joint space-based) or focus solely on tracking the end-effector position (Cartesian space-based).

View Article and Find Full Text PDF