高精度人类数采
高精度人类数采在计算机视觉与人机交互领域具有重要意义。面向以第一视角(egocentric)为核心的真实交互场景,对人体(尤其是手部)的精准、高效数据采集与建模,能够为虚拟现实、增强现实、智能驾驶、机器人交互等应用提供更加自然、直观且贴近人类操作方式的交互基础。例如,在虚拟现实场景中,通过第一视角下对用户手部运动与形态数据的实时、准确采集与重建,系统能够实现更具沉浸感的交互体验,如精细抓取与操作虚拟物体。在机器人领域,基于第一视角采集的人类操作数据更贴近真实执行过程,可作为示教与学习的重要来源,帮助机器人理解人类动作意图,提升人机协作效率。此外,高质量的第一视角人体与手部数据还可为医学分析、动画制作等领域提供可靠的数据支撑,辅助疾病诊断、数字人建模与动作生成等任务。我们的研究主要致力于提升基于RGB与Depth模态的第一视角人体(尤其是手部)数据采集与建模的精度、效率及鲁棒性。
-
Generalizable Hand-Object Modeling from Monocular RGB Images via 3D Gaussians
Xingyu Liu, Pengfei Ren*, Qi Qi, Haifeng Sun, Zirui Zhuang, Jing Wang, Jianxin Liao, Jingyu Wang -
Rule Meets Learning: Confidence-Aware Multi-View Fusion for Self-Supervised 3D Hand Pose Estimation
Pengfei Ren, Jingyu Wang†, Haifeng Sun, Qi Qi†, Jing Wang, Jianxin Liao -
Prior-aware Dynamic Temporal Modeling Framework for Sequential 3D Hand Pose Estimation
Pengfei Ren, Jingyu Wang†, Haifeng Sun, Qi Qi†, Xingyu Liu, Menghao Zhang, Lei Zhang, Jing Wang, Jianxin Liao -
A3-Net: Calibration-Free Multi-View 3D Hand Reconstruction for Enhanced Musical Instrument Learning
Geng Chen∗, Xufeng Jian∗, Yuchen Chen, Pengfei Ren†, Jingyu Wang†, Haifeng Sun, Qi Qi, Jing Wang, Jianxin Liao -
Pose-Guided Temporal Enhancement for Robust Low-Resolution Hand Reconstruction
Kaixin Fan, Pengfei Ren*, Jingyu Wang†, Haifeng Sun, Qi Qi, Zirui Zhuang, Jianxin Liao -
Coarse-to-Fine Implicit Representation Learning for 3D Hand-Object Reconstruction from a Single RGB-D Image
Xingyu Liu, Pengfei Ren*, Jingyu Wang, Haifeng Sun, Qi Qi, Zirui Zhuang, Jianxin Liao -
Keypoint Fusion for RGB-D Based 3D Hand Pose Estimation
Xingyu Liu, Pengfei Ren*, Yuanyuan Gao, Jingyu Wang, Haifeng Sun, Qi Qi, Jianxin Liao -
Decoupled Iterative Refinement Framework forInteracting Hands Reconstruction from a Single RGB Image
Pengfei Ren, Chao Wen, Xiaozheng Zheng, Zhou Xue, Haifeng Sun, Qi Qi, Jingyu Wang, Jianxin Liao -
HaMuCo: Hand Pose Estimation via Multiview Collaborative Self-Supervised Learning
Xiaozheng Zheng, Chao Wen, Zhou Xue, Pengfei Ren, Jingyu Wang -
Region-Aware Dynamic Filtering Network for 3D Hand Reconstruction
Yuchen Chen, Pengfei Ren*, Jingyu Wang, Haifeng Sun, Qi Qi, Jing Wang, Jianxin Liao
