高精度人类数采
高精度人类数采在计算机视觉与人机交互领域具有重要意义。面向以第一视角(egocentric)为核心的真实交互场景,对人体(尤其是手部)的精准、高效数据采集与建模,能够为虚拟现实、增强现实、智能驾驶、机器人交互等应用提供更加自然、直观且贴近人类操作方式的交互基础。例如,在虚拟现实场景中,通过第一视角下对用户手部运动与形态数据的实时、准确采集与重建,系统能够实现更具沉浸感的交互体验,如精细抓取与操作虚拟物体。在机器人领域,基于第一视角采集的人类操作数据更贴近真实执行过程,可作为示教与学习的重要来源,帮助机器人理解人类动作意图,提升人机协作效率。此外,高质量的第一视角人体与手部数据还可为医学分析、动画制作等领域提供可靠的数据支撑,辅助疾病诊断、数字人建模与动作生成等任务。我们的研究主要致力于提升基于RGB与Depth模态的第一视角人体(尤其是手部)数据采集与建模的精度、效率及鲁棒性。
-
Two Heads are Better than One: Image-Point Cloud Network for Depth-Based 3D Hand Pose Estimation
Pengfei Ren, Yuchen Chen, Jiachang Hao, Haifeng Sun, Qi Qi, Jingyu Wang, Jianxin Liao -
SMR: Spatial-Guided Model-Based Regression for 3D Hand Pose and Mesh Reconstruction
Haifeng Sun, Xiaozheng Zheng, Pengfei Ren, Jingyu Wang, Qi Qi, Jianxin Liao -
SA-Fusion: Multimodal Fusion Approach for Web-based Human-Computer Interaction in the Wild
Xingyu Liu, Pengfei Ren, Yuchen Chen, Cong Liu, Jing Wang, Haifeng Sun, Qi Qi, Jingyu Wang -
Mining Multi-View Information: A Strong Self-Supervised Framework for Depth-Based 3D Hand Pose and Mesh Estimation
Pengfei Ren, Haifeng Sun, Jichang Hao, Jingyu Wang, Qi Qi, Jianxin Liao -
A Dual-Branch Self-Boosting Framework for Self-Supervised 3D Hand Pose Estimation
Pengfei Ren, Haifeng Sun, Jichang Hao, Qi Qi, Jingyu Wang, Jianxin Liao -
SAR: Spatial-Aware Regression for 3D Hand Pose and Mesh Reconstruction from a Monocular RGB Image
Xiaozheng Zheng, Pengfei Ren, Haifeng Sun, Jingyu Wang, Qi Qi, Jianxin Liao -
Pose-Guided Hierarchical Graph Reasoning for 3-D Hand Pose Estimation From a Single Depth Image
Pengfei Ren, Haifeng Sun, Jichang Hao, Qi Qi, Jingyu Wang, Jianxin Liao -
Spatial-Aware Stacked Regression Network for Real-Time 3D Hand Pose Estimation
Pengfei Ren, Haifeng Sun, Weiting Huang, Jichang Hao, Daixuan Cheng, Qi Qi, Jingyu Wang, Jianxin Liao -
AWR: Adaptive Weighting Regression for 3D Hand Pose Estimation
Weiting Huang, Pengfei Ren*, Jingyu Wang, Qi Qi, Haifeng Sun -
SRN: Stacked Regression Network for Real-time 3D Hand Pose Estimation
Pengfei Ren, Haifeng Sun, Qi Qi, Jingyu Wang, Weiting Huang
