HuggingFace Daily Papers(社区热门论文)
45AI 编辑部评分,满分 100

Hand Visibility Detector:逐关键点手部可见性估计

2026-08-12 08:00· 1天前
AI 导读

Hand Visibility Detector 首次将手部关节可见性估计作为独立任务系统研究,利用大规模预训练 HPE 模型作为骨干网络实现高精度估计。在下游 3D 手部姿态标注任务中,基于可见性加权的多视角三角化降低了重投影误差。该方法已作为即用型包发布,代码与演示已公开。

Hand Pose Estimation (HPE) is a fundamental technology for various applications such as AR/VR and robotics. In these applications, the visibility of each hand joint in the image is crucial for assessing the reliability of estimation results under occlusion. However, most existing HPE methods output joint positions without explicitly indicating their visibility. Although some methods account for occlusion or visibility, visibility estimation has mainly been used as an auxiliary signal for improving pose estimation. To our knowledge, per-joint hand visibility estimation has not been systematically studied as a standalone task. In this work, we propose Hand Visibility Detector, a model for estimating the visibility of individual hand joints, and present the first systematic investigation of visibility estimation as an independent task. We show that leveraging the prior knowledge of HPE models pretrained on large-scale data as a backbone yields high performance in this task. We further demonstrate the utility of Hand Visibility Detector on a downstream task of 3D hand pose annotation via multi-view triangulation of 2D keypoints, showing that visibility-weighted triangulation reduces reprojection error. Our method is released as a ready-to-use package, and the code and demo are available at https://github.com/ryhara/hand_visibility_detector .

来源:HuggingFace Daily Papers(社区热门论文) · arxiv.org

Hand Visibility Detector:逐关键点手部可见性估计

HuggingFace Daily Papers(社区热门论文)·2026-08-12 08:00·1天前
AI 导读

Hand Visibility Detector 首次将手部关节可见性估计作为独立任务系统研究,利用大规模预训练 HPE 模型作为骨干网络实现高精度估计。在下游 3D 手部姿态标注任务中,基于可见性加权的多视角三角化降低了重投影误差。该方法已作为即用型包发布,代码与演示已公开。

原文 · 保持原样,未翻译

Hand Pose Estimation (HPE) is a fundamental technology for various applications such as AR/VR and robotics. In these applications, the visibility of each hand joint in the image is crucial for assessing the reliability of estimation results under occlusion. However, most existing HPE methods output joint positions without explicitly indicating their visibility. Although some methods account for occlusion or visibility, visibility estimation has mainly been used as an auxiliary signal for improving pose estimation. To our knowledge, per-joint hand visibility estimation has not been systematically studied as a standalone task. In this work, we propose Hand Visibility Detector, a model for estimating the visibility of individual hand joints, and present the first systematic investigation of visibility estimation as an independent task. We show that leveraging the prior knowledge of HPE models pretrained on large-scale data as a backbone yields high performance in this task. We further demonstrate the utility of Hand Visibility Detector on a downstream task of 3D hand pose annotation via multi-view triangulation of 2D keypoints, showing that visibility-weighted triangulation reduces reprojection error. Our method is released as a ready-to-use package, and the code and demo are available at https://github.com/ryhara/hand_visibility_detector .

来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org