基于蒙皮模型和WEOPA的人体外形和运动跟踪.docVIP

 基于蒙皮模型和 WEOPA 的人体外形和运 动跟踪# 陈加1，吴晓军1，王煜2** 5 10 15 20 25 30 35 40 （1. 哈尔滨工业大学深圳研究生院，深圳 518055； 2. 香港中文大学机械与自动化工程系 香港） 摘要：为了解决多关节人体三维外形和运动跟踪问题，提出了一种基于蒙皮模型 (skinned model) 和加权扩展正交普鲁克分析 (weighted extended orthogonal procrustes analysis ， WEOPA) 的三维人体外形和运动跟踪方法。首先使用 Shape-From-Silhouettes 方法从当前帧 多目视频图像轮廓中计算出被跟踪人物的可视外壳，然后建立人物先验蒙皮模型并与之匹 配，其中蒙皮模型的引入使得多关节人体三维外形和运动跟踪问题被转化为一个分层非线性 最小二乘匹配问题。考虑到在先验模型获取中肢体间连接部位产生的网格顶点粘连问题，采 用 WEOPA 算法来进行求解，其中通过引入 4 种不同的权值分配策略，克服了顶点粘连对 匹配的影响，并有效利用了匹配点对的几何法线信息。实验结果表明，该方法能对人物外形 和运动进行有效的跟踪。 关键词：模式识别与智能系统；蒙皮模型；WEOPA；人体外形和运动跟踪 中图分类号：TP391. 41 Human Body Shape and Motion Tracking using Skinned Model and WEOPA Chen Jia1, Wu Xiaojun1, Wang Yu2 (1. Shenzhen Graduate School，Harbin Institute of Technology，Shenzhen 518055; 2. Department of Mecha. and Auto. Engineering，Chinese University of Hong Kong，Hong Kong) Abstract: A new 3D human body shape and motion tracking method based on skinned model and WEOPA (weighted extended orthogonal procrustes analysis) is proposed. First，the visual hull of the tracked people in current frame is computed using Shape-From-Silhouettes method from multi-view silhouettes of the synchronized videos; and then，a prior skinned model is created and fitted to the visual hull. Based on the skinned model，the 3D human body shape and motion tracking problem can be transformed into a hierarchical nonlinear least squares matching problem. In order to solve the mesh vertex adhesion problem between limbs and torso of the prior human mesh model，WEOPA algorithm is adopted. Using 4 different weight assigning methods，WEOPA can overcome the bad influence of the mesh vertex adhesion and use the geometric normal information of vertices during fitting. Experimental results show that the proposed method can effectively conduct 3D human body shape and motion tracking． Key words: pattern recognition and intelligent system; skinned model; WEOPA; human body shape and motion tracking 0 引言 构建多目同步视频捕获设备，并采用计算机视觉的方法，对三维人体外形和运动进行测 量与跟踪，由于其在真实感 3D 动画、自由视点