增强现实中基于三维重建处理遮挡解析.docxVIP

Contentslists availableat ScienceDirectNeurocomputingjournalhomepage:/locate/neucomHandlingocclusionsinaugmentedrealitybased on 3DreconstructionmethodYuan Tiann,1,YanLong, Dan Xia,HuangYao,JinchengZhangSchoolofEducationalInformationTechnology,CentralChinaNormalUniversity,Wuhan430079,ChinaarticleinfoArticlehistory:Received16October2014Receivedinrevisedform25December2014Accepted30December2014CommunicatedbyRongrongJiKeywords: Augmentedreality Occlusionhandling3D reconstructionabstractThe correctrelationshipsbetween realandvirtualobjectsareof utmostimportancetoa realistic augmented realitysystem,in whichtheocclusionhandlingmethodshouldbe abletoestimatethe spatial relationships between real and virtual objects, as well as handle the mutual occlusion automaticallyinreal-time. Toaccomplishtheabovetaskssimultaneously,we propose anovelocclusion handlingmethodbasedon 3D reconstruction,whichconsistsof of?inestageandonlinestage.In the of?inestage,we get thedepthmapof therealsceneusinga lowcostRGB-D camera.Thenthe3D coordinateof eachpointin theglobalcoordinatesystemareobtainedandwill be usedin theonline occlusionhandlingstage.Intheonlinestage,we design aGPUbased3Dpointcloudsalignmentmethod byusingpoint totangentplanedistanceaserrormetrictoacceleratetheconvergencespeedandreduce theiterations.Thecorrectrelationshipsbetweenrealand virtualobjectsarethenobtained automatically by comparingeachpixel’sZcoordinatevalueof realobjectswiththatof virtualobjectsin a smaller regionto achievereal-time performance.Morespeci?cally,we can judgeandhandlethe mutual occlusionwithouthumaninteractivityin realtime,andexperimentalresultsproveits effectiveness.2015ElsevierB.V.Allrightsreserved.1. IntroductionAugmentedreality(AR)systemsaim at addingvirtualobjects to real scene tomakethevirtualobjectsmergewiththeexisting worldseamlesslyinsuchamannerastoappearpartoftheviewed3D scene[1–5]. Applications includeentertainment, military, education,machinemanufacturing,andcomputer-aidedsurgery. Mostnowadayss