北京生物医学工程

基于HoloLens的增强现实手术导航系统研究

Research on augmented reality surgery navigation system based on HoloLens

作者：于德旺王殊轶姜陶然陈俊丁竹谷雯雪

单位：上海理工大学医疗器械与食品学院（上海 200093）上海交通大学医学院附属第九人民医院整复外科（上海 200011）

关键词： HoloLens; 手术导航系统; 增强现实; 误差; 影响因素; 人因工程

分类号：R318.04

出版年·卷·期（页码）：2020·39·3（244-250）

摘要：

目的开发基于HoloLens的AR手术导航系统，分析此系统误差影响因素，定量探究各个因素对误差的影响大小，为此类导航系统误差的降低明确侧重点。方法以Unity3D为开发平台开发的手术导航系统实现了3种三维注册方法：基于识别图三维注册、三点注册和手动注册。从人因工程的角度出发结合临床医生手术操作行为、HoloLens性能和临床使用环境三方面分析误差的可能影响因素，即三维注册方法、头部转动、周围人数和观测角度。将这些因素设置为3个水平，设计正交实验验证并测量不同因素不同水平下每次实验的误差大小，通过方差分析确定影像程度是否显著。结果导航系统3种注册方法平均误差值为4.16 mm。4个因素产生的误差量分别为3.88mm、0.91mm、4.77mm和3.38mm。结论系统能够实现导航功能但存在一定误差，误差影响程度由大到小为头部转动、三维注册方法、周围人数和观测角度，其中头部转动和三维注册方法具有显著性影响，这为基于HoloLens的AR手术导航系统误差的降低和交互方式的设计提供新的思路。

Objective To develop an augmented reality (AR) surgical navigation system based on HoloLens, to analyze influence factors for its system error and to quantitatively investigate the effects of these factors on error, thereby pinpointing the focus to reduce error for this type of navigation system. Methods The surgical navigation system was developed on the platform of Unity3D and three kinds of three-dimensional registration methods were realized, i.e., three-dimensional registration based on identification map, three-point registration and manual registration. From the perspective of human factors engineering, potential factors influencing the error were analyzed by combining the three aspects of surgical operations by clinicians, HoloLens performance and clinical settings. Specifically, these influence factors included the three-dimensional registration method, the rotation of head, the number of surrounding people and the observation angle, which were set as three levels. An orthogonal experiment was designed to validate and measure the error for each experiment with a differed factor and level, thereby determining whether the influence was significant through variance analysis. Results The average error for the three registration methods of the navigation system was 4.16 mm while the error for the four factors was 3.88mm, 0.91mm, 4.77mm and 3.38mm, respectively. Conclusions The system can realize navigation functions though certain errors existed. Also, the sequence of influence factors is the rotation of head, the three-dimensional registration method, the number of surrounding people and the observation angle in descending order, among which the rotation of head and the three-dimensional registration method has a significant impact on error. These findings can provide new approaches for error reduction in AR surgical navigation systems based on HoloLens and design of the interactive mode.

参考文献：

[1] 沈轶. 高精度手术导航的研究与应用[D]. 上海：上海交通大学,2012

Shen Y. High precision surgical navigation and its application[D]. Shanghai：Shanghai Jiao Tong University,2012

[2] 钮艳华, 汪元美, 段会龙. 基于增强现实的外科手术导航技术[J]. 中国医疗器械杂志, 2004, 28(1):50-54.

Niu YH, Wang YM, Duan HL. A survey on augmented- reality- based IGS system[J]. Chinese Journal of Medical Instrumentation, 2004, 28(1):50-54.

[3] 范真诚, 张欣然, 廖洪恩. 精准空间透视融合手术导航[J]. 中国医疗设备, 2016, 31(3):26-32

Fan ZC, Zhang XR, Liao HN. High-precision three-dimensional space see-through surgical navigation [J]. China Medical Devices, 2016, 31 (3):26-32.

[4] 王涌天, 陈靖, 程德文著. 增强现实技术导论[M].北京:国防工业出版社,2015.

Wang YT, Chen J, Cheng DW. Augmented reality: an emerging technologies guide to AR[M]. Beijing: National Defense Industry Press.,2015.

[5] Rodrigues DG, Jain A, Rick SR, et.al. Exploring mixed reality in specialized surgical environments[C]//Proceedings of the ACMCHI conference on human factors in computing systems.New York:CHI,2017

[6] Cui N, Kharel P, Gruev V, Augmented reality with Microsoft HoloLens holograms for near infrared fluorescence based image guided surgery[C]// Molecular-Guided Surgery: Molecules, Devices, and Applications III .San Francisco, California: SPIE, 2017.

[7] Qian L, Barthel A,Johnson A,et,al. Comparison of optical see-through head-mounted displays for surgical interventions with object-anchored 2D-display[J].International Journal of Computer Assisted Radiology & Surgery , 2017 , 12 (6) :901-910

[8] Philp P , Matthew I, Graham L , et al. Through the HoloLensTM:looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels[J]. European Radiology Experimental, 2018, 2(2):1-7

[9] Fatih I,Marion S,Clemens D,et al. Clinical feasibility of a wearable mixed reality device in neurosurgery[J]. World Neurosurgery,2018,118:1-6

[10] Reid V, Adam R, Elvis C,et al.Hologram stability evaluation for Microsoft? HoloLens?[J].MEDICAL IMAGING 2017: Image Perception, Observer Performance, and Technology Assessment,2017, 1013614(3):1-6

[11] ANSI/AAMI HE75:2009(ANSI/AAMI HE 75:2009).Human factors engineering-Design of medical devices[S]. Kensington: American Nuclear Society Specification,2009,

[12] Jiang T, Zhu M, Zan T, et al. A novel augmented reality-based navigation system in perforator flap transplantation - a feasibility study[J]. Annals of Plastic Surgery, 2017, 79:192-196.

[13] Wu ML , Chien JC ,Wu CT, et al.An augmented reality system using improved-iterative closest point algorithm for on-patient medical image visualization[J]. Sensors, 2018, 18(8), 2505.

服务与反馈：

【文章下载】【加入收藏】

提示：您还未登录，请登录！点此登录