A. Wachter, J. Kost, and W. Nahm. MATLAB Simulation Environment for Estimating the Minimal Number and Positions of Cameras for 3D Surface Reconstruction in a Fully-Digital Surgical Microscope. In Current Directions in Biomedical Engineering, vol. 4(1) , pp. 517-520, 2018
Abstract:
Contemporary surgical microscope systems have excellent optical properties but some desirable features re- main unavailable. The number of co-observers is currently re- stricted, by spatial and optical limitations, to only two. More- over, ergonomics poses are a problem: Current microscope systems impede free movement and sometimes demand that surgeons take uncomfortable postures over long periods of time. To rectify these issues, some companies developed surgi- cal microscope systems based on a streaming approach. These systems remove some of the limitations. Multi-observer po- sitions, for example, are not independent from each other, for example. In order to overcome the aforementioned limitations, we are currently developing an approach for the next genera- tion of surgical microscope: Namely the fully digital surgi- cal microscope, where the current observation system is re- placed with a camera array, allowing real-time 3D reconstruc- tion of surgical scenes and, consequently, the rendering of al- most unlimited views for multiple observers. These digital mi- croscopes could make the perspective through the microscope unnecessary allowing the surgeon to move freely and work in more comfortable postures. The requirements on the camera array in such a system have to be determined. For this purpose, we propose of estimation the minimal number of cameras and their positions needed for the 3D reconstruction of microsurgi- cal scenes. The method of estimation is based on the require- ments for the 3D reconstruction. Within the MATLAB simu- lation environment, we have developed a 3D model of a mi- crosurgical scene, used for the determination of the number of required cameras. In a next step a small, compact and cost- ef cient s ystem w ith f ew o pto-mechanical c omponents could be manufactured.
Student Theses (1)
J. Kost. Estimation of the Minimal Number and Positions of Cameras for 3D Reconstruction Based on a 3D Reference Object Regarding the Anatomical Structure of Typical Microsurgery Scenes. Institute of Biomedical Engineering, Karlsruhe Institute of Technology (KIT). Bachelorarbeit. 2018
Abstract:
Despite their maturity, contemporary surgical microscope systems still leave aspects to be desired. The number of co-observers is currently restricted, by spatial and optical limitations, to only two. The co-observers also suffer from decreased stereoscopic depth perception. Moreover, ergonomics pose a problem, with current microscope systems impeding mobility and sometimes demanding that surgeons take uncomfortable postures over lengthy periods of time. The next evolutionary step in surgical microscope design should hence improve surgical microscope ergonomics and remove the limitations on co-viewing. A promising approach to this is the fully digital surgical microscope, where the current observation systems are replaced with a camera array; allowing real-time 3D reconstruction of surgical scenes and, consequently, the rendering of almost unlimited views for different observers. Digital microscopes could thus also relieve the surgeon of the necessity to look through the microscope, hence allowing him to move more freely and take more comfortable postures. The requirements on the camera array in such a system have yet to be determined. To this effort, we have have contributed an estimation of the minimal number and positions of cameras needed for the 3D reconstruction of microsurgical sites, based on the simulated reconstruction of reference models. With the simulation program we developed for this purpose, the requirements for a camera array in a compact and cost effective fully digital surgical microscope could be estimated.
