Real-time three-dimensional soft tissue reconstruction for laparoscopic surgery

Jȩdrzej Kowalczuk, Avishai Meyer, Jay Carlson, Eric T. Psota, Shelby Buettner, Lance C. Pérez, Shane M. Farritor, Dmitry Oleynikov

Research output: Contribution to journalArticlepeer-review

16 Scopus citations


Background: Accurate real-time 3D models of the operating field have the potential to enable augmented reality for endoscopic surgery. A new system is proposed to create real-time 3D models of the operating field that uses a custom miniaturized stereoscopic video camera attached to a laparoscope and an image-based reconstruction algorithm implemented on a graphics processing unit (GPU). Methods: The proposed system was evaluated in a porcine model that approximates the viewing conditions of in vivo surgery. To assess the quality of the models, a synthetic view of the operating field was produced by overlaying a color image on the reconstructed 3D model, and an image rendered from the 3D model was compared with a 2D image captured from the same view. Results: Experiments conducted with an object of known geometry demonstrate that the system produces 3D models accurate to within 1.5 mm. Conclusions: The ability to produce accurate real-time 3D models of the operating field is a significant advancement toward augmented reality in minimally invasive surgery. An imaging system with this capability will potentially transform surgery by helping novice and expert surgeons alike to delineate variance in internal anatomy accurately.

Original languageEnglish (US)
Pages (from-to)3413-3417
Number of pages5
JournalSurgical endoscopy
Issue number12
StatePublished - Dec 2012


  • Augmented reality
  • Computer-integrated surgery
  • Image-based reconstruction
  • Minimally invasive surgery
  • Real-time stereo matching
  • Robotic surgery

ASJC Scopus subject areas

  • Surgery


Dive into the research topics of 'Real-time three-dimensional soft tissue reconstruction for laparoscopic surgery'. Together they form a unique fingerprint.

Cite this