Doctor completes liver surgery with aid of iPad augmented reality app
A German doctor surgeon has leveraged the power of Apple's iPad and an accompanying augmented reality app to assist him in the completion of a surgery, marking one of the first times a procedure has been performed in such a manner.

Using an iPad, surgeons in Bremen, Germany, were able to create a virtual 3D pre-op plan for one patient's procedure, reports Reuters. [Warning: Some graphic images.] The surgeons took a picture of the patient's liver with the iPad's camera. The app then constructs an augmented reality overlay of the liver, showing the physicians where essential structures such as tumors and blood vessels lie.
The augmented reality overlay is built off of scans of the organ that were performed prior to the surgery. Having the actual layout of the organ visible before beginning allows surgeons to avoid potential complications and could result in more efficient operations.
The team behind the app sees it potentially having further applications beyond just the liver. It could also be used to help in excising tumors from the pancreas and other organs.
While this is one of the first times an iPad has played such a role in the actual process of a surgery, Apple's popular tablets and smartphones have become quite popular among doctors. Apple devices are the top choice among physicians, and those doctors are continually finding ways to integrate them into their daily practices.

Using an iPad, surgeons in Bremen, Germany, were able to create a virtual 3D pre-op plan for one patient's procedure, reports Reuters. [Warning: Some graphic images.] The surgeons took a picture of the patient's liver with the iPad's camera. The app then constructs an augmented reality overlay of the liver, showing the physicians where essential structures such as tumors and blood vessels lie.
The augmented reality overlay is built off of scans of the organ that were performed prior to the surgery. Having the actual layout of the organ visible before beginning allows surgeons to avoid potential complications and could result in more efficient operations.
The team behind the app sees it potentially having further applications beyond just the liver. It could also be used to help in excising tumors from the pancreas and other organs.
While this is one of the first times an iPad has played such a role in the actual process of a surgery, Apple's popular tablets and smartphones have become quite popular among doctors. Apple devices are the top choice among physicians, and those doctors are continually finding ways to integrate them into their daily practices.
Comments
When reliability of one's equipment is an issue of life-or-death, there is no "tablet" to be used in the operating room.. but an iPad.
This is incredible stuff. If Apple come come up with an iOS-driven heads-up display (like Google Glass), that would really take off in areas like this.
I have that app
Media consumption tablet.
Quote:
Originally Posted by AppleInsider
(...) reports (...)
LOL, the Dr. seems to have touched the camera app by mistake during surgery. (Pic #7)
How ironic that Steve Jobs may have given us the tools to possibly conquer that from which he perished.
Quote:
Originally Posted by DaveN
When I go to the doctor and see them using a large screen tv in the exam room I just want to scream at the chunkiness of it. I have several gripes about medical record keeping in the USA including: why do they make it nearly impossible for the patient to have copies of their own records - we paid for the test, give us the results; why aren't records portable - keeping the records to themselves (again which we paid for) results in needless repeated tests or missed diagnosis; why do we have to wait for the doctor no matter what time the appointment is - if we make them wait, we are charged.
The problem is the system the hospital uses, like EpicCare, that is difficult for the hospital personnel to use, especially with Macs and iPads. Yes, they supposedly have the ability to work with iPads but through a Citrix-type interface, which doesn't give them everything they can do on a stupid PC. We should be able to have instant access to our records but as long as the hospital system providers bas everything on an insane system built around Windows, we won't. For those who think I hate Windows, listen to my adult child complain about their documentation system crashing all the time and having to wait for a PC tech to fix them.
This is a great use of AR! I just finished a video about Audi's new augmented reality based owner's manual. This is even cooler than AR-based oil changes!
Sorry, no offense to anyone, but, I wouldn't trust a doctor with an Android tablet!
Quote:
Originally Posted by DaveN
When I go to the doctor and see them using a large screen tv in the exam room I just want to scream at the chunkiness of it. I have several gripes about medical record keeping in the USA including: why do they make it nearly impossible for the patient to have copies of their own records - we paid for the test, give us the results; why aren't records portable - keeping the records to themselves (again which we paid for) results in needless repeated tests or missed diagnosis; why do we have to wait for the doctor no matter what time the appointment is - if we make them wait, we are charged.
Dave, did you read the March 4th Time Magazine Cover story? The longest story (36 pages) and the only edition to ever sell out. It's called "Bitter Pill!"
Everyone over the age of 30 should read it.
Best!
Here's a link to the article:
http://livingwithmcl.com/BitterPill.pdf
Depending on the state, you may have the right to see and copy your medical records. Check with your doctor or a lawyer to see if that is the case where you live.
I wonder why they would not use traditional CT and MRI for their work.
If I understand correctly... They took those scans previous to the operation and then during the operation when they cut them open they used AR to tie into those scans to better see whats going on.
Quote:
Originally Posted by Doctor David
If I understand correctly... They took those scans previous to the operation and then during the operation when they cut them open they used AR to tie into those scans to better see whats going on.
This is very likely correct. My wife had deep sinus surgery in which her head was imaged with CT first to map her sinuses using a tight-fitting headpiece that allowed the coordinates to be reproduced later. The doctor used an AR computer screen during the surgery next to the surgical table. It was undoubtedly more expensive than an iPad, but somehow cheaper non-bespoke medical technology rarely translates into lower medical bills.
The person who mentioned a stand above: crikey, I hope this picture was just posed to show off the tablet. You'd think an assistant could at least hold the thing. Having a tablet you don't want to drop wrapped in slippery plastic in one hand and a knife inside the patient in the other seems daft.
What that doctor really needs now is a decent stand for that iPad. It's gotta be tough doing the entire surgery with one hand like that! :P
snip...
"No dammit, the one on MY left, not yours!"