ABSTRACT:As an alternative to building custom electronic devices that connect to mobile phones viaBluetooth or USB, we present a new approach using Augmented Reality (AR) and machinevision to digitally recognize a biomedical device and capture readings automatically.
AR tocreate accurate 3-dimensional reconstructions of tumors and human organs. The complex imagereconstructing technology basically empowers surgeons with X-ray views – without anyradiation exposure, in real time. The AR graphic overlay is used to provide feedback to patientsand doctors by displaying personalized reference values.
It is integrate with EMR’s, clinicalinformation feeds and medical imaging systems to support clinical decision making through acombined AR view. It uses everyday technology – any pair of computers, tablets or smartphoneswith cameras can be used to connect surgeons & students, in real time, anywhere in the world.AR can be used to capture medical device data on a mobile phone and help automate the datarecording tasks performed by health workers in developing countries.INTRODUCTION:THE TERM “augmented reality” (AR) refers to the overlay of computer-generated graphics overa real-world scene. A special requirement of AR is the fact that the structure generated bycomputer graphics has to be linked to the viewed scenery, i.
e., the perceived position of thescenery and the computer-generated object have to match. Besides using a display system thatallows for merging real and virtual views, a second requirement is the accurate tracking of theposition of the viewer relative to the viewed scene . A head-mounted display (HMD) can be usedto generate a virtual view for guiding the service engineer through the plane’s blueprints duringinspection.
The joint display of virtual and real scenery in the HMD which is difficult to achievein a simple HMD design where the only optical element in the viewer’s optical path is a simplebeamsplitter. The acceptance of the HMD by physicians. Clinical experience with CAS clearlyshows that an additional cumbersome device such as a bulky HMD will not find a place in theoperating room.II.
MATERIALS AND METHODS:The Varioscope is a head-mounted, lightweight operating binocular developed and produced byLife Optics, Vienna, Austria (Available at http://www.lifeoptics.com). It features autofocus withautomatic parallax correction (operating range: approximately 300–600 mm) and zoom (magnification range 3.6–7.2 ).
Parallax correction is necessary since the short operating rangewould otherwise inevitably lead to double images due to the parallax between left and right eye;in the current version of the Varioscope, merging the optical axes of the left and right tube isachieved by moving the tubes in- and outwards. The overall weight of the Varioscope is about300 grams. The physical dimensions of the base instrument are 73x120x64 mm (W/L/H).This commercially available device was modified for AR visualization in close cooperation withthe manufacturer and Docter Optics, Vienna, Austria; we refer to the prototype as the VarioscopeAR.
Since the optical properties of the Varioscope are the same as of an astronomical telescope,the insertion of image rectification prisms into the optical path is necessary; this offers aconvenient way to add the beamsplitters for merging the computer-images and the optical viewas captured by the lens of the Varioscope.
