TBA
IISA2017 | Augmented Visualization in Medicine and Surgery
8301
singular,single,single-post,postid-8301,single-format-standard,ajax_fade,page_not_loaded,,qode-child-theme-ver-1.0.0,qode-theme-ver-3.1,wpb-js-composer js-comp-ver-4.11.1,vc_responsive
 

Blog

Augmented Visualization in Medicine and Surgery

  |   Tutorials   |   No comment
Lucio De Paolis 3

Lucio Tommaso De Paolis

Director of the Augmented and Virtual Reality Laboratory (AVR Lab),
Department of Engineering for Innovation, University of Salento, Italy

Background and Goals

Augmented Visualization in Medicine and Surgery

Lucio Tommaso De Paolis

Director of the Augmented and Virtual Reality Laboratory (AVR Lab),
Department of Engineering for Innovation, University of Salento, Italy

Augmented Reality (AR) technology refers to a perception of a physical real environment whose elements are merged with virtual computer-generated objects in order to create a mixed reality; the user is under the impression that the virtual and real objects coexist in the same space.
The merging of virtual and real objects in an AR application has to run in real time. Virtual objects have to be aligned (registered) with real world structures. Both of these requirements guarantee that the dynamics of real world environments remain unchanged after virtual data have been added.

AR concepts are applicable to a wide range of applications moving from pure academic research into industrial and potential consumer areas. In particular, these technological innovations have provided medicine and surgery with new tools by translating the information contained in medical images into a 3D virtual model of the patient who is a realistic replica of living patient with actual pathologies.

New applications of AR technology provide systems that help surgeons in the intra-operative phase by means of the overlapping of virtual organs on the real patient; this allows the surgeon to have a sort of “X-ray vision” of the patient’s internal anatomy.
The use of augmented visualization in surgery has the potential to bring the advantages of the open-surgery visualization also in minimally invasive surgery, produces a better spatial perception and a reduction in the duration of the surgical procedure permitting to perform the tasks in ways that are both faster and safer.

The aim of this tutorial is to present the new applications of the Augmented Reality technology in medicine and surgery and discuss on the clinical benefits and limitations.

Short Bio

Lucio Tommaso De Paolis

Assistant Professor in Information Processing Systems at the Department of Engineering for
Innovation -University of Salento, Italy
Director of the Augmented and Virtual Reality Laboratory (AVR Lab)
Responsible of the “Advanced Techniques of Virtual Reality for Medicine” research group of the
DReAM at the Hospital of Lecce, Italy

phone: +39 0832 297284 fax: +39 0832 297284
e-mail: lucio.depaolis@unisalento.it
web: www.avr.unisalento.it

LUCIO TOMMASO DE PAOLIS had a Degree in Electronic Engineering from the University of Pisa (Italy) and is an Assistant Professor of Information Processing Systems at the Department of Innovation Engineering of the University of Salento (Italy). His research interest concerns the study and the design of applications of Virtual and Augmented Reality and Human-Computer Interaction in medicine and surgery, cultural heritage and education.

De Paolis is the Director of the Augmented and Virtual Reality Laboratory (AVR Lab –www.avr.unisalento.it) at the Department of Engineering for Innovation of the University of Salento and the responsible of the “Advanced Virtual Reality for Medicine” research group at the Laboratory ofInterdisciplinary Research Applied to Medicine (DReAM) of the Hospital of Lecce, Italy.

He is the vice-president of MIMOS (Italian Movement Modelling and Simulation) and the founder of AVR Med srl (www.avrmed.com), a spin-off company of the University of Salento.

He teaches “Applications of Virtual and Augmented Reality” at the Master Degree in “ComputerEngineering” of the University of Salento and at EUROMACHS (European Heritage, Digital Media and the Information Society), an international course within the degree class “Computer Methodologies for the
Humanities”.

He has been a Visiting Professor in 2014 at the Tallinn University of Technology, in 2012 at the Vytautas Magnus University of Kaunas (Lithuania) and in 2011 at the University of Tallinn (Estonia).

He has been visiting researcher in 2007 and 2010 at the Centro de Ciencias Aplicadas y Desarrollo Tecnologico (CCADET) of the Universidad Nacional Autonoma de Mexico (UNAM), Mexico City (Messico) and in 2007 and 2009 at the Computer Graphics Laboratory of the Sabanci University of Istanbul
(Turkey).

De Paolis has been the coordinator of some Italian and international projects focused on the application of virtual and augmented reality in medicine, cultural heritage and education.

He is the organizer of the International Conference on Augmented Reality, Virtual Reality and Computer Graphics (SALENTO AVR).

Organizer of international conferences:

4th International Conference on Augmented Reality, Virtual Reality and Computer Graphics (SALENTO AVR
2017)

Ugento, Italy – June 12-15, 2017
http://www.salentoavr.it

3rd International Conference on Augmented Reality, Virtual Reality and Computer Graphics (SALENTO AVR
2016)

Otranto, Italy – June 15-18, 2016
http://www.salentoavr.it

2nd International Conference on Augmented and Virtual Reality (SALENTO AVR 2015)

Lecce, Italy – August 31 -September 3, 2015
http://www.salentoavr.it

1st International Conference on Augmented and Virtual (SALENTO AVR 2014)

Lecce, Italy -September 17-20, 2014
http://www.salentoavr.it

Keynote speaker at national and international conferences:

5th Intern. Conf. on Advancements of Medicine and Health Care through Technology (MediTech2016)

October 12-15, 2016 -Cluj-Napoca, Romania
Title: Virtual Reality and Augmented Visualization in Medicine and Surgery
http://www.meditech.utcluj.ro
Innovazione Digitale in Sanita

April 20, 2016 -San Giovanni Rotondo, Italy
Title: Visualizzazione Aumentata e Simulazione in Medicina e Chirurgia

HealthIT 2016

March 22, 2016 – Milano, Italy
Title: La Realta Aumentata a Supporto della Chirurgia Mini-Invasiva: il trattamento dei tumori epatici tramite ablazione
con radiofrequenza

First Baltic Sea Symposium on Simulation and Virtual Reality for Education in Health Care and Patient
Safety

February 04-06, 2016 – Riga, Latvia
Title: Augmented Visualization and Virtual Simulation in Surgical Education

3rd International Conference on BIOMEDICINE and HEALTH ENGINEERING (BIHE ’14)

January 10-12, 2014 -Tenerife, Spain
Title: Virtual Reality and Augmented Visualization in Medicine and Surgery

The Eighth International Conference on Systems (ICONS 2013)

January 27 -February 1, 2013 -Seville, Spain
Title: Virtual and Augmented Reality Applications

2011 IEEE International Conference on Information and Education Technology (ICIET 2011)

Guiyang, China -January 26–28, 2011
Title: Virtual Reality in Medicine and Surgery

Tutorial speaker at international conferences:

6th International Conference on Information, Intelligence, Systems and Applications (IISA 2015)

Corfu, Greece -June 6-8, 2015
Title of tutorial: New Trends in Virtual Reality and Augmented Visualization
http://iisa2015.unipi.gr

1st International Conference on Virtual and Augmented Reality (SALENTO AVR 2014)

Lecce, Italy -September 17-20, 2014
http://www.salentoavr.it

International Symposium on INnovations in Intelligent SysTems and Applications (INISTA 2014)

Alberobello, Italy -June 23-25, 2014
Title of tutorial: New Applications of Virtual and Augmented Reality
http://www.inista.org

Middle East Conference on Biomedical Engineering (MECBME 2014)

Doha, Qatar -17–20 February, 2014
Title of tutorial: New Applications of Virtual and Augmented Reality in Medicine and Surgery
http://mecbme.net/tutorials

6TH BALKAN CONFERENCE IN INFORMATICS (BCI 2013)

Thessaloniki, Greece -September 19–21, 2013
Title of tutorial: Virtual and Augmented Reality
http://bci2013.bci-conferences.org/tutorials.php

EURO-MEDITERRANEAN MEDICAL INFORMATICS and TELEMEDICINE (EMMIT 2012)

La Valletta, Malta -December 17–19, 2012
Title of tutorial: Virtual and Augmented Reality in Medicine and Surgery

Eighth International Conference on Innovations in Information Technology (Innovations’12)

Al-Ain, Abu-Dhabi, United Arab Emirates -March 18–20, 2012
http://www.it-innovations.ae/iit2012/index.html
Title of tutorial: Virtual and Augmented Reality Applications

EURO-MEDITERRANEAN MEDICAL INFORMATICS and TELEMEDICINE (EMMIT 2010)

Split, Croatia -September 26–28, 2010
Title of tutorial: Virtual Reality in Medicine and Surgery

Organiser of special sessions and workshops at international conferences:

The 2015 International Conference on Computational Science and its Applications (ICCSA 2015)

Banff, Alberta, Canada -June 22-25, 2015
Workshop: Virtual Reality and Applications

http://www.iccsa.org/workshops

The 2014 International Conference on Computational Science and its Applications (ICCSA 2014)

Guimaraes, Portugal -June 30 -July 3, 2014
Workshop: Virtual Reality and Applications
http://www.iccsa.org/sessions
The 2013 International Conference on Computational Science and its Applications (ICCSA 2013)

Ho Chi Minh City, Vietnam -June 24-27, 2013
Special Session: Virtual Reality and Applications
http://www.iccsa.org/sessions

The 2011 International Conference on Computational Science and its Applications (ICCSA 2011)

Santander, Spain -June 20-23, 2011
Special Session: Virtual Reality in Medicine and Surgery
http://www.avr.unisalento.it/wp-content/ICCSA_2011/spec_vers_ICSSA_2011/ICCSA_2011.html

The 10th IEEE Intern. Conference on Information Technology and Applications in Biomedicine (ITAB 2010)

Corfu, Greece -November 2-5, 2010
Special session: Virtual Reality in Medicine and Surgery
http://medlab.cs.uoi.gr/itab2010/index.php?option=com_content&view=article&id=220&Itemid=405

Latest Publications

Journal


L. T. De Paolis, “Advanced Navigation and Augmented Visualization in Minimally Invasive Surgery”, Computers, 1,
197-203, 2016;

S. Invitto, C. Faggiano, S. Sammarco, V. De Luca, L. T. De Paolis, “Haptic, Virtual Interaction and Motor Imagery:
Entertainment Tools and Psychophysiological Testing”, Sensors 2016, 16(3), 394; doi:10.3390/s16030394;

A. Cirulis, L. T. De Paolis, M. Tutberidze, “Virtualization of Digitalized Cultural Heritage and Use Case Scenario
Modeling for Sustainability Promotion of National Identity”, Procedia Computer Science, Vol. 77, 2015, pp 199–
206, ISSN: 1877-0509, doi:10.1016/j.procs.2015.12.384;

Zocco A., De Paolis L.T., “Augmented Command and Control Table to Support Network-Centric Operations”,
Defence Science Journal, Vol. 65, No. 1, January 2015, pp.39-45;

Livatino S., De Paolis L., D’Agostino M., Zocco A., Agrimi A., De Santis A., Bruno L.V., Lapresa M., “Stereoscopic
Visualization and 3D Technologies in Medical Endoscopic Teleoperation” IEEE Transactions on Industrial Electronics
No. 13-TIE-2678.R1, 2014;

Ricciardi F., De Paolis L.T., “A Comprehensive Review of Serious Games in Health Professions”, International
Journal of Computer Games Technology, Volume 2014 (2014), Article ID 787968, pp. 1-11, Hindawi Publishing
Corporation, http://dx.doi.org/10.1155/2014/787968;

De Paolis L.T., Aloisio G., ” An Augmented Reality Platform for the Enhancement of Surgical Decisions in Pediatric
Laparoscopy “, International Journal On Advances in Software, Vol. 4, No. 3&4, 2011, ISSN: 1942-2628;
Chapter Book and Book Editor


De Paolis L.T., Mongelli A. (Eds.), “Augmented and Virtual Reality, and Computer Graphics”, Third International
Conference (AVR 2016), Lecce, Italy, June 15-18, 2016, Lecture Notes in Computer Science, Vol. 9768 and 9769,
Springer, ISBN 978-3-319-40621-3 and 978-3-319-40620-6, DOI: 10.1007/978-3-319-40621-3 and
10.1007/978-3-319-40651-0;

De Paolis L.T., Mongelli A. (Eds.), “Augmented and Virtual Reality”, Second International Conference Augmented
and Virtual Reality (AVR 2015), Lecce (Italy), August 31 -September 3, 2015, Lecture Notes in Computer Science,
Vol. 9254, Springer, ISBN 978-3-319-22888-4, DOI: 10.1007/978-3-319-22888-4;

De Paolis Lucio Tommaso, Mongelli Antonio (Eds.), “Augmented and Virtual Reality”, First International
Conference Augmented and Virtual Reality (AVR 2014), Lecce (Italy), September 17-20, 2014, Lecture Notes in
Computer Science, Vol. 8853, Springer;

Tinelli A., Malvasi A., Gustapane S., De Nunzio G., Bochicchio M., De Paolis L., Aloisio G., “Robotic Assisted
Surgery in Endoscopy: The Problem of Learning Curve”, In: Laparoscopy: New Developments, Procedures and
Risks, Chapter 2, Editor: Hana Terzic, Nova Science Publishers, 2011, ISBN 978-1-61470-747-9;

Tinelli A., Malvasi A., Gustapane S., De Nunzio G., Bochicchio M., De Paolis L., Aloisio G., Tsin D.A. “The Utilization
of Novel Technology in Risk Reducing Laparoscopic Gynecological Complications”, In: Laparoscopy: New
Developments, Procedures and Risks, Chapter 3, Editor: Hana Terzic, Nova Science Publishers, 2011, ISBN 978-161470-
747-9;

Tinelli A., De Paolis L., Aloisio G., De Nunzio G., Bochicchio M., Malvasi A. “Laparoscopic Trainers and Surgical
Virtual Simulators in Laparoscopic Learning Curve”, In: Laparoscopy: New Developments, Procedures and Risks,
Chapter 6, Editor: Hana Terzic, Nova Science Publishers, 2011, ISBN 978-1-61470-747-9;

De Paolis L.T., Aloisio G., “Augmented Reality in Minimally Invasive Surgery”, Advances in Biomedical Sensing,
Measurements, Instrumentation and Systems, Lecture Notes in Electrical Engineering, Vol. 55, Mukhopadhyay S.C.
& Lay-Ekuakille A. (Eds.), Springer Publisher, December 2010, ISBN 978-3-642-05166-1.
Conference Proceedings


De Luca V., Meo A., Mongelli A., Vecchio P., De Paolis L.T., “Development of a Virtual Simulator for
Microanastomosis: New Opportunities and Challenges”, Third International Conference Augmented and Virtual
Reality, and Computer Graphics (AVR 2016), Lecce, Italy, June 15-18, 2016, Lecture Notes in Computer Science,
Vol. 9769, pp. 65-81, Springer, ISBN 978-3-319-40620-6;

De Paolis L.T., “A Touchless Gestural Platform for the Interaction with the Patients Data”, XIV Mediterranean
Conference on Medical and Biological Engineering and Computing 2016 (MEDICON 2016), March 31st–April 2nd
2016, Paphos, Cyprus, Springer International Publishing, ISBN 978-3-319-32701-3;

De Paolis L.T., Ricciardi F., “Augmented Reality in Radiofrequency Ablation of the Liver Tumors”, VipIMAGE 2015 ECCOMAS
Thematic Conferences on Computational Vision and Medical Image Processing, October 19-21, 2015,
Tenerife, Canary Island, Spain;

Ricciardi F., Copelli C., De Paolis L.T., “A Pre-Operative Planning Module for an Augmented Reality Application in
Maxillo-Facial Surgery”, Second International Conference Augmented and Virtual Reality (AVR 2015), Lecce (Italy),
August 31 -September 3, 2015, Lecture Notes in Computer Science, Vol. 9254, pp. 244-254, Springer, ISBN 9783-
319-22888-4, DOI: 10.1007/978-3-319-22888-4_18;

Ricciardi F., Pastorelli E., De Paolis L.T., Herrmann H., “Scalable Medical Viewer for Virtual Reality Environments”,

Second International Conference Augmented and Virtual Reality (AVR 2015), Lecce (Italy), August 31 September
3, 2015, Lecture Notes in Computer Science, Vol. 9254, pp. 233-243, Springer, ISBN: 978-3-31922887-
7, DOI: 10.1007/978-3-319-22888-4_17;


Vecchio P., Mele F., De Paolis L.T., Epicoco I., Mancini M., Aloisio G., “Cloud Computing and Augmented Realty for
Cultural Heritage”, Second International Conference Augmented and Virtual Reality (AVR 2015), Lecce (Italy),
August 31 -September 3, 2015, Lecture Notes in Computer Science, Vol. 9254, pp. 51-60, Springer, ISBN: 9783-
319-22887-7, DOI: 10.1007/978-3-319-22888-4_5;

Invitto S., Spada I., De Paolis L.T., “Augmented Reality, Embodied Cognition and Learning”, Second International
Conference Augmented and Virtual Reality (AVR 2015), Lecce (Italy), August 31 -September 3, 2015, Lecture
Notes in Computer Science, Vol. 9254, pp. 125-134, Springer, ISBN: 978-3-319-22887-7, DOI: 10.1007/978-3319-
22888-4_10;

Zocco A., Zocco M.D., Greco A., Livatino S., De Paolis L.T., “Touchless Interaction for Command and Control in
Military Operations”, Second International Conference Augmented and Virtual Reality (AVR 2015), Lecce (Italy),
August 31 -September 3, 2015, Lecture Notes in Computer Science, Vol. 9254, pp. 432-445, Springer, ISBN:
978-3-319-22887-7, DOI: 10.1007/978-3-319-22888-4_32;

Invitto S., Faggiano C., Sammarco S., De Luca V., De Paolis L.T., “Interactive Entertainment, Virtual Motion
Training and Brain Ergonomy”, 7th International Conference on Intelligent Technologies for Interactive
Entertainment (INTETAIN 2015), Torino, Italy, June 10–12, 2015;

Zocco A., De Paolis L.T., Greco L., Manes C.L., “An Augmented Environment for Command and Control Systems”,
10th International Conference on Computer Vision Theory and Applications (VISAPP 2015), Berlin (Germany),
March 11-14, 2015, pp. 209-214, ISBN: 978-989-758-091-8;

Zocco A., Livatino S., De Paolis L.T., “Stereoscopic-3D Vision to Improve Situational Awareness in Military
Operations”, 1st International Conference on Augmented and Virtual Reality (SALENTO AVR 2014), Lecce (Italy),
September 17-20, 2014;

De Paolis L.T., Ricciardi F., “Development of a Serious Game for Laparoscopic Suture Training”, 1st International
Conference on Augmented and Virtual Reality (SALENTO AVR 2014), Lecce (Italy), September 17-20, 2014;

Zocco A., Cannone D., De Paolis L. T., “Effects of Stereoscopy on a Human-Computer Interface for Network
Centric Operations”, 9th International Conference on Computer Vision Theory and Applications (VISAPP 2014),
Lisbon, Portugal, January 5-8, 2014;

De Paolis L.T., “Training on Laparoscopic Suturing by Means of a Serious Game”, Computational Science and Its
Applications – ICCSA 2013, Lecture Notes in Computer Science, vol. 7971, Springer-Verlag, 2013, pp. 622-631,
ISBN: 978-3-642-39645-8;

De Mauro A., Mazars J., Manco L., Mataj T., Hernandez A., Andres Cortes C., De Paolis L. T., “Intraoperative
Navigation System for Image Guided Surgery”, The Sixth Intern. Conference on Complex, Intelligent, and
Software Intensive Systems (CISIS-2012), July 4-6, 2012, Palermo, Italy, pp.486-490;

De Paolis L.T., “Serious Game for Laparoscopic Suturing Training”, The Sixth International Conference on Complex,
Intelligent, and Software Intensive Systems (CISIS-2012), July 4-6, 2012, Palermo, Italy;

De Mauro A., Mazars J., Manco L., Mataj T., Hernandez A., De Paolis L. T., “Intraoperative Navigation System for
Spine Surgery”, International Journal of Computer Assisted Radiology and Surgery – CARS 2012, Pisa, Italy,
2012;

De Paolis L.T., Aloisio G., “Augmented Reality in Minimally Invasive Surgery”, the 5th International Conference on
Advances in Computer-Human Interactions (ACHI 2012), January 30 -February 4, 2012, Valencia, Spain;

De Paolis L.T., Ricciardi F., Aloisio G., “Image-Guided Platform for the Radiofrequency Ablation of the Hepatic
Tumours” 14th International Conference on Medical Image Computing and Computer Assisted Intervention
(MICCAI 2011), September 18-22, 2011 Toronto, Canada;

De Paolis L.T., Aloisio G., “Advanced Interface for the Pre-Operative Planning in Pediatric Laparoscopy”, The 33rd
Intern. Conference on Information Technology Interfaces (ITI 2011), June 27-30, 2011, Cavtat, Dubrovnik,
Croatia;

De Paolis L.T., Ricciardi F., Dragoni A., Aloisio G., “An Augmented Reality Application for the Radio Frequency
Ablation of the Liver Tumors”, Computational Science and Its Applications -ICCSA 2011, Lecture Notes in
Computer Science, vol. 6785, Springer-Verlag, 2011, pp. 572-581, ISBN 978-3-642-21897-2;

De Paolis L.T., Aloisio G., “Advanced Interface for the Pre-Operative Planning and the Simulation of the Abdominal
Access in Pediatric Laparoscopy”, Computational Science and Its Applications -ICCSA 2011, Lecture Notes in
Computer Science, vol. 6785, Springer-Verlag, 2011, pp. 562-571, ISBN 978-3-642-21897-2;

De Paolis L.T., Pulimeno M., Aloisio G., “An Augmented Reality Application for the Enhancement of Surgical
Decisions”, The 4th International Conference on Advances in Computer-Human Interactions (ACHI 2011),
February 23-28, 2011, Gosier, Guadeloupe, France;

De Paolis L.T., Pulimeno M., Aloisio G., “Augmented Reality Application for the Trocars Insertion in Pediatric
Laparoscopy”, The 18th Medicine Meets Virtual Reality Conference, (MMVR 18), February 8-12, 2011, Newport
Beach, Los Angeles, CA, USA.