Onyx, an AI-based surgeon assistance system
Today, non-invasive imaging systems have become an integral part of medicine and surgery in Iran and the world. In this regard, one of the needs of surgeons is the possibility of using medical images of the patient in the operating room and during surgery. With the advent of new medical imaging technologies, software is needed to display these images and a sterile and secure interface for the surgeon to control these images in the operating room.
Today, non-invasive imaging systems have become an integral part of medicine and surgery in Iran and the world. In this regard, one of the needs of surgeons is the possibility of using medical images of the patient in the operating room and during surgery. With the advent of new medical imaging technologies, software is needed to display these images and a sterile and secure interface for the surgeon to control these images in the operating room.
Methods of using images during surgery in the operating room are divided into two categories, each of which has its problems:
Methods of using images during surgery in the operating room are divided into two categories, each of which has its problems:
1. Using a viewfinder to view the captured stereotypes; In this method, it is not possible to enlarge or change the contrast, the brightness of the images, and the possibility of using three-dimensional image display systems for better understanding by the surgeon during surgery.
1. Using a viewfinder to view the captured stereotypes; In this method, it is not possible to enlarge or change the contrast, the brightness of the images, and the possibility of using three-dimensional image display systems for better understanding by the surgeon during surgery.
2. Using a computer system to view patient images; Due to the possibility of contamination when the surgeon comes in contact with computer controls such as mouse and keyboard in the operating room and the difficulty of sterilizing these devices and considering clinical protocols (the surgeon should not be sterile during surgery It is necessary for one of the assistants, not the surgeon himself, to take control of such tools like the mouse and the keyboard. This means of communication is time-consuming, error-prone, and inefficient due to the use of non-surgeon staffing and the loss of the surgeon focus due to human interaction.
2. Using a computer system to view patient images; Due to the possibility of contamination when the surgeon comes in contact with computer controls such as mouse and keyboard in the operating room and the difficulty of sterilizing these devices and considering clinical protocols (the surgeon should not be sterile during surgery It is necessary for one of the assistants, not the surgeon himself, to take control of such tools like the mouse and the keyboard. This means of communication is time-consuming, error-prone, and inefficient due to the use of non-surgeon staffing and the loss of the surgeon focus due to human interaction.
In general, the two main problems the existing methods face for viewing medical images during surgery in the operating room are the lack of comprehensive software for simultaneous three-dimensional display of medical images (fMRI, MRI, DTI, and tumor).
In general, the two main problems the existing methods face for viewing medical images during surgery in the operating room are the lack of comprehensive software for simultaneous three-dimensional display of medical images (fMRI, MRI, DTI, and tumor).
It can cover all of the surgeon perceptual needs; the other is the lack of an effective, sterile, and secure interface for the surgeon to display and control these images. Recognition of motion can be the beginning of a way for human-machine interaction.
It can cover all of the surgeon perceptual needs; the other is the lack of an effective, sterile, and secure interface for the surgeon to display and control these images. Recognition of motion can be the beginning of a way for human-machine interaction.
Given the importance of this issue, human motion analysis has a wide range of research in machine vision, which aims to automate actions such as segmentation, recording, recognition, and recognition of human movements in real time. This research is used in various fields, including creating public monitoring tools in environments such as stores and airports, home care for older adults and children, medicine and virtual reality, etc. With many advances in computer-aided surgery, hospitals tend to use equipment and user-centered interfaces in the operating room. This process main challenge is enabling the physician and surgeon to interact visually, effectively, safely, and without causing any infection when using these devices.
Given the importance of this issue, human motion analysis has a wide range of research in machine vision, which aims to automate actions such as segmentation, recording, recognition, and recognition of human movements in real time. This research is used in various fields, including creating public monitoring tools in environments such as stores and airports, home care for older adults and children, medicine and virtual reality, etc. With many advances in computer-aided surgery, hospitals tend to use equipment and user-centered interfaces in the operating room. This process main challenge is enabling the physician and surgeon to interact visually, effectively, safely, and without causing any infection when using these devices.
There are two main problems with viewing medical images during surgery in the operating room. One is the lack of comprehensive software to display two- and three-dimensional medical images simultaneously (fMRI, MRI, DTI, and tumor) that can cover the surgeon perceptual needs, and the second is the lack of an effective, sterile, and secure interface for the surgeon to display and control these images. Of course, in the past, the stethoscope was used to view stereotypes; In this method, it is not possible to enlarge or change the contrast brightness of the images, and also, the possibility of using three-dimensional image display systems for better understanding by the surgeon during surgery. The purpose of producing this product is to design an intelligent system that, by removing the obstacles and problems expressed, can, without the intervention of the interface and in different lighting conditions of the operating room environment, in a completely sterile manner, the surgeon interacts with the comprehensive medical image management system to display Enable 2D or 3D images. This system recognizes the surgeon's movements and speech and performs various operations according to the received commands. Another goal is to display fMRI and DTI images simultaneously on MRI images. These images can be accessed and used simultaneously in 2D and 3D in the Sagittal, Coronal, and Transverse plane positions.
There are two main problems with viewing medical images during surgery in the operating room. One is the lack of comprehensive software to display two- and three-dimensional medical images simultaneously (fMRI, MRI, DTI, and tumor) that can cover the surgeon perceptual needs, and the second is the lack of an effective, sterile, and secure interface for the surgeon to display and control these images. Of course, in the past, the stethoscope was used to view stereotypes; In this method, it is not possible to enlarge or change the contrast brightness of the images, and also, the possibility of using three-dimensional image display systems for better understanding by the surgeon during surgery. The purpose of producing this product is to design an intelligent system that, by removing the obstacles and problems expressed, can, without the intervention of the interface and in different lighting conditions of the operating room environment, in a completely sterile manner, the surgeon interacts with the comprehensive medical image management system to display Enable 2D or 3D images. This system recognizes the surgeon's movements and speech and performs various operations according to the received commands. Another goal is to display fMRI and DTI images simultaneously on MRI images. These images can be accessed and used simultaneously in 2D and 3D in the Sagittal, Coronal, and Transverse plane positions.