Computer-assisted surgery (CAS)

Computer-assisted surgery: Looking to the future

It can take 20 years for a new medical technology to mature through the various development stages. In a way, today’s “cutting-edge” technology reflects the ideas of yesterday. Part 3 gazes into the future of CAS. Will virtual reality rule the operating room? Will there still be a need for a human surgeon?

Computer-assisted surgery (CAS) systems, such as navigation and surgical robots, are currently available in select operating rooms (ORs) around the world. Part 1 introduced the terminology used in CAS and the different types of CAS technology being used. Part 2 looked at the evidence for and against the use of computer-assisted orthopedic surgery (CAOS) systems, concluding that more studies—particularly related to long-term clinical outcomes—are needed to determine the impact of these technologies beyond the documented improved surgical/implant placement accuracy, especially in terms of reconciling costs.

So what direction is technology taking the field of CAS in orthopedics?

Mark Roussot, MBChB, MPhil, MMed, FC Orth (SA), FRCS (Tr & Orth), University College London Hospital, Department of Trauma and Orthopaedics, UK

“The next frontier in hip and knee surgery may include advancements in joint preservation, soft tissue reconstruction, tissue engineering, and training,” says Mark Roussot, MBChB MPhil, MMed, FC Orth, of the University College London Hospital, Department of Trauma and Orthopaedics.

Georges Vles, MD, PhD, University Hospitals Leuven, Division of Orthopedic Surgery, Belgium

Georges Vles, MD, PhD, from Belgium’s University Hospitals Leuven, Division of Orthopedic Surgery thinks that, “For me as a hip surgeon, I think the next frontier would be robot-assisted CAM resection. For knees, the logical next steps would be osteotomies (getting a perfect angle and always leaving the hinge intact) and ACL [anterior cruciate ligament] reconstruction (bone tunnels and graft preloading and tensioning).”

Let us look at some of the enduring challenges in orthopedics that have great potential to be resolved with the CAS systems of the future.

Surgeon training

Virtual reality (VR) training for surgeons is still in its infancy and the financial investment of a VR simulation system can be significant, depending on its complexity.[1,2] Mark Roussot points out that, “Virtual reality, augmented reality, and procedures performed with CAS/robots on cadavers provide safe environments for trainees to rehearse procedural steps, become accustomed to the technology, and learn about the nuances of achieving a well-aligned, well-balanced, and stable joint replacement. Like other industries, simulation-based training will become increasingly utilized.”

One concern that has been raised around computer-based training is the establishment of proficiency standards. If, after a certain number of attempts or time, simulation training ends, it does not take into account the large variation in attempts individuals take to learn a procedure.[3] See Figure 1. To be effective, VR training should differentiate between user experience levels, then tailor the training accordingly. Interestingly, how precisely a simulation replicates what it is modeling does not necessarily produce superior training outcomes—a low-fidelity laparoscopy simulator was shown to be superior to a comparable high-fidelity simulator in skills transfer to the OR.[4]

Figure 1. First-year residents and consultants specialized in orthopedic trauma surgery performed the placement of cannulated screws, Hansson pins, and sliding hip screw using the Swemac TraumaVision VR simulator so researchers could determine characteristics of learning curves for novices and experts and a pass/fail mastery-learning standard for junior trainees. Used with permission under CC BY 4.0 license. Source: Gustafsson A, et al. Hip-fracture osteosynthesis training: exploring learning curves and setting proficiency standards. Acta Orthop. 2019;90(4):348–353.

Augmented reality

Augmented reality (AR) is another modality that has potential to train surgeons and offer guidance during procedures. AR incorporates dynamic VR elements and merges them in real time within a user’s perceived visual environment.[5] For example, it might allow a local surgeon to see an image of a remote surgeon’s hands within their field of view during an actual surgery, or images of a patient’s hidden anatomy superimposed over their field of view. See Figure 2.

Use of AR for surgeon training is not widespread, however, the AR interface has been explored in more depth in relation to distance medicine.

Figure 2. An artist’s illustration of a surgical augmented reality (AR) environment in the future. Used with permission under CC BY 2.0 license. Source: Brother.

Telemedicine

Providing high-quality medical care and specialist consultation to remote communities has several challenges, including high costs and inconvenience related to travel. Real-time video conferencing between geographically separated orthopedic specialists and patients was shown to offer cost savings[6,7] and access to care otherwise not easily found.[8] A 2019 study allowed general practitioners to evaluate the cases of highly rural patients collaboratively with remote orthopedic specialists, allowing nearly 70% of patients’ issues to be resolved during this first evaluation. Ultimately, for those who required a referral, the wait time was reduced from 201 to 40 days.[9]

Telepresence

It has been predicted that through harnessing the strengths of AR technology, telemedicine, and surgical robotics, it will one day be safe and possible for surgeons to operate on a patient from whom they are physically separated. This “telepresence” was shown to successfully facilitate remote instruction of complex surgical procedures in cadavers.[10] In concept, it is well suited to remote teaching but not widely used at present, even though in 2001 the first complete distance surgery was completed with the patient in France and the surgeon in the US.[11]

Garcia et al reported on their Trauma Pod project and showed, among other features, that a surgeon was able to successfully perform a bowel anastomosis and an iliac shunt on a remote patient phantom using teleoperation while being supported by autonomous robotic arms that carried out scrub-nurse and circulating-nurse functions.[12]

However, surgery from a distance carries risks and challenges that need to be solved to enable wider adoption. A few requirements for this technology to be successful include: stable, uninterrupted, high-speed internet connection; reliable power sources on both ends; and a back-up plan for human intervention if required. In addition, security of the connection is paramount—it is not inconceivable that hackers could hijack a robot’s programming and take control of a remote procedure.[13]

Rehabilitation video games

Patient nonadherence to physiotherapy is a barrier to recovery.[14] Computer-assisted rehabilitation offers a way to provide quantifiable measurement of improvement and there is evidence that well designed, video game-based rehabilitation can trigger reward-related dopamine systems in the brain and can motivate patients towards longer, more intensive training sessions.[15,16] However, most robotic rehabilitation research has been focused on neurorehabilitation for patients with central nervous system lesions and not orthopedics.[17] See Figure 3.

Figure 3. Two stroke-related arm impaired subjects playing an air hockey game. The ARMin robots are attached to the subjects’ arms, and the game is shown on screens in front of each subject. In the case of one subject, the attending nurse held the subject’s shoulder to decrease tremor. Used with permission under CC BY 2.0 license. Source: Novak D, et al. Increasing motivation in robot-aided arm rehabilitation with competitive and cooperative gameplay. J Neuroeng Rehabil. 2014;11:64.

Knee ligament reconstruction

Since the 1990s, surgeons have used navigation in ACL reconstruction.[18] It can assist with drill hole placement and in quantifying instability in the sagittal, coronal, and axial planes. Robotic systems have also been used for knee ligament reconstruction, although clinical outcome improvements have yet to be identified. They have been shown to improve the accuracy of tunnel placement,[19] which contributes to achieving stability in the joint.[20] Planning tunnel placement for multiligament reconstructions and ligament reconstructions that are combined with osteotomies would be well suited to the use of robotics, but this has not yet been reported.

In addition, Mark Roussot feels that, “CAS and robotics could play a valuable role in achieving the optimum tunnel position for knee ligament reconstruction, especially for more challenging scenarios such as multiligament reconstructions or a ligament reconstruction combined with an osteotomy.” At a more microscopic level, tissue engineering technologies that are capable of 3D printing osteochondral grafts are also developing.[21,22]

There is also the potential to use robotics, which have the benefit of exact repeatability of motion and force, to measure stability and kinematics intraoperatively. This feature has been used to quantitatively compare the effectiveness of different operative techniques experimentally.[23,24] (See Figure 4 and Figure 5.)

Figure 4. KUKA KR 60-3 6 degrees of freedom robot being used to quantitatively measure knee laxity of single-bundle versus double-bundle anatomically reconstructed ACLs in paired cadaveric specimens. Used with permission. Source: Goldsmith MT, et al. Biomechanical comparison of anatomic single- and double-bundle anterior cruciate ligament reconstructions: an in vitro study. Am J Sports Med. 2013;41(7):1595–1604.

Figure 5. Robot being used to assess the effect of sequential cutting of knee structures on rotational stability. Used with permission under CC BY-NC-ND 3.0 license. Source: Vap AR, et al. The Role of the Peripheral Passive Rotation Stabilizers of the Knee with Intact Collateral and Cruciate Ligaments: A Biomechanical Study. Orthop J Sports Med. 2017;5(5):2325967117708190.

Joint preservation

Despite navigation being used in osteotomies around the knee, and shown in cadaver and clinical studies to enhance accuracy of the corrective surgery while limiting the intraoperative radiation exposure for patients and OR personnel,[25] it is associated with higher costs and operative time which in turn has limited the adoption of the technology for this use.[26] Neither has a meta-analysis determined if navigated osteotomies result in improved clinical outcomes or survivorship.[26]

Long-term comparative studies are needed in addition to reporting on sagittal and axial plane measurement reliability; coronal correction is more often the reported parameter. Navigation in osteotomies can be regarded as a sophisticated intraoperative goniometer (an instrument that either measures an angle or allows an object to be rotated to a precise angular position[27]).

This short video outlines a high tibial osteotomy procedure using computer navigation.

Figure 6. Left knee valgus producing high tibial osteotomy (HTO) using computer navigation. Note the use of arthroscopic assisted registration (A), medial opening wedge HTO (B), intraoperative fluoroscopic images (C and D) and navigations screen captures (E and F) showing correction from 7.5O varus to 1.5O valgus mechanical axis. G and H demonstrate preoperative and postoperative x-rays. Images courtesy of Mark Roussot and Sam Oussedik.

 

Robot-assisted osteotomy has the potential, because of the precision of the robot’s movements, to guide surgeons through their planned procedure and reduce the risk of soft tissue injury. By helping to control the coronal, sagittal, and axial plain correction, robot-assisted osteotomies could make the combination of osteotomy and ligament reconstruction simpler.

Periacetabular osteotomies

Periacetabular osteotomies (PAO) are perfectly suited to the use of computer assistance and robotics. Both image-based and imageless navigation for PAO have been described,[28,29] one of the first in 1997.[30] Although few comparative studies exist, advocates suggest these systems improve surgical planning, increase the accuracy of correction, and aid in the learning curve. A 2019 cadaver study of 3D printed patient-specific implants (PSI) for use in PAO showed accurate fit to bone and precise positioning of the osteotomies which resulted in acceptable corrections when compared to what had been planned.[31]

As discussed in Part 1, preoperative planning using images, most commonly computed tomography (CT), is largely standard in orthopedics. When coupled with the dynamic 3D analysis that planning software offers, it has become possible for surgeons to model a procedure, alter variables, generate hypothetical outcomes, then move into the OR with a digital plan to compare against in real-time.

 

This video demonstrates the computer-generated dynamic 3D imaging based on a patient’s CT scan that can be used to evaluated pathological hip morphology and for planning periacetabular osteotomies and arthroscopic resections, such as for hip dysplasia or femoroacetabular impingement. Image courtesy of Mark Roussot.

 

However, intraoperatively, correction must be applied to compensate for the differences in imaging modalities when, for example CT is used for preoperative planning and these images are compared with on-table supine fluoroscopy, which is prone to distortion.[32] See Figure 7. It is a challenging endeavor and takes a very experienced surgeon to achieve a suitable correction. The correction is performed in the supine position, but this is only one of the functional positions of the pelvis and may be altered by muscle relaxation during anesthesia, making it challenging for the surgeon to determine the appropriate correction intraoperatively.

Figure 7. Fluoroscopy is known to distort images. This series of images illustrates this distortion, a corrective solution, and the resulting more focused image from a study on a calibration method to improve the resolution and coregistration of simultaneously acquired hybrid fluoroscopic and nuclear images. Fluoroscopic image of the lead grid: (a) before distortion correction; (b) the acquired distortion matrix; and (c) fluoroscopic image of the lead grid after distortion correction. Used with permission under CC BY 4.0 license. Source: Beijst C, et al. Multimodality calibration for simultaneous fluoroscopic and nuclear imaging. EJNMMI Phys. 2016;3(1):20.

 

Robotics, together with artificial intelligence (AI), has the potential to address this problem. It would require the development of an application with the capacity to evaluate pelvic and spinopelvic parameters and incorporate dynamic x-rays in different functional positions (eg, supine, sitting, standing), comparing these factors with preoperative plans and intraoperative corrections, to build an understanding of what an appropriate correction for each individual would be. However, this type of application is not associated with the use of implants and therefore is much less likely to receive resources for research and development.

There are currently several applications that provide analysis of intraoperative fluoroscopy to correct for distortion[33] and measure angles such as lateral center-edge angle and anterior wall index in order to assist the surgeon in monitoring the parameters of the correction.

Hip arthroscopy

“Our understanding of femoroacetabular impingement (FAI) and its contribution to early onset osteoarthritis has developed tremendously over the last decade,” says Georges Vles. “However, we are not achieving the results we would like because we are trying to fix a complex 3D problem by means of a 2D procedure. Both over- and under-resection have significant consequences.”

Cam resection for FAI using navigation has been attempted with some success,[34] but not without drawbacks, such as increased operative time and radiation exposure.[35] See Figure 8. With this procedure there is a fine line between adequate resection to prevent impingement and excessive resection that may risk complication, such as fracture. We already have the capacity to evaluate preoperative CT scans dynamically and robot-assisted cam resection has been performed successfully. However, it is still cumbersome to use and will require development of purpose-designed instrumentation.

“It is my hope that in the near future it will be standard practice to preoperatively define the zone of impingement in a kinematic 3D model, plan the bony resection based on a virtual impingement-free range of motion, and execute this planned resection semi-automatically and with high-precision,” remarks Georges Vles. “I am convinced this will lead to better outcomes for our patients and maintain the enthusiasm for FAI surgery.”

Figure 8. Verification of a navigated arthroscopic surgery for femoroacetabular impingement. Resected area and depth by pointer. The pointer device indicates the distal margin of resected area from the anterolateral portal view with the pointer via the midanterior portal (A), which is also identified by the computer navigation monitor (B). The lateral margin of the resected area is clearly verified from the mid-anterior portal view with the pointer via the anterolateral portal (C, D). Used with permission under CC BY-NC-ND license. Source: Kobayashi N, et al. Kobayashi N, et al. Computer-Assisted Hip Arthroscopic Surgery for Femoroacetabular Impingement. Arthrosc Tech. 2018;7(4):e397–e403.

Spine

Robotic assistance in spine surgery has predominantly focused on helping the surgeon to attain the correct trajectory for pedicle screws, and there is evidence that robotics is at least comparable, if not superior to manual technique in terms of accuracy, however, total operative time is prolonged and radiation exposure is variable.[36,37] Even with robotic assistance for screw trajectory, drilling pathways can be altered by soft tissue pressures, forceful surgical application, and bony surface skiving. Actual placement of the pedicle screw is still performed by the surgeon, and robotics has not yet been used to aid in deformity correction.[38]

Shoulders

PSI and navigation have been used for shoulder arthroplasty to reduce the risk of glenoid malplacement, which can lead to instability, poor function, and early loosening. Currently, the advantage over standard instrumentation seems to be marginal, and there are no long-term comparative studies.[39] Glenoid exposure is an art, and additional navigation instrumentation can make the procedure more cumbersome. PSI accuracy appears to diminish with greater degrees of glenoid deficiency, which is when accuracy is most required.

Much of the success of shoulder arthroplasty relies on the integrity of the soft tissue, which navigation in its current form does not improve.

Tumors

Computer navigation has been used successfully for tumor surgery and increases the precision of bony resection aimed at achieving a sufficient tumor free margin[40] while minimizing disease-free bone loss.[41] However, recurrence rates are also influenced by the adequacy of soft tissue margins, and are therefore similar when compared to non-navigated resections.[42]

Machine learning (or AI) is characterized by the ability to mimic human-like cognitive functions such as learning and problem solving, and is also proving to be extremely useful in many applications. A study published in January 2020 described a novel process that combines advanced imaging with AI training to diagnose brain tumor tissue intraoperatively in under 3 minutes. See Figure 9. It demonstrated accuracy equal to that of a pathologist and would facilitate intraoperative tumor tissue diagnosis with unprecedented speed, allowing surgeons to differentiate between tumor tissue they cannot distinguish visually and the healthy tissue that surrounds it on a cellular level without need of a pathology laboratory.[43]

Figure 9. Combining stimulated Raman histology plus convolutional neural networks (CNN) and machine learning, researchers have developed a machine for use in ORs that analyzes a fresh surgical sample within 3 minutes and can predict with great accuracy the kind of tumor cells present. Used with permission. Source. Image by: Todd Hollon.

Trauma: Fracture reduction

Robotics have the potential to help overcome several bottlenecks associated with traditional fracture surgery, including trial and error reductions, multiple attempts of entry points, freehand fixations, and suboptimal trajectories of screws and nails with perforation of cartilage or neurovascular structures.[44–47]

One of the most common and refined applications in trauma surgery involves sacroiliac screw placement in posteriorly unstable pelvic ring fractures. A prospective randomized comparison by Wang et al, showed superior accuracy, decreased intraoperative radiation exposure, and less guidewire attempts for the robot-assisted group compared with the conventional group, while the surgical time remained the same.[48] Similar results have been shown in case-control studies for robot-assisted percutaneous screw fixation of femoral neck fractures[49,50] and cephalomedullary nail fixation of intertrochanteric fractures[51]. Liu et al showed excellent results of robot-assisted, computer navigated percutaneous fixation of ten nondisplaced scaphoid waste fractures with all patients requiring only a single guidewire insertion attempt with no screw protuberances or other complications.[52]

Although still a long way off from clinical use, several research groups are exploring the possibilities of robot-assisted fracture reduction, especially for femoral fractures.[53] See Figure 10. Creating software that automatically deducts both the desired end-position of fracture fragments as well as the optimal reduction path from preoperative CT scans seems feasible.[54] Accurate and consistent postreduction alignment has been shown in saw-bone and cadaveric studies.[55–57] Nevertheless, meeting the high loading demands of long bone fracture reduction, while keeping the options open for definitive fixation, remains a significant challenge for computer-assisted technology in the future.[53]

Figure 10. Robot Assisted Fracture Surgery's (RAFs) surgical robot. A team from the Bristol Robotics Laboratory at the University of the West of England is working on a surgical robot that uses a minimally invasive approach to put joint fractures back together. Used with permission under open source license. Source 1, Source 2: Dagnino G, et al. Image-Guided Surgical Robotic System for Percutaneous Reduction of Joint Fractures. Ann Biomed Eng. 2017;45(11):2648–2662.

Hip and knee arthroplasty

One of the challenges that robot-assisted total hip arthroplasty (THA) and total knee arthroplasty (TKA) face is that the ideal implant position is not yet fully understood.

THA—building a database: With regards to the hip, it is usually straightforward to plan the restoration of length and offset. However, achieving the appropriate acetabular position and femoral anteversion requires an appreciation for the dynamic hip motion, spinopelvic morphology, and alignment (including rotational alignment) of the entire lower limb. These factors are not routinely incorporated in the preoperative plan in most practices.

Figure 11. Robot-assisted THA has the potential to build a large, multicenter database that, with the help of AI analysis, could be harnessed to better understand optimal implant placement. Source: By Tumisu

 

However, the use of robotic assistance that requires pre-operative CT image acquisition may provide a large database of pathological and reconstructed alignment. See Figure 11. Institutions that include advanced postoperative imaging such as CT evaluation (whether for research purposes or otherwise) will be well positioned to contribute to the understanding of optimal position when this is correlated with subjective and objective outcomes.

TKA—soft-tissue balancing: For TKA, there is much debate about the correct limb alignment and implant position. For example, traditional goals of achieving neutral alignment with orthogonal bone resections or anatomical bone resection have been challenged by the philosophies of kinematic alignment and functional alignment.[58] It takes an experienced surgeon to appreciate and establish the soft tissue balance and tracking in a knee that would be suitable for a patient, and to dynamically test the stability intraoperatively. See Figure 12. There are now ways of evaluating this quantitatively using intracompartmental pressure sensors such as this single-use, wireless product that is compatible with several implant brands. Professor Fares Haddad has been instrumental in demonstrating that these modern surgical aids can be used to reconstruct the functional alignment of the knee that is specific to the individual and still maintained within the acceptable safe zones of alignment.[59]

Figure 12. Determining theoretical extension (A) and flexion (B) gaps prior to resection with valgus (A2 and B2) and varus forces (A3 and B3) applied by the surgeon. Images courtesy Mark Roussot and Fares Haddad. From: Roussot MA, Vles GF, Haddad FS. Functional resection: modern advances in surgical technique for roboticassisted total knee arthroplasty. In: Catani F, editor. Robotic-assisted surgery for total hip and knee replacement. Turin: Edizioni Minerva Medica; 2020:130–142.

Future evolution of CAS

Mark Roussot and Georges Vles suggest that the future evolution in CAS is likely to progress in three ways:

  1. The technologies themselves will evolve and be refined so that the large, cumbersome machine used today can progressively be replaced by one that takes up less space in the OR, is capable of exchanging instruments quickly and efficiently, can recognize a patient’s anatomy with a faster registration process, and does not require extra incisions with bone pins in order to monitor the position of the patient.
  2. Computer-assisted technologies will be integrated with other technologies to provide more dynamic evaluation of a procedure and implant position.
  3. The use of machine learning and AI will become an essential part of planning and a procedure. Optimal alignment and soft tissue balance will be determined based on the accumulation of data from previous procedures that have been correlated with outcomes. A CAS of the future would recommend the appropriate alignment and implant position for each patient that would ensure the best chance of a good outcome.

In fact, these advances are not only imaginable, but they already exist in various forms. For example, pinless navigation has shown acceptable accuracy,[60] robots can change instruments[12] and perform soft tissue surgery,[61] and AI is being used in diagnostic imaging.[62,63]

Question: What functionality would you like to see in surgical robots of the future?

Justin Chang
MBBS, MRCS (Eng), FRCSC, University College London Hospital NHS Foundation Trust, Trauma and Orthopaedics Department, UK

Ahmed Magan
BM BSc (Hons) MRCS (Eng) FRCS (Eng), Trauma & Orth, University College London Hospital, Department of Trauma and Orthopaedics, UK

Mark Roussot
MBChB, MPhil, MMed, FC Orth (SA), FRCS (Tr & Orth), University College London Hospital, Department of Trauma and Orthopaedics, UK

Georges Vles
MD, PhD, University Hospitals Leuven, Division of Orthopedic Surgery, Belgium

Currently, the robot used most in orthopedics is physically large and limits the ability to have assistants/trainees close to the wound. I would like to see technology developed to avoid optical tracking and. “line of sight” issues. Improved dynamic measurement of soft tissue balance throughout range of motion (laxity profile) is needed and accurate registration performed without the need for pre-op CT scans would reduce costs and patient trips.

Looking forward, I think technological developments that would allow robots to better protect soft tissue, compared with standard instrumentation, would really improve patient outcomes. This is functionality I would like to see soon. But, if I were going to really dream about my ideal surgical robot, I’d ask for the possibilities of telemedicine and telesurgery to grow to the point that I could perform remote surgery. This would be fantastic!

The robot should have hand-held controls to let the surgeon navigate without a technician needing to click buttons, have a faster registration process, assist with limb position and stabilization, switch instruments with ease, and rapidly self-calibrate between instrument changes (it is currently a time-consuming manual process). I would also like to see the robots export procedural records to the electronic patient record or joint registry and have wireless connectivity.

I would like to see a robot that does not rely on bone pins that require separate incisions, uploads data gathered on every procedure to a master database, and provides a summary at the end of the procedure of time spend per phase as well as learning points/progress compared to previous procedures. These are just a few of the features I would like to see in the surgical robots of the future.

Outside the box thinking: collaboration to drive change

As we have witnessed in the COVID-19 outbreak, engineering companies have enormous capacity for reinvention when the demand is great enough. See Figure 13. If companies like AMG-Mercedes, Yamaha, Apple, or Microsoft, who already have decades of experience with robotics and AI start to manufacture robots with surgical capacity, their functionality and economy has the potential to advance exponentially.

Figure 13. In 100 hours, a cross-discipline team of engineers from AMG-Mercedes and University College London (UCL) reverse engineered a prototype of a Continuous Positive Airway Pressure (CPAP) machine to be used in Covid-19 patients, offering an alternative to mechanical ventilators which are in short supply. Used with permission. Source: UCL, James Tye.

Open and closed systems

At present, CAS systems are mostly closed, in other words, if you want to perform a robot-assisted orthopedic procedure, you have to use a specific robotic that uses a specific implant or brand of implants, and the planning process can take weeks.

Some have pointed out that the complexity of CAS technology and the proprietary nature of each machine’s programming and implant incompatibility has limited the translation of new ideas into clinical use.[64] Being able to easily bridge, for example, a surgical robot with a new imaging platform could hasten the implementation of new applications by integrating the engineering of both fields. There are researchers who are working on compatibility software interfaces[65] and suggesting common robot software (eg, Open Core Control)[66] to enable this.

One surgical robot called RAVEN[67] has an open source software platform (RAVEN II) to allow universities and/or research centers to contribute to the evolution of robotic surgery.[68] It has been placed in 16 research centers around the world. The user “community is united in the application and support of a common platform, and each member has the power to pursue and develop their own intellectual property.” It allows the community of users to make improvements to the core robotic manipulator, which are then made available to the entire group. Users can then pursue their own proprietary advances in procedures, attached instruments, supervisory software, and human/machine interfaces. Aspects of knee arthroscopy and chondroplasty have been investigated on models.[69]

This video highlights a group of researchers using RAVEN to perform experiments to establish significant proof of concept results for supervised telesurgery.

 

Cross-discipline integration of technological advancements is on the horizon. For example, tissue engineering techniques (3D printing osteochondral tissue) have been applied to mouse and rabbit models and have shown promising preliminary results in terms of neocartilage formation, osteochondral integration, and a smooth cartilage cap in 3D printed cartilage cells implanted into a rabbit knee.[70–72] Integration with modern imaging provides the potential for individualized osteochondral reconstruction.[70]

Machine communication and interaction

Currently, most ORs contain many machines requiring human operators for monitoring.[66] The need to integrate medical systems and software solutions into a holistic clinical infrastructure is growing.[73] Envisioning an OR of the future where these machines, including CAS systems, are interconnected and communicating with each other will require the development of platforms that are, at least to some extent, open-source.

Imagine if a machine was capable of simultaneously measuring and recording temperature, controlling theatre ventilation, administering anesthesia, monitoring vitals, and tracking operative time and parameters that we may not be aware of, or sense ourselves. These specifications could be met with AI technology of the future. “There is opportunity, says Georges Vles, “for a surgical robot to feed information to an anesthesiologist and the OR floor manager. Then they could understand what phase of the operation we are in, adjust their anesthetic or send for the next patient.”

Robots will need to occupy a smaller footprint within the OR and have the sensing capacity to avoid collisions with people and other equipment in a dynamic manner. Automation of low-level tasks, such as changing, cleaning, or packing instrumentation, could be performed quickly by a robot.

Operated by UK online supermarket Ocado, this warehouse full of robots avoid each other as they navigate a grid system to pack up to 65,000 grocery orders per week.

 

“A simple but big step in the right direction in integrating technologies would be to identify what data can be measured before, during, or after a joint replacement that may provide insight into the best way of performing the procedure. Presently, our main metrics are radiological alignment and patient reported outcomes or revision rates,” commented Mark Roussot.

Who determines the parameters?

The speed of computing and its ability to parse and evaluate reams of data much faster than the human brain holds powerful potential. However, it should be kept in mind that more data is not necessary better, and sticky questions arise about who decides what the “perfect” surgery or surgical parameters might be.[74] The regulation and protection of data lag considerably behind the advancement in data capturing. CAS/robotics will generate an almost infinite amount of data and Georges Vles cautions that “at all costs, we should prevent the wrong data from being used to determine success.

“We as surgeons should take the lead in making sure success is measured by subjective outcomes that are important to the patient as well as objective measures important to the surgeon while improving efficiency and minimizing costs.”

“Absolutely,” affirms Mark Roussot, “it will be essential to involve all the key stakeholders in determining what data is captured, how it is used, and who has access to it.”

Roussot feels that including the patient in these discussions and using metrics that optimize patient care is important. He thinks that success needs to be measured with “evidence-based recommendations for the best objective and subjective (patient-reported) metrics. Surgeons, or councils of surgeons, will also need to evaluate the impact that these metrics and access to data will have on our practice.”

Will robots make surgeons irrelevant?

By 2019, 1.4 million new industrial robots were predicted to be in operation, raising the total to 2.6 million worldwide.[75,76] Always a hot-button topic when it comes to robots and automation is the potential for job loss as tasks move from human workers to machines. Georges Vles notes that, “most surgeons fear becoming redundant when they first become aware of these new innovations.”

However, robots may not be the threat they appear to be at first glance, especially to the realm of medicine and its highly educated practitioners. “Even the best AI and robotic systems produced by the most respected and experienced companies have flaws that humans identify and correct,” says Mark Roussot. “Early attempts at autonomous surgical robots demonstrated how dangerous they can be for a patient.”

“Exactly,” adds Vles, “given our poor results with fully automatic robots in the past, for example robots broaching the femoral canal in an autonomic manner, semi-automatic robots are here to stay, at least for the foreseeable future.”

Mark Roussot and Georges Vles recommend listening to Professor Fares Haddad’s perspective on the future relationship between robots and surgeons. In an interview with CNBC, Professor Haddad asserted that robots will not replace surgeons, but they are capable of making surgeons better at the surgery they perform.

When speaking with media outlet GeekWire, Blake Hannaford, one of the leaders of the open-platform surgical robot RAVEN reaffirmed this when he said that the point of robotic surgery is to expand “the capabilities of human surgeons…and increas[e] the precision of the treatment.”[77]

The World Bank Group put it this way in its 2019 World Development Report, The Changing Nature of Work:

The growing role of technology in life and business means that all types of jobs (including low-skill ones) require more advanced cognitive skills. The role of human capital is also enhanced because of the rising demand for sociobehavioral skills. Jobs that rely on interpersonal interaction will not be readily replaced by machines. However, to succeed at these jobs, sociobehavioral skills—acquired in one’s early years and shaped throughout one’s lifetime—must be strong. Human capital is important because there is now a higher premium on adaptability.[75]

Mark Roussot believes that undertakings requiring adaptability, empathy, common sense, and creativity, such as orthopedic surgery, will continue to need human involvement. If anything, tasks will become automated, not the roles. CAS technology will assist surgeons to become more accurate and efficient and improve patient outcomes, but in doing so will free up a surgeon’s time to offer more services. Consider the classic examples of bank tellers, ATMs, or commercial airline pilots. He points out that, “AI demonstrates significant value with tasks that are data intensive and require several calculations, precision, and endurance; it has enormous potential within the wide scope of orthopedics.”

Georges Vles encourages us to consider that “with these types of robots, surgical skills remain essential, in an unprecedented way. Altering approaches to accommodate robotic requirements, maintaining surgical flow, interpreting new and extensive data, knowing when and how to convert to conventional procedures, these are just some of the new challenges we as surgeons need to meet.”

Conclusion

There will be a need for orthopedic surgeons for a long time to come, but how they perform their jobs and the tools they use are changing. As advances in other fields are integrated into orthopedics, hopefully, long-term outcomes of navigated and robot-assisted procedures will begin to show clear advantages to traditional procedures. Mark Roussot firmly believes that, “through improvements in preoperative planning, precision, and soft-tissue preservation, computer-assisted technology will be shown to facilitate quicker recoveries with better pain resolution and functional outcomes in the future.”

 

Contributing experts

This series of articles was created with the support of the following specialists (in alphabetical order):

Justin Chang
MBBS, MRCS (Eng), FRCSC, University College London Hospital NHS Foundation Trust, Trauma and Orthopaedics Department, UK

Ahmed Magan
BM BSc (Hons) MRCS (Eng) FRCS (Eng), Trauma & Orth, University College London Hospital, Department of Trauma and Orthopaedics, UK

Mark Roussot
MBChB, MPhil, MMed, FC Orth (SA), FRCS (Tr & Orth), University College London Hospital, Department of Trauma and Orthopaedics, UK

Georges Vles
MD, PhD, University Hospitals Leuven, Division of Orthopedic Surgery, Belgium

 

References

1. Willy C. [Simulation techniques in surgical training programs to become an orthopedic and trauma surgeon : Introduction to the topic]. Unfallchirurg. 2019 Jun;122(6):418–424.
2. Sheik-Ali S, Edgcombe H, Paton C. Next-generation Virtual and Augmented Reality in Surgical Education: A Narrative Review. Surg Technol Int. 2019 Nov 10;35:27–35.
3. Gustafsson A, Pedersen P, Rømer TB, et al. Hip-fracture osteosynthesis training: exploring learning curves and setting proficiency standards. Acta Orthop. 2019 Aug;90(4):348–353.
4. Tan SC, Marlow N, Field J, et al. A randomized crossover trial examining low- versus high-fidelity simulation in basic laparoscopic skills training. Surg Endosc. 2012 Nov;26(11):3207–3214.
5. Baker D, Fryberger C, Ponce B. The Emergence of Augmented Reality in Orthopaedic Surgery and Education. The Orthopaedic Journal at Harvard Medical School. 2015 June;16.
6. Buvik A, Bergmo TS, Bugge E, et al. Cost-Effectiveness of Telemedicine in Remote Orthopedic Consultations: Randomized Controlled Trial. J Med Internet Res. 2019 Feb 19;21(2):e11330.
7. Aponte-Tinao LA, Farfalli GL, Albergo JI, et al. Face to Face Appointment vs. Telemedicine in First Time Appointment Orthopedic Oncology Patients: A Cost Analysis. Stud Health Technol Inform. 2019 Aug 21;264:512–515.
8. Lese A, Sraj S. Rural Orthopedics: Providing Orthopedic Care in Rural Communities. Orthopedics. 2019 Jul 1;42(4):e350–e355.
9. Prada C, Izquierdo N, Traipe R, et al. Results of a New Telemedicine Strategy in Traumatology and Orthopedics. Telemed J E Health. 2019 Jul 9.
10. Shenai MB, Dillavou M, Shum C, et al. Virtual interactive presence and augmented reality (VIPAR) for remote surgical assistance. Neurosurgery. 2011 Mar;68(1 Suppl Operative):200–207.
11. Marescaux J, Leroy J, Gagner M, et al. Transatlantic robot-assisted telesurgery. Nature. 2001 Sept;413(6854):379–380.
12. Garcia P, Rosen J, Kapoor C, et al. Trauma Pod: a semi-automated telerobotic surgical system. Int J Med Robot. 2009 Jun;5(2):136–146.
13. Emerging Technology from the arXivarchive page. Security Experts Hack Teleoperated Surgical Robot. 2015. https://www.technologyreview.com/2015/04/24/168339/security-experts-hack-teleoperated-surgical-robot/. Accessed May 3, 2020.
14. Lohse K, Shirzad N, Verster A, et al. Video games and rehabilitation: using design principles to enhance engagement in physical therapy. J Neurol Phys Ther. 2013 Dec;37(4):166–175.
15. Janssen J, Verschuren O, Renger WJ, et al. Gamification in Physical Therapy: More Than Using Games. Pediatr Phys Ther. 2017 Jan;29(1):95–99.
16. Novak D, Nagle A, Keller U, et al. Increasing motivation in robot-aided arm rehabilitation with competitive and cooperative gameplay. J Neuroeng Rehabil. 2014 Apr 16;11:64.
17. Padilla-Castañeda MA, Sotgiu E, Barsotti M, et al. An Orthopaedic Robotic-Assisted Rehabilitation Method of the Forearm in Virtual Reality Physiotherapy. J Healthc Eng. 2018 2018:7438609.
18. Dessenne V, Lavallée S, Julliard R, et al. Computer-assisted knee anterior cruciate ligament reconstruction: first clinical tests. J Image Guid Surg. 1995 1(1):59–64.
19. Cho WJ, Kim JM, Kim DE, et al. Accuracy of the femoral tunnel position in robot-assisted anterior cruciate ligament reconstruction using a magnetic resonance imaging-based navigation system: A preliminary report. Int J Med Robot. 2018 Oct;14(5):e1933.
20. Śmigielski R, Zdanowicz U, Drwięga M, et al. The anatomy of the anterior cruciate ligament and its relevance to the technique of reconstruction. Bone Joint J. 2016 Aug;98-b(8):1020–1026.
21. Okoroha KR, Evans TJ, Stephens JP, et al. Three-dimensional printing improves osteochondral allograft placement in complex cases. Knee Surg Sports Traumatol Arthrosc. 2018 Dec;26(12):3601–3605.
22. Abdulghani S, Morouço PG. Biofabrication for osteochondral tissue regeneration: bioink printability requirements. J Mater Sci Mater Med. 2019 Jan 28;30(2):20.
23. Yamaguchi KT, Cheung EC, Markolf KL, et al. Effects of Anterior Closing Wedge Tibial Osteotomy on Anterior Cruciate Ligament Force and Knee Kinematics. Am J Sports Med. 2018 Feb;46(2):370–377.
24. Vap AR, Schon JM, Moatshe G, et al. The Role of the Peripheral Passive Rotation Stabilizers of the Knee With Intact Collateral and Cruciate Ligaments: A Biomechanical Study. Orthop J Sports Med. 2017 May;5(5):2325967117708190.
25. Song EK, Seon JK, Yim JH, et al. Robotic-assisted TKA reduces postoperative alignment outliers and improves gap balance compared to conventional TKA. Clin Orthop Relat Res. 2013 Jan;471(1):118–126.
26. Kim HJ, Yoon JR, Choi GW, et al. Imageless Navigation Versus Conventional Open Wedge High Tibial Osteotomy: A Meta-Analysis of Comparative Studies. Knee Surg Relat Res. 2016 Mar;28(1):16–26.
27. Wikipedia. Goniometer. Published 2020. Updated April 13, 2020. Accessed May 2, 2020.
28. Liu L, Ecker T, Schumann S, et al. Computer assisted planning and navigation of periacetabular osteotomy with range of motion optimization. Med Image Comput Comput Assist Interv. 2014 17(Pt 2):643–650.
29. Hooper JM, Mays RR, Poultsides LA, et al. Periacetabular osteotomy using an imageless computer-assisted navigation system: a new surgical technique. J Hip Preserv Surg. 2019 Dec;6(4):426–431.
30. Langlotz F, Stucki M, Bächler R, et al. The first twelve cases of computer assisted periacetabular osteotomy. Comput Aided Surg. 1997 2(6):317–326.
31. Wirth SH, Rahm S, Kamath AF, et al. Periacetabular osteotomy using three-dimensional cutting and reposition guides: a cadaveric study. Journal of Hip Preservation Surgery. 2019 6(4):411–420.
32. Wylie JD, Ferrer MG, McClincy MP, et al. What Is the Reliability and Accuracy of Intraoperative Fluoroscopy in Evaluating Anterior, Lateral, and Posterior Coverage During Periacetabular Osteotomy? Clin Orthop Relat Res. 2019 May;477(5):1138–1144.
33. Anderson L, Erickson J, Peters C. Validation of a quantitative fluoroscopic tool with distortion correction for acetabular positioning in periacetabular osteotomy. The Hip Society (THS) 2019 Summer Meeting; 2019; Kohler, WI, USA,.
34. Kobayashi N, Inaba Y, Kubota S, et al. Computer-Assisted Hip Arthroscopic Surgery for Femoroacetabular Impingement. Arthrosc Tech. 2018 Apr;7(4):e397–e403.
35. Van Houcke J, Khanduja V, Nakano N, et al. Accuracy of navigated cam resection in femoroacetabular impingement: A randomised controlled trial. Int J Med Robot. 2017 Dec;13(4).
36. Ghasem A, Sharma A, Greif DN, et al. The Arrival of Robotics in Spine Surgery: A Review of the Literature. Spine (Phila Pa 1976). 2018 Dec 1;43(23):1670–1677.
37. Vardiman AB, Wallace DJ, Crawford NR, et al. Pedicle screw accuracy in clinical utilization of minimally invasive navigated robot-assisted spine surgery. J Robot Surg. 2019 Jul 19.
38. Smith JS, Shaffrey CI, Ames CP, et al. Treatment of adult thoracolumbar spinal deformity: past, present, and future. J Neurosurg Spine. 2019 May 1;30(5):551–567.
39. Villatte G, Muller AS, Pereira B, et al. Use of Patient-Specific Instrumentation (PSI) for glenoid component positioning in shoulder arthroplasty. A systematic review and meta-analysis. PLoS One. 2018 13(8):e0201759.
40. So TY, Lam YL, Mak KL. Computer-assisted navigation in bone tumor surgery: seamless workflow model and evolution of technique. Clin Orthop Relat Res. 2010 Nov;468(11):2985–2991.
41. Farfalli GL, Albergo JI, Ritacco LE, et al. What Is the Expected Learning Curve in Computer-assisted Navigation for Bone Tumor Resection? Clin Orthop Relat Res. 2017 Mar;475(3):668–675.
42. Nandra R, Matharu G, Stevenson J, et al. Long-term outcomes after an initial experience of computer-navigated resection of primary pelvic and sacral bone tumours: soft-tissue margins must be adequate to reduce local recurrences. Bone Joint J. 2019 Apr;101-b(4):484–490.
43. Hollon TC, Pandian B, Adapa AR, et al. Near real-time intraoperative brain tumor diagnosis using stimulated Raman histology and deep neural networks. Nat Med. 2020 Jan;26(1):52–58.
44. Bai L, Yang J, Chen X, et al. Medical Robotics in Bone Fracture Reduction Surgery: A Review. Sensors (Basel). 2019 Aug 18;19(16).
45. Oszwald M, Westphal R, Stier R, et al. Hands-on robotic distal interlocking in intramedullary nail fixation of femoral shaft fractures. Technol Health Care. 2010 18(4-5):325–334.
46. Gosling T, Westphal R, Hufner T, et al. Robot-assisted fracture reduction: a preliminary study in the femur shaft. Med Biol Eng Comput. 2005 Jan;43(1):115–120.
47. Lei H, Sheng L, Manyi W, et al. A biplanar robot navigation system for the distal locking of intramedullary nails. Int J Med Robot. 2010 Mar;6(1):61–65.
48. Wang JQ, Wang Y, Feng Y, et al. Percutaneous Sacroiliac Screw Placement: A Prospective Randomized Comparison of Robot-assisted Navigation Procedures with a Conventional Technique. Chin Med J (Engl). 2017 Nov 5;130(21):2527–2534.
49. Duan SJ, Liu HS, Wu WC, et al. Robot-assisted Percutaneous Cannulated Screw Fixation of Femoral Neck Fractures: Preliminary Clinical Results. Orthop Surg. 2019 Feb;11(1):34–41.
50. Wang XD, Lan H, Li KN. Treatment of Femoral Neck Fractures with Cannulated Screw Invasive Internal Fixation Assisted by Orthopaedic Surgery Robot Positioning System. Orthop Surg. 2019 Oct;11(5):864–872.
51. Lan H, Tan Z, Li KN, et al. Intramedullary Nail Fixation Assisted by Orthopaedic Robot Navigation for Intertrochanteric Fractures in Elderly Patients. Orthop Surg. 2019 Apr;11(2):255–262.
52. Liu B, Wu F, Chen S, et al. Robot-assisted percutaneous scaphoid fracture fixation: a report of ten patients. J Hand Surg Eur Vol. 2019 Sep;44(7):685–691.
53. Zhao JX, Li C, Ren H, et al. Evolution and Current Applications of Robot-Assisted Fracture Reduction: A Comprehensive Review. Ann Biomed Eng. 2020 Jan;48(1):203–224.
54. Buschbaum J, Fremd R, Pohlemann T, et al. Computer-assisted fracture reduction: a new approach for repositioning femoral fractures and planning reduction paths. Int J Comput Assist Radiol Surg. 2015 Feb;10(2):149–159.
55. Dagnino G, Georgilas I, Köhler P, et al. Navigation system for robot-assisted intra-articular lower-limb fracture surgery. Int J Comput Assist Radiol Surg. 2016 Oct;11(10):1831–1843.
56. Oszwald M, Westphal R, Bredow J, et al. 3D visualized robot assisted reduction of femoral shaft fractures: evaluation in exposed cadaveric bones. Technol Health Care. 2009 17(4):337–343.
57. Zhu Q, Liang B, Wang X, et al. Minimally invasive treatment of displaced femoral shaft fractures with a teleoperated robot-assisted surgical system. Injury. 2017 Oct;48(10):2253–2259.
58. Roussot M, Vles G, Oussedik S. Clinical outcomes of kinematic alignment versus mechanical alignment in total knee arthroplasty – a systematic review. [Accepted for publication]. EFORT Open Reviews. 2020.
59. Oussedik S, Abdel MP, Victor J, et al. Alignment in total knee arthroplasty. Bone Joint J. 2020 Mar;102-b(3):276–279.
60. Ulivi M, Orlandini LC, Meroni V, et al. Intraoperative validation of bone cut accuracy of a pinless smart touch-screen navigation system device in total knee arthroplasty. Int J Med Robot. 2019 Oct;15(5):e2030.
61. Shademan A, Decker RS, Opfermann JD, et al. Supervised autonomous robotic soft tissue surgery. Sci Transl Med. 2016 May 4;8(337):337ra364.
62. Jones LD, Golan D, Hanna SA, et al. Artificial intelligence, machine learning and the evolution of healthcare: A bright future or cause for concern? Bone Joint Res. 2018 Mar;7(3):223–225.
63. Bayliss L, Jones LD. The role of artificial intelligence and machine learning in predicting orthopaedic outcomes. Bone Joint J. 2019 Dec;101-b(12):1476–1478.
64. Ungi T, Lasso A, Fichtinger G. Open-source platforms for navigated image-guided interventions. Med Image Anal. 2016 Oct;33:181–186.
65. Frank T, Krieger A, Leonard S, et al. ROS-IGTL-Bridge: an open network interface for image-guided therapy using the ROS environment. Int J Comput Assist Radiol Surg. 2017 Aug;12(8):1451–1460.
66. Arata J, Kozuka H, Kim HW, et al. Open core control software for surgical robots. Int J Comput Assist Radiol Surg. 2010 May;5(3):211–220.
67. Applied Dexterity. Applied Dexterity: Driving innovation in surgical robotics. http://applieddexterity.com/  Published 2020. Accessed May 3, 2020.
68. Hannaford B, Rosen J, Friedman DW, et al. Raven-II: an open platform for surgical robotics research. IEEE Trans Biomed Eng. 2013 Apr;60(4):954–959.
69. Lopez E, Kwok KW, Payne CJ, et al. Implicit Active Constraints for Robot-Assisted Arthroscopy. IEEE Int Conf Robot Autom. 2013 May 10;2013:5390–5395.
70. Dhawan A, Kennedy PM, Rizk EB, et al. Three-dimensional Bioprinting for Bone and Cartilage Restoration in Orthopaedic Surgery. J Am Acad Orthop Surg. 2019 Mar 1;27(5):e215–e226.
71. Xu T, Binder KW, Albanna MZ, et al. Hybrid printing of mechanically and biologically improved constructs for cartilage tissue engineering applications. Biofabrication. 2013 Mar;5(1):015001.
72. Shim JH, Jang KM, Hahn SK, et al. Three-dimensional bioprinting of multilayered constructs containing human mesenchymal stromal cells for osteochondral tissue regeneration in the rabbit knee joint. Biofabrication. 2016 Feb 4;8(1):014102.
73. Pirlich M, Stöhr M, Neumuth T, et al. The Intelligent ENT Operating Room of the Future. Laryngorhinootologie. 2019 Mar;98(S 01):S5–S31.
74. Jarvis C. Opinion: Surgical Robots are Surging in Popularity. So Will Their Data. Undark. https://undark.org/2019/08/15/surgical-robots-are-suring-in-popularity/. Published 2019. Updated August 15, 2019. Accessed May 3, 2020.
75. World Bank Group. The Changing Nature of Work. 2019:10.
76. International Federation of Robotics. Facts about robots. https://ifr.org/. Published 2020. Accessed May 3, 2020.
77. Boyle A. Why your robotic surgeon will have a human overlord looking over its shoulder. GeekWire. https://www.geekwire.com/2016/robot-surgeon-human-overlord/. Published 2016. Updated April 27, 2016. Accessed May 3, 2020.

overview
Please correct the following errors and try again: