Robotic assistance is applied in orthopedic interventions for pedicle screw placement
(PSP). While current robots do not act autonomously, they are expected to have higher autonomy
under surgeon supervision in the mid-term. Augmented reality (AR) is promising to support this
supervision and to enable human–robot interaction (HRI). To outline a futuristic scenario for robotic
PSP, the current workflow was analyzed through literature review and expert discussion. Based on
this, a hypothetical workflow of the intervention was developed, which additionally contains the
analysis of the necessary information exchange between human and robot. A video see-through
AR prototype was designed and implemented. A robotic arm with an orthopedic drill mock-up
simulated the robotic assistance. The AR prototype included a user interface to enable HRI. The
interface provides data to facilitate understanding of the robot’s ”intentions”, e.g., patient-specific
CT images, the current workflow phase, or the next planned robot motion. Two-dimensional and
three-dimensional visualization illustrated patient-specific medical data and the drilling process. The
findings of this work contribute a valuable approach in terms of addressing future clinical needs and
highlighting the importance of AR support for HRI.
| Identifer | oai:union.ndltd.org:DRESDEN/oai:qucosa:de:qucosa:91420 |
| Date | 16 May 2024 |
| Creators | Schreiter, Josefine, Schott, Danny, Schwenderling, Lovis, Hansen, Christian, Heinrich, Florian, Joeres, Fabian |
| Publisher | MDPI |
| Source Sets | Hochschulschriftenserver (HSSS) der SLUB Dresden |
| Language | English |
| Detected Language | English |
| Type | info:eu-repo/semantics/publishedVersion, doc-type:article, info:eu-repo/semantics/article, doc-type:Text |
| Rights | info:eu-repo/semantics/openAccess |
| Relation | 255, 10.3390/jimaging8100255 |
Page generated in 0.0022 seconds