Park, Juyoun Park, Chung Hyuk 2024-01-19T15:02:48Z 2024-01-19T15:02:48Z 2021-10-21 2021-04 2377-3766 https://pubs.kist.re.kr/handle/201004/117192 Artificial intelligence (AI) has demonstrated superior performances in various fields, including computer vision and medical imaging. Further advancement in AI and medical imaging can effectively contribute to increasing the quality of service in both robotic and non-robotic surgical domains by providing enhanced medical perception and predictive assistance. In this regard, we propose a method for successfully recognizing the current surgical actions as well as predicting future surgical actions based on the robotic surgical scenes. We introduce an online robotic tool detection method that can extract visual features that focus on each robotic surgical tool without prior learning. Based on the features, we develop an encoder-decoder framework to recognize the current surgical action and predict the sequence of the next surgical actions to be performed. By performing experiments using the JHU-ISI Gesture and Skill Assessment Working Set (JIGSAWS) data, it is verified that the proposed method recognizes the current surgical action with high accuracy and effectively predicts a sequence of future surgical actions. English Institute of Electrical and Electronics Engineers Inc. Recognition and Prediction of Surgical Actions Based on Online Robotic Tool Detection Article 10.1109/LRA.2021.3060410 1 IEEE Robotics and Automation Letters, v.6, no.2, pp.2365 - 2372 IEEE Robotics and Automation Letters 6 2 2365 2372 N scie scopus 000631202300007 2-s2.0-85101781706 Robotics Robotics Article Deep learning methods medical robots and systems planning surgical robotics