TY - JOUR
T1 - Automatic surgical phase recognition in laparoscopic inguinal hernia repair with artificial intelligence
AU - Takeuchi, M.
AU - Collins, T.
AU - Ndagijimana, A.
AU - Kawakubo, H.
AU - Kitagawa, Y.
AU - Marescaux, J.
AU - Mutter, D.
AU - Perretta, S.
AU - Hostettler, A.
AU - Dallemagne, B.
N1 - Funding Information:
Author Y.K received lecture fees from CHUGAI PHARMACEUTICAL Co., Ltd., TAIHO PHARMACEUTICAL Co., Ltd., ASAHI KASEI PHARMA CORPORATION, Otsuka Pharmaceutical Factory Inc., SHIONOGI & Co., Ltd., Nippon Covidien Inc., ONO PHARMACEUTICAL Co., Ltd., Bristol-Myers Squibb K.K. Author Y.K was supported by grants from CHUGAI PHARMACEUTICAL Co., Ltd., TAIHO PHARMACEUTICAL Co., Ltd., Yakult Honsha Co., Ltd., AsahiKASEI Co., Ltd., Otsuka Pharmaceutical Co., Ltd., Takeda Pharmaceutical Co., Ltd., ONO PHARMACEUTICAL Co., Ltd., TSUMURA & CO., Kyouwa Hakkou Kirin Co., Ltd., DAINIPPON SUMITOMO PHARMA Co., Ltd., EA Pharma Co., Ltd., Astellas Pharma Inc., Toyama Chemical Co., Ltd., MEDICON INC., KAKEN PHARMACEUTICAL Co., Ltd., Eisai Co., Ltd., Otsuka Pharmaceutical Factory Inc., TEIJIN PHARMA LIMITED., NIHON PHARMACEUTICAL Co., Ltd., and Nippon Covidien Inc. Author Y.K held an endowed chair provided by CHUGAI PHARMACEUTICAL Co., Ltd. and TAIHO PHARMACEUTICAL Co., Ltd., outside of the submitted work.
Publisher Copyright:
© 2022, The Author(s), under exclusive licence to Springer-Verlag France SAS, part of Springer Nature.
PY - 2022/12
Y1 - 2022/12
N2 - Background: Because of the complexity of the intra-abdominal anatomy in the posterior approach, a longer learning curve has been observed in laparoscopic transabdominal preperitoneal (TAPP) inguinal hernia repair. Consequently, automatic tools using artificial intelligence (AI) to monitor TAPP procedures and assess learning curves are required. The primary objective of this study was to establish a deep learning-based automated surgical phase recognition system for TAPP. A secondary objective was to investigate the relationship between surgical skills and phase duration. Methods: This study enrolled 119 patients who underwent the TAPP procedure. The surgical videos were annotated (delineated in time) and split into seven surgical phases (preparation, peritoneal flap incision, peritoneal flap dissection, hernia dissection, mesh deployment, mesh fixation, peritoneal flap closure, and additional closure). An AI model was trained to automatically recognize surgical phases from videos. The relationship between phase duration and surgical skills were also evaluated. Results: A fourfold cross-validation was used to assess the performance of the AI model. The accuracy was 88.81 and 85.82%, in unilateral and bilateral cases, respectively. In unilateral hernia cases, the duration of peritoneal incision (p = 0.003) and hernia dissection (p = 0.014) detected via AI were significantly shorter for experts than for trainees. Conclusion: An automated surgical phase recognition system was established for TAPP using deep learning with a high accuracy. Our AI-based system can be useful for the automatic monitoring of surgery progress, improving OR efficiency, evaluating surgical skills and video-based surgical education. Specific phase durations detected via the AI model were significantly associated with the surgeons’ learning curve.
AB - Background: Because of the complexity of the intra-abdominal anatomy in the posterior approach, a longer learning curve has been observed in laparoscopic transabdominal preperitoneal (TAPP) inguinal hernia repair. Consequently, automatic tools using artificial intelligence (AI) to monitor TAPP procedures and assess learning curves are required. The primary objective of this study was to establish a deep learning-based automated surgical phase recognition system for TAPP. A secondary objective was to investigate the relationship between surgical skills and phase duration. Methods: This study enrolled 119 patients who underwent the TAPP procedure. The surgical videos were annotated (delineated in time) and split into seven surgical phases (preparation, peritoneal flap incision, peritoneal flap dissection, hernia dissection, mesh deployment, mesh fixation, peritoneal flap closure, and additional closure). An AI model was trained to automatically recognize surgical phases from videos. The relationship between phase duration and surgical skills were also evaluated. Results: A fourfold cross-validation was used to assess the performance of the AI model. The accuracy was 88.81 and 85.82%, in unilateral and bilateral cases, respectively. In unilateral hernia cases, the duration of peritoneal incision (p = 0.003) and hernia dissection (p = 0.014) detected via AI were significantly shorter for experts than for trainees. Conclusion: An automated surgical phase recognition system was established for TAPP using deep learning with a high accuracy. Our AI-based system can be useful for the automatic monitoring of surgery progress, improving OR efficiency, evaluating surgical skills and video-based surgical education. Specific phase durations detected via the AI model were significantly associated with the surgeons’ learning curve.
KW - Artificial intelligence
KW - Automatic surgical phase recognition
KW - Laparoscopic inguinal hernia repair
KW - Learning curve
UR - http://www.scopus.com/inward/record.url?scp=85129750231&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85129750231&partnerID=8YFLogxK
U2 - 10.1007/s10029-022-02621-x
DO - 10.1007/s10029-022-02621-x
M3 - Article
C2 - 35536371
AN - SCOPUS:85129750231
SN - 1265-4906
VL - 26
SP - 1669
EP - 1678
JO - Hernia : the journal of hernias and abdominal wall surgery
JF - Hernia : the journal of hernias and abdominal wall surgery
IS - 6
ER -