Deep Learning-Based Segmentation, Action, and Phase Recognition in Laparoscopic Cholecystectomy: A Review
Review Article  ·  Published: 22 September 2026
Issue cover
Journal of Artificial Intelligence in Bioinformatics
Volume 2, Issue 2, 2026: 55-67
Review Article Open Access

Deep Learning-Based Segmentation, Action, and Phase Recognition in Laparoscopic Cholecystectomy: A Review

1 School of Computer Science and Technology, Donghua University, Shanghai 201620, China
2 Department of Computer Science, Iowa State University, Ames 50011, United States
3 Wuhan National Laboratory for Optoelectronics and School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan 430074, China
4 School of Automation, Central South University, Changsha 410083, China
5 Division of Industrial and Logistics Engineering Technology, Faculty of Engineering and Technology, King Mongkut's University of Technology North Bangkok, Rayong Campus, Rayong 21120, Thailand
These authors contributed equally to this work
* Corresponding Author: Hafsa Gulzar, [email protected]
Volume 2, Issue 2
You have full access to this open access article · CC BY 4.0 License

Article Information

Abstract

The integration of artificial intelligence into biomedical image analysis represents a paradigm shift in clinical decision support and surgical informatics. Laparoscopic cholecystectomy (LC) is a widely performed minimally invasive procedure but remains technically challenging due to limited visibility, anatomical variations, and the risk of complications such as bile duct injury. Artificial intelligence (AI), particularly deep learning (DL), has shown great potential for improving intraoperative understanding through automated surgical video analysis. This review summarizes recent advances in DL-based LC video analysis, focusing on semantic segmentation and surgical action or phase recognition. Existing approaches are categorized into convolutional neural networks (CNNs), transformer-based architectures, and hybrid spatio-temporal models. For segmentation, U-Net variants, DeepLab architectures, and vision transformers are reviewed for identifying anatomical structures and surgical instruments. For action and phase recognition, CNN-LSTM frameworks, 3D CNNs, and video transformers are discussed for modeling surgical workflows and temporal dependencies. We also summarize commonly used datasets, including Cholec80 and CholecSeg8k, and evaluation metrics such as Dice score, IoU, accuracy, and F1-score. Major challenges include data scarcity, inter-surgeon variability, domain shift, and real-time computational constraints. Future research should emphasize self-supervised learning, multi-modal fusion, and clinically explainable AI to improve robustness, generalizability, and real-world surgical deployment.

Graphical Abstract

Deep Learning-Based Segmentation, Action, and Phase Recognition in Laparoscopic Cholecystectomy: A Review

Keywords

laparoscopic cholecystectomy deep learning semantic segmentation surgical phase recognition surgical action recognition

Data Availability Statement

Data sharing is not applicable to this article as no new datasets were generated or analyzed; all datasets discussed are publicly available from their respective original sources.

Funding

This work was supported without any funding.

Conflicts of Interest

The authors declare no conflicts of interest.

AI Use Statement

The authors declare that no generative AI was used in the preparation of this manuscript.

Ethical Approval and Consent to Participate

Not applicable.

References

  1. Fernicola, A., Palomba, G., Capuano, M., De Palma, G. D., & Aprea, G. (2024). Artificial intelligence applied to laparoscopic cholecystectomy: what is the next step? A narrative review. Updates in Surgery, 76(5), 1655-1667.
    [CrossRef] [Google Scholar]
  2. Liao, W., Zhu, Y., Zhang, H., Wang, D., Zhang, L., Chen, T., ... & Ye, Z. (2025). Artificial intelligence-assisted phase recognition and skill assessment in laparoscopic surgery: a systematic review. Frontiers in Surgery, 12, 1551838.
    [CrossRef] [Google Scholar]
  3. Zhou, R., Wang, D., Zhang, H., Zhu, Y., Zhang, L., Chen, T., ... & Ye, Z. (2025). Vision techniques for anatomical structures in laparoscopic surgery: a comprehensive review. Frontiers in Surgery, 12, 1557153.
    [CrossRef] [Google Scholar]
  4. Corallino, D., Balla, A., Coletta, D., Pacella, D., Podda, M., Pronio, A., ... & Aldrighetti, L. (2025). Systematic review on the use of artificial intelligence to identify anatomical structures during laparoscopic cholecystectomy: a tool towards the future. Langenbeck's archives of surgery, 410(1), 101.
    [CrossRef] [Google Scholar]
  5. Gammulle, H., Chen, Y., Sridharan, S., Klein, T., & Fookes, C. (2023). Learning through guidance: knowledge distillation for endoscopic image classification. arXiv preprint arXiv:2308.08731.
    [CrossRef] [Google Scholar]
  6. Anteby, R., Horesh, N., Soffer, S., Zager, Y., Barash, Y., Amiel, I., ... & Klang, E. (2021). Deep learning visual analysis in laparoscopic surgery: a systematic review and diagnostic test accuracy meta-analysis. Surgical endoscopy, 35(4), 1521-1533.
    [CrossRef] [Google Scholar]
  7. Yousef, M., Aly, K. E., Ahmed, M., Ahmed, F. A., Al Jalham, K., & Balakrishnan, S. (2026). Bibliometric analysis of deep learning for surgical instrument segmentation, detection and tracking in minimally invasive surgery. Frontiers in Digital Health, 8, 1633888.
    [CrossRef] [Google Scholar]
  8. Maier-Hein, L., Vedula, S. S., Speidel, S., Navab, N., Kikinis, R., Park, A., ... & Jannin, P. (2017). Surgical data science for next-generation interventions. Nature Biomedical Engineering, 1(9), 691-696.
    [CrossRef] [Google Scholar]
  9. Levendovics, R., Levendovics, T., Kronreif, G., & Haidegger, T. (2024). Surgical data science: Emerging trends and future pathways. Recent Advances in Intelligent Engineering: Volume Dedicated to Imre J. Rudas’ Seventy-Fifth Birthday, 65-84.
    [CrossRef] [Google Scholar]
  10. Twinanda, A. P., Shehata, S., Mutter, D., Marescaux, J., De Mathelin, M., & Padoy, N. (2016). Endonet: a deep architecture for recognition tasks on laparoscopic videos. IEEE transactions on medical imaging, 36(1), 86-97.
    [CrossRef] [Google Scholar]
  11. Mascagni, P., Alapatt, D., Sestini, L., Altieri, M. S., Madani, A., Watanabe, Y., ... & Hashimoto, D. A. (2022). Computer vision in surgery: from potential to clinical value. npj Digital Medicine, 5(1), 163.
    [CrossRef] [Google Scholar]
  12. Pescio, M., Marzola, F., Distefano, G., Leoncini, P., Ammirati, C. A., Barontini, F., ... & Arezzo, A. (2026). Artificial intelligence in minimally invasive and robotic gastrointestinal surgery: Major applications and recent advances. Journal of Personalized Medicine, 16(2), 71.
    [CrossRef] [Google Scholar]
  13. Kitaguchi, D., Takeshita, N., Hasegawa, H., & Ito, M. (2022). Artificial intelligence‐based computer vision in surgery: Recent advances and future perspectives. Annals of gastroenterological surgery, 6(1), 29-36.
    [CrossRef] [Google Scholar]
  14. Wagner, M., Müller-Stich, B. P., Kisilenko, A., Tran, D., Heger, P., Mündermann, L., ... & Bodenstedt, S. (2023). Comparative validation of machine learning algorithms for surgical workflow and skill analysis with the HeiChole benchmark. Medical image analysis, 86, 102770.
    [CrossRef] [Google Scholar]
  15. Jin, Y., Li, H., Dou, Q., Chen, H., Qin, J., Fu, C. W., & Heng, P. A. (2020). Multi-task recurrent convolutional network with correlation loss for surgical video analysis. Medical image analysis, 59, 101572.
    [CrossRef] [Google Scholar]
  16. Demir, K. C., Schieber, H., Weise, T., Roth, D., May, M., Maier, A., & Yang, S. H. (2023). Deep learning in surgical workflow analysis: a review of phase and step recognition. IEEE Journal of Biomedical and Health Informatics, 27(11), 5405-5417.
    [CrossRef] [Google Scholar]
  17. Ali, S. (2022). Where do we stand in AI for endoscopic image analysis? Deciphering gaps and future directions. npj Digital Medicine, 5(1), 184.
    [CrossRef] [Google Scholar]
  18. Garrow, C. R., Kowalewski, K. F., Li, L., Wagner, M., Schmidt, M. W., Engelhardt, S., ... & Nickel, F. (2021). Machine learning for surgical phase recognition: a systematic review. Annals of surgery, 273(4), 684-693.
    [CrossRef] [Google Scholar]
  19. Hegde, S. R., Namazi, B., Iyengar, N., Cao, S., Desir, A., Marques, C., ... & Sankaranarayanan, G. (2024). Automated segmentation of phases, steps, and tasks in laparoscopic cholecystectomy using deep learning. Surgical endoscopy, 38(1), 158-170.
    [CrossRef] [Google Scholar]
  20. Siddique, N., Paheding, S., Elkin, C. P., & Devabhaktuni, V. (2021). U-net and its variants for medical image segmentation: A review of theory and applications. IEEE access, 9, 82031-82057.
    [CrossRef] [Google Scholar]
  21. Limon, D., Satish, V., Raghavan, N., Nguyen, P., & Rajesh, A. (2026). Artificial intelligence in surgery revisited: a 2025 guide to understanding and applying AI models in clinical practice. The American Surgeon™, 92(3), 687-697.
    [CrossRef] [Google Scholar]
  22. Hussain, S. M., Brunetti, A., Lucarelli, G., Memeo, R., Bevilacqua, V., & Buongiorno, D. (2022). Deep learning based image processing for robot assisted surgery: a systematic literature survey. IEEE Access, 10, 122627-122657.
    [CrossRef] [Google Scholar]
  23. Dick, L., Boyle, C. P., Skipworth, R. J., Smink, D. S., Tallentire, V. R., & Yule, S. (2024). Automated analysis of operative video in surgical training: scoping review. BJS open, 8(5), zrae124.
    [CrossRef] [Google Scholar]
  24. Li, Y., Zhao, Z., Li, R., & Li, F. (2024). Deep learning for surgical workflow analysis: a survey of progresses, limitations, and trends. Artificial Intelligence Review, 57(11), 291.
    [CrossRef] [Google Scholar]
  25. Tokuyasu, T., Iwashita, Y., Matsunobu, Y., Kamiyama, T., Ishikake, M., Sakaguchi, S., ... & Inomata, M. (2021). Development of an artificial intelligence system using deep learning to indicate anatomical landmarks during laparoscopic cholecystectomy. Surgical endoscopy, 35(4), 1651-1658.
    [CrossRef] [Google Scholar]
  26. King, A., Fowler, G. E., Macefield, R. C., Walker, H., Thomas, C., Markar, S., ... & Blencowe, N. S. (2025). Use of artificial intelligence in the analysis of digital videos of invasive surgical procedures: scoping review. BJS open, 9(4), zraf073.
    [CrossRef] [Google Scholar]
  27. Oktay, O., Schlemper, J., Folgoc, L. L., Lee, M., Heinrich, M., Misawa, K., ... & Rueckert, D. (2018). Attention u-net: Learning where to look for the pancreas. arXiv preprint arXiv:1804.03999.
    [CrossRef] [Google Scholar]
  28. Zhou, Z., Siddiquee, M. M. R., Tajbakhsh, N., & Liang, J. (2018). UNet++: A nested U-Net architecture for medical image segmentation. In Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support (pp. 3–11). Springer, Cham.
    [CrossRef] [Google Scholar]
  29. Grammatikopoulou, M., Sanchez-Matilla, R., Bragman, F., Owen, D., Culshaw, L., Kerr, K., Stoyanov, D., & Luengo, I. (2024). A spatio-temporal network for video semantic segmentation in surgical videos. International Journal of Computer Assisted Radiology and Surgery, 19(2), 375–382.
    [CrossRef] [Google Scholar]
  30. Bravo, A., Razzaq, S., Murari, M., Ahuja, A., Birchett, D., & Schumacher, L. (2026). Transformers in surgical artificial intelligence: A domain-stratified, study-level narrative review. JTCVS open, 101597.
    [CrossRef] [Google Scholar]
  31. Kolbinger, F. R., Rinner, F. M., Jenke, A. C., Carstens, M., Krell, S., Leger, S., Distler, M., Weitz, J., Speidel, S., & Bodenstedt, S. (2023). Anatomy segmentation in laparoscopic surgery: comparison of machine learning and human expertise – an experimental study. International Journal of Surgery, 109(10), 2962–2974.
    [CrossRef] [Google Scholar]
  32. El Boghdady, M., Temori, S., Khaireldin, D., Ewalds-Kvist, B., Ghazanfar, M. A., & Aroori, S. (2025). The role of artificial intelligence in enhancing safety assessment of laparoscopic cholecystectomy: a systematic review. HPB.
    [CrossRef] [Google Scholar]
  33. Czempiel, T., Paschali, M., Ostler, D., Kim, S. T., Busam, B., & Navab, N. (2021, September). Opera: Attention-regularized transformers for surgical phase recognition. In International conference on medical image computing and computer-assisted intervention (pp. 604-614). Cham: Springer International Publishing.
    [CrossRef] [Google Scholar]
  34. Eppler, M. B., Sayegh, A. S., Maas, M., Venkat, A., Hemal, S., Desai, M. M., ... & Goldenberg, M. G. (2023). Automated capture of intraoperative adverse events using artificial intelligence: a systematic review and meta-analysis. Journal of Clinical Medicine, 12(4), 1687.
    [CrossRef] [Google Scholar]
  35. Gao, X., Jin, Y., Long, Y., Dou, Q., & Heng, P. A. (2021, September). Trans-svnet: Accurate phase recognition from surgical videos via hybrid embedding aggregation transformer. In International conference on medical image computing and computer-assisted intervention (pp. 593-603). Cham: Springer International Publishing.
    [CrossRef] [Google Scholar]
  36. Ronneberger, O., Fischer, P., & Brox, T. (2015, October). U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention (pp. 234-241). Cham: Springer international publishing.
    [CrossRef] [Google Scholar]
  37. Alom, M. Z., Yakopcic, C., Hasan, M., Taha, T. M., & Asari, V. K. (2019). Recurrent residual U-Net for medical image segmentation. Journal of medical imaging, 6(1), 014006-014006.
    [CrossRef] [Google Scholar]
  38. Chen, L. C., Zhu, Y., Papandreou, G., Schroff, F., & Adam, H. (2018, September). Encoder-decoder with atrous separable convolution for semantic image segmentation. In European conference on computer vision (pp. 833-851). Cham: Springer International Publishing.
    [CrossRef] [Google Scholar]
  39. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., ... & Guo, B. (2021, October). Swin transformer: Hierarchical vision transformer using shifted windows. In 2021 IEEE/CVF international conference on computer vision (ICCV) (pp. 9992-10002). IEEE.
    [CrossRef] [Google Scholar]
  40. Madani, A., Namazi, B., Altieri, M. S., Hashimoto, D. A., Rivera, A. M., Pucher, P. H., ... & Alseidi, A. (2020). Artificial intelligence for intraoperative guidance: using semantic segmentation to identify surgical anatomy during laparoscopic cholecystectomy. Annals of surgery, 276(2), 363.
    [CrossRef] [Google Scholar]
  41. Silva, B., Oliveira, B., Morais, P., Buschle, L. R., Correia-Pinto, J., Lima, E., & Vilaca, J. L. (2022). Analysis of current deep learning networks for semantic segmentation of anatomical structures in laparoscopic surgery. In 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) (pp. 3502-3505). IEEE.
    [CrossRef] [Google Scholar]
  42. Khan, U., Nawaz, U., Qayyum, A., Baig, I., Alam, M., Ashraf, S., ... & Qadir, J. (2026). Surgical scene understanding in the era of foundation AI models: A comprehensive review. IEEE Access, 14, 137034-137089.
    [CrossRef] [Google Scholar]
  43. Bian, G. B., Peng, Y., Zhang, L., Li, J., & Li, Z. (2024, June). Algorithms in surgical action recognition: A survey. In 2024 IEEE International Conference on Real-time Computing and Robotics (RCAR) (pp. 366-371). IEEE.
    [CrossRef] [Google Scholar]
  44. Padoy, N. (2019). Machine and deep learning for workflow recognition during surgery. Minimally Invasive Therapy & Allied Technologies, 28(2), 82-90.
    [CrossRef] [Google Scholar]
  45. Guo, K., Tao, H., Zhu, Y., Li, B., Fang, C., Qian, Y., & Yang, J. (2023). Current applications of artificial intelligence-based computer vision in laparoscopic surgery. Laparoscopic, Endoscopic and Robotic Surgery, 6(3), 91-96.
    [CrossRef] [Google Scholar]
  46. Nwoye, C. I., Yu, T., Gonzalez, C., Seeliger, B., Mascagni, P., Mutter, D., ... & Padoy, N. (2022). Rendezvous: Attention mechanisms for the recognition of surgical action triplets in endoscopic videos. Medical Image Analysis, 78, 102433.
    [CrossRef] [Google Scholar]
  47. Batić, D., Holm, F., Özsoy, E., Czempiel, T., & Navab, N. (2024). EndoViT: pretraining vision transformers on a large collection of endoscopic images. International Journal of Computer Assisted Radiology and Surgery, 19(6), 1085-1091.
    [CrossRef] [Google Scholar]
  48. Liu, Y., Boels, M., Garcia-Peraza-Herrera, L. C., Vercauteren, T., Dasgupta, P., Granados, A., & Ourselin, S. (2025). LoViT: Long video transformer for surgical phase recognition. Medical Image Analysis, 99, 103366.
    [CrossRef] [Google Scholar]
  49. Chadebecq, F., Lovat, L. B., & Stoyanov, D. (2023). Artificial intelligence and automation in endoscopy and surgery. Nature Reviews Gastroenterology & Hepatology, 20(3), 171-182.
    [CrossRef] [Google Scholar]
  50. Rivas-Blanco, I., Perez-Del-Pulgar, C. J., Garcia-Morales, I., & Munoz, V. F. (2021). A review on deep learning in minimally invasive surgery. IEEE Access, 9, 48658-48678.
    [CrossRef] [Google Scholar]
  51. Jin, Y., Long, Y., Chen, C., Zhao, Z., Dou, Q., & Heng, P. A. (2021). Temporal memory relation network for workflow recognition from surgical video. IEEE Transactions on Medical Imaging, 40(7), 1911-1923.
    [CrossRef] [Google Scholar]
  52. Kadkhodamohammadi, A., Luengo, I., & Stoyanov, D. (2022). PATG: position-aware temporal graph networks for surgical phase recognition on laparoscopic videos. International Journal of Computer Assisted Radiology and Surgery, 17(5), 849-856.
    [CrossRef] [Google Scholar]
  53. Funke, I., Bodenstedt, S., Oehme, F., von Bechtolsheim, F., Weitz, J., & Speidel, S. (2019, October). Using 3D convolutional neural networks to learn spatiotemporal features for automatic surgical gesture recognition in video. In International conference on medical image computing and computer-assisted intervention (pp. 467-475). Cham: Springer International Publishing.
    [CrossRef] [Google Scholar]
  54. Seenivasan, L., Mitheran, S., Islam, M., & Ren, H. (2022). Global-reasoned multi-task learning model for surgical scene understanding. IEEE Robotics and Automation Letters, 7(2), 3858-3865.
    [CrossRef] [Google Scholar]
  55. Jin, Y., Dou, Q., Chen, H., Yu, L., Qin, J., Fu, C. W., & Heng, P. A. (2017). SV-RCNet: workflow recognition from surgical videos using recurrent convolutional network. IEEE transactions on medical imaging, 37(5), 1114-1126.
    [CrossRef] [Google Scholar]
  56. Yang, Z., Wen, J., Huang, D., Yang, A., Zhang, R., Ren, B., ... & Qin, N. (2025). Efficient segmentation of intraoperative anatomical landmarks in laparoscopic cholecystectomy based on deep learning. Computer Methods and Programs in Biomedicine, 109012.
    [CrossRef] [Google Scholar]
  57. Leifman, G., Golany, T., Rivlin, E., Khoury, W., Assalia, A., & Reissman, P. (2024). Real-time artificial intelligence validation of critical view of safety in laparoscopic cholecystectomy. Intelligence-Based Medicine, 10, 100153.
    [CrossRef] [Google Scholar]
  58. Murali, A., Alapatt, D., Mascagni, P., Vardazaryan, A., Garcia, A., Okamoto, N., ... & Padoy, N. (2023). The endoscapes dataset for surgical scene segmentation, object detection, and critical view of safety assessment: Official splits and benchmark. Scientific Data, 12.
    [CrossRef] [Google Scholar]
  59. Hong, W. Y., Kao, C. L., Kuo, Y. H., Wang, J. R., Chang, W. L., & Shih, C. S. (2020). Cholecseg8k: a semantic segmentation dataset for laparoscopic cholecystectomy based on cholec80. arXiv preprint arXiv:2012.12453.
    [CrossRef] [Google Scholar]
  60. Alabi, O., Toe, K. K. Z., Zhou, Z., Budd, C., Raison, N., Shi, M., & Vercauteren, T. (2025). Cholecinstanceseg: A tool instance segmentation dataset for laparoscopic surgery. Scientific Data, 12(1), 825.
    [CrossRef] [Google Scholar]
  61. Allan, M., Kondo, S., Bodenstedt, S., Leger, S., Kadkhodamohammadi, R., Luengo, I., ... & Speidel, S. (2020). 2018 robotic scene segmentation challenge. arXiv preprint arXiv:2001.11190.
    [CrossRef] [Google Scholar]
  62. Taha, A. A., & Hanbury, A. (2015). Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool. BMC medical imaging, 15(1), 29.
    [CrossRef] [Google Scholar]
  63. Czempiel, T., Paschali, M., Keicher, M., Simson, W., Feussner, H., Kim, S. T., & Navab, N. (2020, September). Tecno: Surgical phase recognition with multi-stage temporal convolutional networks. In International conference on medical image computing and computer-assisted intervention (pp. 343-352). Cham: Springer International Publishing.
    [CrossRef] [Google Scholar]
  64. Ramesh, S., Srivastav, V., Alapatt, D., Yu, T., Murali, A., Sestini, L., ... & Padoy, N. (2023). Dissecting self-supervised learning methods for surgical computer vision. Medical Image Analysis, 88, 102844.
    [CrossRef] [Google Scholar]
  65. Özsoy, E., Örnek, E. P., Eck, U., Czempiel, T., Tombari, F., & Navab, N. (2022, September). 4d-or: Semantic scene graphs for or domain modeling. In International conference on medical image computing and computer-assisted intervention (pp. 475-485). Cham: Springer Nature Switzerland.
    [CrossRef] [Google Scholar]
  66. Mascagni, P., Vardazaryan, A., Alapatt, D., Urade, T., Emre, T., Fiorillo, C., ... & Padoy, N. (2022). Artificial intelligence for surgical safety: automatic assessment of the critical view of safety in laparoscopic cholecystectomy using deep learning. Annals of surgery, 275(5), 955-961.
    [CrossRef] [Google Scholar]
  67. Van der Velden, B. H., Kuijf, H. J., Gilhuijs, K. G., & Viergever, M. A. (2022). Explainable artificial intelligence (XAI) in deep learning-based medical image analysis. Medical image analysis, 79, 102470.
    [CrossRef] [Google Scholar]
  68. Özsoy, E., Pellegrini, C., Bani-Harouni, D., Yuan, K., Keicher, M., & Navab, N. (2026). Specialized foundation models for intelligent operating rooms. NPJ Digital Medicine.
    [CrossRef] [Google Scholar]

Cite This Article

APA Style
Gulzar, H., Bilal, M., Nawaz, M. Z., Yaqub, M., & Bunterngchite, C. (2026). Deep Learning-Based Segmentation, Action, and Phase Recognition in Laparoscopic Cholecystectomy: A Review. Journal of Artificial Intelligence in Bioinformatics, 2(2), 55-67. https://doi.org/10.62762/JAIB.2026.698089
Export Citation
RIS Format
Compatible with EndNote, Zotero, Mendeley, and other reference managers
TY  - JOUR
AU  - Gulzar, Hafsa
AU  - Bilal, Muhammad
AU  - Nawaz, Muhammad Zubair
AU  - Yaqub, Muhammad
AU  - Bunterngchite, Chayut
PY  - 2026
DA  - 2026/09/22
TI  - Deep Learning-Based Segmentation, Action, and Phase Recognition in Laparoscopic Cholecystectomy: A Review
JO  - Journal of Artificial Intelligence in Bioinformatics
T2  - Journal of Artificial Intelligence in Bioinformatics
JF  - Journal of Artificial Intelligence in Bioinformatics
VL  - 2
IS  - 2
SP  - 55
EP  - 67
DO  - 10.62762/JAIB.2026.698089
UR  - https://www.icck.org/article/abs/JAIB.2026.698089
KW  - laparoscopic cholecystectomy
KW  - deep learning
KW  - semantic segmentation
KW  - surgical phase recognition
KW  - surgical action recognition
AB  - The integration of artificial intelligence into biomedical image analysis represents a paradigm shift in clinical decision support and surgical informatics. Laparoscopic cholecystectomy (LC) is a widely performed minimally invasive procedure but remains technically challenging due to limited visibility, anatomical variations, and the risk of complications such as bile duct injury. Artificial intelligence (AI), particularly deep learning (DL), has shown great potential for improving intraoperative understanding through automated surgical video analysis. This review summarizes recent advances in DL-based LC video analysis, focusing on semantic segmentation and surgical action or phase recognition. Existing approaches are categorized into convolutional neural networks (CNNs), transformer-based architectures, and hybrid spatio-temporal models. For segmentation, U-Net variants, DeepLab architectures, and vision transformers are reviewed for identifying anatomical structures and surgical instruments. For action and phase recognition, CNN-LSTM frameworks, 3D CNNs, and video transformers are discussed for modeling surgical workflows and temporal dependencies. We also summarize commonly used datasets, including Cholec80 and CholecSeg8k, and evaluation metrics such as Dice score, IoU, accuracy, and F1-score. Major challenges include data scarcity, inter-surgeon variability, domain shift, and real-time computational constraints. Future research should emphasize self-supervised learning, multi-modal fusion, and clinically explainable AI to improve robustness, generalizability, and real-world surgical deployment.
SN  - 3068-7535
PB  - Institute of Central Computation and Knowledge
LA  - English
ER  - 
BibTeX Format
Compatible with LaTeX, BibTeX, and other reference managers
@article{Gulzar2026Deep,
  author = {Hafsa Gulzar and Muhammad Bilal and Muhammad Zubair Nawaz and Muhammad Yaqub and Chayut Bunterngchite},
  title = {Deep Learning-Based Segmentation, Action, and Phase Recognition in Laparoscopic Cholecystectomy: A Review},
  journal = {Journal of Artificial Intelligence in Bioinformatics},
  year = {2026},
  volume = {2},
  number = {2},
  pages = {55-67},
  doi = {10.62762/JAIB.2026.698089},
  url = {https://www.icck.org/article/abs/JAIB.2026.698089},
  abstract = {The integration of artificial intelligence into biomedical image analysis represents a paradigm shift in clinical decision support and surgical informatics. Laparoscopic cholecystectomy (LC) is a widely performed minimally invasive procedure but remains technically challenging due to limited visibility, anatomical variations, and the risk of complications such as bile duct injury. Artificial intelligence (AI), particularly deep learning (DL), has shown great potential for improving intraoperative understanding through automated surgical video analysis. This review summarizes recent advances in DL-based LC video analysis, focusing on semantic segmentation and surgical action or phase recognition. Existing approaches are categorized into convolutional neural networks (CNNs), transformer-based architectures, and hybrid spatio-temporal models. For segmentation, U-Net variants, DeepLab architectures, and vision transformers are reviewed for identifying anatomical structures and surgical instruments. For action and phase recognition, CNN-LSTM frameworks, 3D CNNs, and video transformers are discussed for modeling surgical workflows and temporal dependencies. We also summarize commonly used datasets, including Cholec80 and CholecSeg8k, and evaluation metrics such as Dice score, IoU, accuracy, and F1-score. Major challenges include data scarcity, inter-surgeon variability, domain shift, and real-time computational constraints. Future research should emphasize self-supervised learning, multi-modal fusion, and clinically explainable AI to improve robustness, generalizability, and real-world surgical deployment.},
  keywords = {laparoscopic cholecystectomy, deep learning, semantic segmentation, surgical phase recognition, surgical action recognition},
  issn = {3068-7535},
  publisher = {Institute of Central Computation and Knowledge}
}

Article Metrics

Citations
Crossref
0
Scopus
0
Views
33
PDF Downloads
5

Publisher's Note

ICCK stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and Permissions

CC BY Copyright © 2026 by the Author(s). Published by Institute of Central Computation and Knowledge. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
Journal of Artificial Intelligence in Bioinformatics
Journal of Artificial Intelligence in Bioinformatics
ISSN: 3068-7535 (Online)
Portico
Preserved at
Portico