ESAD: Endoscopic Surgeon Action Detection dataset


In this work, we take aim towards increasing the effectiveness of surgical assistant robots. We intended to make assistant robots safer by making them aware about the actions of surgeon, so it can take appropriate assisting actions. In other words, we aim to solve the problem of surgeon action detection in endoscopic videos. To this, we introduce a challenging dataset for surgeon action detection in real world endoscopic videos. Action classes are picked based on the feedback of surgeons and annotated by medical professional. Given a video frame, we draw bounding box around surgical tool which is performing action and label it with action label. Finally, we present a frame-level action detection baseline model based on recent advances in object detection. Results on our new dataset show that our presented dataset provides enough interesting challenges for future method and it can serve as strong benchmark corresponding research in surgeon action detection in endoscopic videos.

DOI (Digital Object Identifier)

Permanent link to this resource: https://doi.org/10.48550/arXiv.2006.07164

Attached files


Singh Bawac, Vivek
Singh, Gurkit
Kaping’A, Francis
Skarga-Bandurova, Inna
Leporini, Alice
Landolfo, Carmela
Stabile, Armando
Setti, Franesco
Muradore, Riccardo
Oleari, Elettra
Cuzzolin, Fabio

Oxford Brookes departments

School of Engineering, Computing and Mathematics


Year of publication: 2022
Date of RADAR deposit: 2022-07-08


Related resources

This RADAR resource is Identical to ESAD: Endoscopic Surgeon Action Detection dataset


  • Owner: Joseph Ripp
  • Collection: Outputs
  • Version: 1 (show all)
  • Status: Live
  • Views (since Sept 2022): 371