Dataset download: https://data.bris.ac.uk/data/dataset/2ite3tu1u53n42hjfh3886sa86
Each video has a different frame rate. The annotation files provide a synchronized timestamp between videos.
[root folder]/Synchronised_action_label.txt
Columns correspond to:
- subject_id <- Subject ID
- str_GoPro_ts <- Begin GoPro Timecode
- end_GoPro_ts <- End GoPro Timecode
- str_GoPro_frame <- Begin GoPro Frame Index
- end_GoPro_frame <- End GoPro Frame Index
- str_SMI_w_ts <- Begin SMI with eye Timecode
- end_SMI_w_ts <- End SMI with eye Timecode
- str_SMI_w_frame <- Begin SMI with eye Frame Index
- end_SMI_w_frame <- End SMI with eye Frame Index
- str_SMI_wo_ts <- Begin SMI without eye Timecode
- end_SMI_wo_ts <- End SMI without eye Timecode
- str_SMI_wo_frame <- Begin SMI without eye Frame Index
- end_SMI_wo_frame <- End SMI without eye Frame Index
- action_label <- Action (Subtask) Label
[root folder]/Synchronised_error_label.txt
- subject_id <- Subject ID
- str_GoPro_ts <- Begin GoPro Timecode
- end_GoPro_ts <- End GoPro Timecode
- str_GoPro_frame <- Begin GoPro Frame Index
- end_GoPro_frame <- End GoPro Frame Index
- str_SMI_w_ts <- Begin SMI with eye Timecode
- end_SMI_w_ts <- End SMI with eye Timecode
- str_SMI_w_frame <- Begin SMI with eye Frame Index
- end_SMI_w_frame <- End SMI with eye Frame Index
- str_SMI_wo_ts <- Begin SMI without eye Timecode
- end_SMI_wo_ts <- End SMI without eye Timecode
- str_SMI_wo_frame <- Begin SMI without eye Frame Index
- end_SMI_wo_frame <- End SMI without eye Frame Index
- error_label_main <- Error Label
- error_label_sub <- (concurrent) Error Label (-1 represents no concurrent error label)
- action_label <- Action (Subtask) Label associated with Action Segment
Frame-by-frame action label ground truths used for the online recognition section of the paper are contained in the frame_level_action_annotation directory.
Each participant has a file in the style: [ParcticipantNumber].frame_level_gt.txt
The file contains 2 columns:
frame_digit -> Frame number in GoPro Video
action_id -> Action (sub-task) Label for that frame
Action_annotation = {0:'assemble support', 1:'insert stake', 2:'insert support', 3:'insert support tab', 4:'instruction', 5:'pickup/open stakebag', 6:'pickup/open supportbag', 7:'pickup/open tentbag', 8:'pickup/place ventcover', 9:'place guyline', 10:'spread tent', 11:'tie top'}
Error_annotation = {0:'motor', 1:'misuse', 2:'order', 3:'failure', 4:'omit', 5:'search', 6:'correction', 7:'slow', 8:'repeat'}
Note, begin time codes for Omit and Order error annotations denote time when the error began.
End time codes for omission should not be used as omission is the absence of an action.
Ordering errors timecodes denotes the begin and end of the ongoing action, but the ordering error is about going out of sequence not duration.