Automatic Summarization of Activities Depicted in Instructional Videos by Use of Speech Analysis
Existing activity recognition based assistive living solutions have adopted a relatively rigid approach to modelling activities. To address the deficiencies of such approaches, a goal-oriented solution has been proposed that will offer a method of flexibly modelling activities. This approach does, however, have a disadvantage in that the performance of goals may vary hence requiring differing video clips to be associated with these variations. In order to address this shortcoming, the use of rich metadata to facilitate automatic sequencing and matching of appropriate video clips is necessary. This paper introduces a mechanism of automatically generating rich metadata which details the actions depicted in video files to facilitate matching and sequencing. This mechanism was evaluated with 14 video files, producing annotations with a high degree of accuracy.
Citation : Rafferty, J. et al. (2014) Automatic Summarization of Activities Depicted in Instructional Videos by Use of Speech Analysis. The 6th International Work-conference on Ambient Assisted Living (IWAAL2014), Lecture Notes in Computer Science LNCS No.8868, pp.123-130
ISBN : 9783319131047
Research Institute : Cyber Technology Institute (CTI)
Peer Reviewed : Yes