Best Frame Selection to Enhance Training Step Efficiency in Video-Based Human Action Recognition

• Type: Article in International Scientific Journal
• Date: 2022-02

Authors

Abdorreza Alavi Gharahbagh (Author) Other; Vahid Hajihashemi (Author) Other; Marta Campos Ferreira (Author) FEUP; José J. M. Machado (Author) FEUP; João Manuel R. S. Tavares (Author) FEUP

Journal

Title: Applied Sciences

Vol. 17

Pages: 1-1830

Publisher: MDPI

Indexing

ISI Web of Knowledge - 10 Citations

ISI Web of Science

Scopus - 11 Citations

Scientific classification

CORDIS: Technological sciences

FOS: Engineering and technology

Associated Projects

Safe Cities - Safe Cities - Inovação para Construir Cidades Seguras

Other information

Authenticus ID: P-00W-3MG

DOI: 10.3390/app12041830

Abstract (EN): In recent years, with the growth of digital media and modern imaging equipment, the use of video processing algorithms and semantic film and image management has expanded. The usage of different video datasets in training artificial intelligence algorithms is also rapidly expanding in various fields. Due to the high volume of information in a video, its processing is still expensive for most hardware systems, mainly in terms of its required runtime and memory. Hence, the optimal selection of keyframes to minimize redundant information in video processing systems has become noteworthy in facilitating this problem. Eliminating some frames can simultaneously reduce the required computational load, hardware cost, memory and processing time of intelligent video-based systems. Based on the aforementioned reasons, this research proposes a method for selecting keyframes and adaptive cropping input video for human action recognition (HAR) systems. The proposed method combines edge detection, simple difference, adaptive thresholding and 1D and 2D average filter algorithms in a hierarchical method. Some HAR methods are trained with videos processed by the proposed method to assess its efficiency. The results demonstrate that the application of the proposed method increases the accuracy of the HAR system by up to 3% compared to random image selection and cropping methods. Additionally, for most cases, the proposed method reduces the training time of the used machine learning algorithm.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 12