Best Frame Selection to Enhance Training Step Efficiency in Video-Based Human Action Recognition

• Tipo: Artigo em Revista Científica Internacional
• Data: 2022-02

Autores

Abdorreza Alavi Gharahbagh (Autor) Outra; Vahid Hajihashemi (Autor) Outra; Marta Campos Ferreira (Autor) FEUP; José J. M. Machado (Autor) FEUP; João Manuel R. S. Tavares (Autor) FEUP

Revista

Título: Applied Sciences

Vol. 85

Páginas: 1-1830

Editora: MDPI

Indexação

ISI Web of Knowledge - 10 Citações

ISI Web of Science

Scopus - 11 Citações

Classificação Científica

CORDIS: Ciências Tecnológicas

FOS: Ciências da engenharia e tecnologias

Projetos Associados

Safe Cities - Safe Cities - Inovação para Construir Cidades Seguras

Outras Informações

ID Authenticus: P-00W-3MG

DOI: 10.3390/app12041830

Abstract (EN): In recent years, with the growth of digital media and modern imaging equipment, the use of video processing algorithms and semantic film and image management has expanded. The usage of different video datasets in training artificial intelligence algorithms is also rapidly expanding in various fields. Due to the high volume of information in a video, its processing is still expensive for most hardware systems, mainly in terms of its required runtime and memory. Hence, the optimal selection of keyframes to minimize redundant information in video processing systems has become noteworthy in facilitating this problem. Eliminating some frames can simultaneously reduce the required computational load, hardware cost, memory and processing time of intelligent video-based systems. Based on the aforementioned reasons, this research proposes a method for selecting keyframes and adaptive cropping input video for human action recognition (HAR) systems. The proposed method combines edge detection, simple difference, adaptive thresholding and 1D and 2D average filter algorithms in a hierarchical method. Some HAR methods are trained with videos processed by the proposed method to assess its efficiency. The results demonstrate that the application of the proposed method increases the accuracy of the HAR system by up to 3% compared to random image selection and cropping methods. Additionally, for most cases, the proposed method reduces the training time of the used machine learning algorithm.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 12