Synthesizing Human Activity for Data Generation

• Tipo: Artigo em Revista Científica Internacional
• Data: 2023

Autores

Romero, A (Autor) Outra; Pedro Carvalho (Autor) Outra; Luís Corte-Real (Autor) FEUP; Pereira, A (Autor) Outra

Revista

Título: Journal of Imaging

Vol. 9

Editora: MDPI

Indexação

ISI Web of Knowledge - 0 Citações

Scopus - 0 Citações

Outras Informações

ID Authenticus: P-00Z-944

DOI: 10.3390/jimaging9100204

Abstract (EN): The problem of gathering sufficiently representative data, such as those about human actions, shapes, and facial expressions, is costly and time-consuming and also requires training robust models. This has led to the creation of techniques such as transfer learning or data augmentation. However, these are often insufficient. To address this, we propose a semi-automated mechanism that allows the generation and editing of visual scenes with synthetic humans performing various actions, with features such as background modification and manual adjustments of the 3D avatars to allow users to create data with greater variability. We also propose an evaluation methodology for assessing the results obtained using our method, which is two-fold: (i) the usage of an action classifier on the output data resulting from the mechanism and (ii) the generation of masks of the avatars and the actors to compare them through segmentation. The avatars were robust to occlusion, and their actions were recognizable and accurate to their respective input actors. The results also showed that even though the action classifier concentrates on the pose and movement of the synthetic humans, it strongly depends on contextual information to precisely recognize the actions. Generating the avatars for complex activities also proved problematic for action recognition and the clean and precise formation of the masks.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 16