Automatic Description of Research Images: Utopia or Reality?

• Type: Article in International Conference Proceedings Book
• Date: 2024

Authors

Carla Teixeira Lopes (Author) FEUP; Joana Rodrigues (Author) FEUP

Conference proceedings International

Title: METADATA AND SEMANTIC RESEARCH, MTSR 2023

Pages: 205-212

17th Research Conference on Metadata and Semantic Research (MTSR)

Milan, ITALY, OCT 25-27, 2023

Indexing

ISI Web of Knowledge - 0 Citations

Scopus - 0 Citations

Other information

Authenticus ID: P-016-T1R

DOI: 10.1007/978-3-031-65990-4_18

Abstract (EN): Data description is a fundamental step in Research Data Management (RDM). When it comes to images, the challenge is increased, as they have characteristics that differentiate them from other typologies. We conducted a study in which we obtained a set of 27 images described according to their content, by researchers of the projects where they are inserted. After obtaining the ground-truth that would support the analysis, we proceeded to two more stages of description, one through an automatic processing tool (Vision AI) and the other through researchers with no knowledge of the images. We concluded that the human description is more elucidative of the images' content, namely at a semantic level. In turn, the automatic tools enhance a more literal description. This study allowed us to reflect on the description of images in a research context and to discuss the potential of formal analysis and analysis of the semantic expression of images.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 8