Tackling the Data Sourcing Problem in Construction Procurement Using File-Scraping Algorithms

• Tipo: Artigo em Revista Científica Internacional
• Data: 2023-10-26

Autores

Luís Jacques de Sousa (Autor) FEUP; João Poças Martins (Autor) FEUP; Luís Sanhudo (Autor) Outra

Revista

Título: Engineering proceedings

Vol. 53

ISSN: 2673-4591

Indexação

Scopus - 0 Citações

Outras Informações

ID Authenticus: P-00Z-BDT

DOI: 10.3390/iocbd2023-15190

Abstract (EN): The Architecture, Engineering and Construction (AEC) sector has a lower adoption rate of machine learning (ML) tools than other industries with similar characteristics. A significant contributing factor to this lower adoption rate is the limited availability of data, as ML techniques rely on large datasets to train algorithms effectively. However, the construction process generates substantial data that provide detailed characterisation of a project. In this regard, this paper presents a data-scraping algorithm to search construction procurement repositories systematically to develop an ML-ready dataset for training data for ML and natural language processing (NLP) algorithms focused on construction¿s procurement phase. This tool automatically scrapes procurement repositories, developing a procurement file dataset comprisffing bills of quantities (BoQs) and project specifications.

Idioma: Inglês

Tipo (Avaliação Docente): Científica