Tackling the Data Sourcing Problem in Construction Procurement Using File-Scraping Algorithms

• Type: Article in International Scientific Journal
• Date: 2023-10-26

Authors

Luís Jacques de Sousa (Author) FEUP; João Poças Martins (Author) FEUP; Luís Sanhudo (Author) Other

Journal

Title: Engineering proceedings

Vol. 53

ISSN: 2673-4591

Indexing

Scopus - 0 Citations

Other information

Authenticus ID: P-00Z-BDT

DOI: 10.3390/iocbd2023-15190

Abstract (EN): The Architecture, Engineering and Construction (AEC) sector has a lower adoption rate of machine learning (ML) tools than other industries with similar characteristics. A significant contributing factor to this lower adoption rate is the limited availability of data, as ML techniques rely on large datasets to train algorithms effectively. However, the construction process generates substantial data that provide detailed characterisation of a project. In this regard, this paper presents a data-scraping algorithm to search construction procurement repositories systematically to develop an ML-ready dataset for training data for ML and natural language processing (NLP) algorithms focused on construction¿s procurement phase. This tool automatically scrapes procurement repositories, developing a procurement file dataset comprisffing bills of quantities (BoQs) and project specifications.

Language: English

Type (Professor's evaluation): Scientific