Activity classification using accelerometers and machine learning for complex construction worker activities

• Type: Article in International Scientific Journal
• Date: 2021

Authors

Luís Sanhudo (Author) Other; Diego Calvetti (Author) FEUP; João Poças Martins (Author) FEUP; Nuno Ramos (Author) FEUP; Pedro Mêda (Author) Other; Miguel Chichorro Gonçalves (Author) FEUP; Hipólito Sousa (Author) FEUP

Journal

The Journal is awaiting validation by the Administrative Services.

Title: JOURNAL OF BUILDING ENGINEERING

Vol. 35

Pages: 1-16

ISSN: 2352-7102

Publisher: Elsevier

Indexing

ISI Web of Knowledge - 15 Citations

Scopus - 33 Citations

Other information

Authenticus ID: P-00T-221

DOI: 10.1016/j.jobe.2020.102001

Abstract (EN): Automated Construction worker activity classification has the potential to not only benefit the worker performance in terms of productivity and safety, but also the overall project management and control. The activity-level knowledge and indicators that can be extracted from this process may support project decision making, aiding in project schedule adjustment, resource management, construction site control, among others. Previous works on this topic focused on the collection and classification of worker acceleration data using wearable accelerometers and supervised machine learning algorithms, respectively. However, most of these studies tend to consider small sets of activities performed in an instructed manner, which can lead to higher accuracy results than those expected in a real construction scenario. To this end, this paper builds on the results of these past studies, committing to expand this discussion by covering a larger set of complex Construction activities than the current state-of-the-art, while avoiding the need to instruct test subjects on how and when to perform each activity. As such, a Machine Learning methodology was developed to train and evaluate 13 classifiers using artificial features extracted from raw accelerometer data segments. An experimental study was carried out under the form of a realistic activity-circuit to recognise ten different activities: gearing up; hammering; masonry; painting; roughcasting; sawing; screwing; sitting; standing still; and walking; with most activities being a cluster of simpler tasks (i.e. masonry includes fetching, transporting, and laying bricks). Activities were initially separated and tested in three different activity groups, before assessing all activities together. It was found that a segment length of 6 s, with a 75% overlap, enhanced the classifier performance. Feature selection was carried out to speed the algorithm running time. A nested cross-validation approach was performed for hyperparameter tuning and classifier training and testing. User-dependent and -independent approaches (differing in whether the system must undergo an additional training phase for each new user) were evaluated. Results indicate that accelerometers can be used to create a robust system to recognise large sets of Construction worker activities automatically. The K-Nearest Neighbours and Gradient Boosting algorithms were selected according to their performances, respectively, for the user-dependent and -independent scenarios. In both cases, the classifiers showed balanced accuracies above 84% for their respective approaches and test groups. Results also indicate that a user-dependent approach using task groups provides the highest accuracy.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 16