Grad-CAM: The impact of large receptive fields and other caveats

• Type: Article in International Scientific Journal
• Date: 2025

Authors

Santos, R (Author) Other; Pedrosa, J (Author) Other; Ana Maria Mendonça (Author) FEUP; Aurélio Campilho (Author) FEUP

Journal

Title: Computer Vision and Image Understanding

Vol. 258

ISSN: 1077-3142

Publisher: Elsevier

Indexing

ISI Web of Knowledge - 6 Citations

Scopus - 7 Citations

Other information

Authenticus ID: P-018-RQB

DOI: 10.1016/j.cviu.2025.104383

Abstract (EN): The increase in complexity of deep learning models demands explanations that can be obtained with methods like Grad-CAM. This method computes an importance map for the last convolutional layer relative to a specific class, which is then upsampled to match the size of the input. However, this final step assumes that there is a spatial correspondence between the last feature map and the input, which may not be the case. We hypothesize that, for models with large receptive fields, the feature spatial organization is not kept during the forward pass, which may render the explanations devoid of meaning. To test this hypothesis, common architectures were applied to a medical scenario on the public VinDr-CXR dataset, to a subset of ImageNet and to datasets derived from MNIST. The results show a significant dispersion of the spatial information, which goes against the assumption of Grad-CAM, and that explainability maps are affected by this dispersion. Furthermore, we discuss several other caveats regarding Grad-CAM, such as feature map rectification, empty maps and the impact of global average pooling or flatten layers. Altogether, this work addresses some key limitations of Grad-CAM which may go unnoticed for common users, taking one step further in the pursuit for more reliable explainability methods.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 10