Coding Exercise on Class Activation Maps

Ablation CAM: Gradient-free approach to GradCAM

Grad-CAM suffers from the problem of gradient saturation, which causes the backpropagated gradients to diminish and, therefore, adversely affects the quality of visualizations. Ablation-CAM is a gradient-free approach to GradCAM that avoids using gradients and, at the same time, produces high-quality CAMs.

Overview of GradCAM

Let’s assume that $\mathcal{F}_l \in \R^{h \times w}$ is the $l^{th}$ feature map obtained from the penultimate convolutional layer ($h$ and $w$ are the height and width of the feature map) and $\mathcal{F}_l(i,j)$ represents the activation of the $(i,j)^{th}$ neuron in the $l^{th}$ feature map (total $L$ ...