layerSVD Gemma 4 26B-A4B

tokens

concept activation heatmap · click to pin

rows = layers (L00 top → L29 bottom) · cols = K=64 right-singular vectors of the selected channel · cell color = activation magnitude at the current token chain markers · rings on the heatmap = same-channel shadows · off-channel shadows live in the side panel

concept chains