Outlier dimensions — fails to elevate → Default (neuron/residual-stream) basis baseline
It would be natural to expect that, because outlier dimensions carry disproportionate real information, the default-basis baseline should score above the random-directions floor on autointerpretability -- yet the paper checks this directly and reports the opposite: 'We do not find residual stream basis directions to be any more interpretable than random directions.' This sentence is placed immediately after the paper's discussion of outlier dimensions and Dettmers et al.'s evidence for a partial privileged basis, which reads as the authors pre-empting exactly this expectation. The result implies that outlier dimensions being information-bearing in the aggregate is not the same as the specific coordinates being interpretable one at a time -- the information may be real but still spread thinly across many polysemantic dimensions rather than concentrated in a legible way.