Nick Cammarata Challenges Superposition Explanations in Neural Network Interpretability
Nick Cammarata’s Neural Networks Are Already Clean argues that improved observation tools reveal coherent neuron functions, reporting clear interpretations for 99%–100% of final-layer neurons in tested modern vision models. He reinterprets classic examples of apparently unrelated features as geometric detection or recursive generalization. Neel Nanda counters that these findings do not resolve representational superposition in language models and defends SAE applications. Cammarata describes the proposal as a working hypothesis, acknowledging gaps in language-model training evidence, multimodal coverage, and causal validation.