Verbalizing Activation Differences with Natural Language Autoencoders
We tested if natural language autoencoders still work outside the setting they were trained for. By and large they do: they compose analogies, transfer to light finetunes, and recover a concealed secret word from activation differences alone.