At the Core of Memory