This makes it easy to get the current transform of a layer, and uses consistent naming everywhere. `Memory::layer_transforms` is now called `Memory::to_global`, because the old name was ambiguous (transform into what direction?)