When I die, what exactly is the "I" that returns to the universe?

Pantheists say we return to the whole. I want to be precise about what returns. My atoms, obviously, though they were only ever on loan. Not my memories, which are patterns in a brain that stops. Not my consciousness, unless someone here wants to argue for that. So is "return" just a nice word for "stop," or is there a sense in which something that was me continues to be part of the universe rather than just having been?