OP, you fail to grasp that your "higher self" is not your extension, but you arean extension, or an organ (like snail has extended eyes), of your higher self.

the shit you think you need to remember when you - just a replaceable organ really - dies here, is totally unimportant.

don't worry, the important of it, the high-level feelings, experiences, that stays.

those are not stored in your brain, for your brain is for most part just an advanced antenna connected to your higher self brain.

try to focus your inner eye into your inner world from time to time, you will not be so freaked out.