The answer all relates to how memory works during sleep. Dreams happen in the temporal lobes as in "short-term memory". The long term memory region, the Hippocampus doesn't allow information to flow in during sleep, but it actually lets information flow out.

Thus there is no transfer of dream memory from short-term to long-term centers during sleep. We wake up and it all fades from short-term memory.