The past is hidden somewhere outside the realm, beyond the reach of intellect, in some material object (in the sensation which that material object will give us) which we do not suspect.
The process of perception is not a simple matter of recording sensory data but involves the active organization of that data into meaningful patterns.