Its harder than that. They have to prove you knew at that time. You can absolutely temporarily forget things.
Which is why the trump documents case was such a crazy case. We litterally have a conversation of him with a journalist saying "I have these documents, I can't declassify them now, and I know it's illegal for me to have them". Fucker should have gone to jail, it does not get more dead to rights than that.