It happens to me all the time. Watching an old movie I like is refreshing b/c of this reason. DW is much better at it. She remembers more of the plot, scenes, etc..
Am currently watching the original Star Trek series which I watched it many times before. There are few episodes which take me a while to remember I watched it before.