Our usual stream of consciousness is also highly associative, however. Certain events in the present will remind us if past ones, for example, and sometimes our memory of the past will color present events.
Association or not, physically we will remember events in time, with present moments nealy following past ones. The psyche deals largely with associative processes, however, as it organizes events through association. Time as such has little meaning in that framework. Associations are tied together, so to speak, by emotional experience. In a large manner, the emotions defy time.