Abstract
The hallmark of episodic memory is recollecting multiple perceptual details tied to a specific spatial-temporal context. To remember an event, it is therefore necessary to integrate such details into a coherent representation during initial encoding. Here we tested how the brain encodes and binds multiple, distinct kinds of features in parallel, and how this process evolves over time during the event itself. We analyzed data from 27 human subjects (16 females, 11 males) who learned a series of objects uniquely associated with a color, a panoramic scene location, and an emotional sound while fMRI data were collected. By modeling how brain activity relates to memory for upcoming or just-viewed information, we were able to test how the neural signatures of individual features as well as the integrated event changed over the course of encoding. We observed a striking dissociation between early and late encoding processes: left inferior frontal and visuo-perceptual signals at the onset of an event tracked the amount of detail subsequently recalled and were dissociable based on distinct remembered features. In contrast, memory-related brain activity shifted to the left hippocampus toward the end of an event, which was particularly sensitive to binding item color and sound associations with spatial information. These results provide evidence of early, simultaneous feature-specific neural responses during episodic encoding that predict later remembering and suggest that the hippocampus integrates these features into a coherent experience at an event transition.SIGNIFICANCE STATEMENT Understanding and remembering complex experiences are crucial for many socio-cognitive abilities, including being able to navigate our environment, predict the future, and share experiences with others. Probing the neural mechanisms by which features become bound into meaningful episodes is a vital part of understanding how we view and reconstruct the rich detail of our environment. By testing memory for multimodal events, our findings show a functional dissociation between early encoding processes that engage lateral frontal and sensory regions to successfully encode event features, and later encoding processes that recruit hippocampus to bind these features together. These results highlight the importance of considering the temporal dynamics of encoding processes supporting multimodal event representations.