Memory Encoding Model

Understand

We explore a new class of brain encoding model by adding memory-related information as input.

• Memory is an essential brain mechanism that works alongside visual stimuli.
• During a vision-memory cognitive task, we found the non-visual brain is largely predictable using previously seen images.
• Our Memory Encoding Model (Mem) won the Algonauts 2023 visual brain competition even without model ensemble (single model score 66.8, ensemble score 70.8).