Memory Lab Minnets åtkomlighet och tillförlitlighet Professor Mikael Johansson Institutionen för psykologi Lunds universitet Methodological approach Behavioral paradigms (experimental paradigms, standardized tests) Electrophysiological methods (EEG/ERP; time and frequency analyses) Structural and functional MRI Healthy subjects and patients with focal brain lesions or psychiatric disorders Transcranial direct current stimulation (tdcs) Animal studies (rodents) Eye-tracking Current team Inês Bramão, Roger Johansson Undergraduate and postgraduate students Collaborations Psychiatric Neuromodulation Unit, Lund University Cambridge University & Cardiff University, UK Saarland University & Konstanz University, Germany Stanford University, USA Prof Mikael Johansson, PhD - Lund University Everyone has a photographic memory, some just don't have film. Steven Wright Dear Photograph, I ll always remember my first fish. - Brian Thurman www.dearphotograph.com Minne och verklighet Konstruktion och rekonstruktion Minnet Korttids/ Långtids arbets Deklarativt (Explicit ) Minnets funktion Icke-deklarativt (Implicit ) Semantiskt Procedur Fakta, generell kunskap, språk, t ex: Vad heter Frankrikes huvudstad? Vad kan man göra med en hammare? Är marvilan ett svenskt ord? Vad betyder H2O? Färdigheter, t ex: Cykla Spela piano Perceptuellt Priming, underlättad bearbetning av sådant vi exponerats för tidigare, t ex: Identifikation Episodiskt Autobiografisk information om upplevda erfarenheter från en händelse bunden i tid och rum, t ex: Vad gjorde du igår kväll? Var parkerade du bilen i morse? Betingning Automatisk associativ inlärning, t ex Saliveringsreflex Event Segmentation Theory Event model DuBrow et al. (2017) Kurby & Zacks (2008) av en händelse Mentala tidsresor Tidsmaskinen Åtkomlighet Emotionella händelser 3 201 sco nsi Fra San
av en händelse Golden Gate? Episodiskt Simulerad perception Vov hund Multivariate pattern analysis (MVPA) hund Feature binding Pattern separation Hippocampus hund? hund? Pattern completion Wheeler et al., (2000). PNAS for reviews see Danker & Anderson (2010); Rissman & Wagner (2012); Rugg, Johnson, Park, & Uncapher (2008); Xue (2018) Åtkomlighet Åtkomlighet : t ex bearbetningsdjup, imagery Åtkomlighet är ledtrådsberoende Minnet gynnas av likhet mellan inkodnings- och framplockningssituationen Interna Externa Minnesspår Minnesspår Sinnestillstånd Extern miljö Åtkomliga vs tillgängliga Craik & Lockhart (1972) Tulving & Pearlstone (1966) EncodingRetrieval Overlap Encoding specificity principle Godden & Baddeley (1975) Transfer appropriate processing Morris, Bransford, & Franks (1977) Orienting focus Task requirement Visual Encoding-retrieval overlap promotes memory MVPA of transfer-appropriate processing Decoding MVPA Apple Apple Verbal State-dependent memory Context congruency Mood congruency Multivariate pattern analysis (MVPA) of high time-resolution oscillatory brain activity to assess spontaneously engaged processing during memory formation? Category-specific visual processing (cf. Jafarpour et al., 2014; Kaneshiro et al., 2015; Kurth-Nelson et al., 2015) Transfer-appropriate processing Transfer-appropriate processing Retrieval - Replay of category-specific visual processing from encoding covaries with episodic memory performance Replay is beneficial Transfer-appropriate processing r = -0.51 Replay is detrimental Transfer-inappropriate processing MVPA reveals category-specific visual processing during encoding, and later cortical reinstatement at retrieval. N = 36 (cf. Jafarpour et al., 2014; Kaneshiro et al., 2015; Kurth-Nelson et al., 2015) Bramão & Johansson (2018). eneuro Bramão & Johansson (2018). eneuro Bramão & Johansson (2018). eneuro
Apple Orienting focus Task requirement Perception imagery Perception Mental föreställning Mental föreställning aktiverar huvudsakligen samma områden som perception Visual Verbal Cost Ganis et al., (2004). Cognitive Brain Research Encoding-retrieval overlap promotes memory Bramão, Karlsson, & Johansson (2017). Cortex Bramão, Karlsson, & Johansson (2017). Cortex Relationen mellan ögonrörelser och episodiskt N = 32 Comparable benefits following mental reinstatement Bramão, Karlsson, & Johansson (2017). Cortex Bramão, Karlsson, & Johansson (2017). Cortex Tracking the mind s eye Ögonrörelser avslöjar sinnehåll! Funktionell roll? Johansson et al. (2006). Cognitive Science Spontana ögonrörelser 38 % Påstående Cykeln var till vänster om loket Fritt Sant / Falskt 1 2 Relevant 3 Mean proportion fixations 29 % 19 % 10 % 0 % Relevant 1st 2nd 3rd Johansson & Johansson (2014). Psychological Science
Konsekvenser ögonrörelser Ögonrörelser kan underlätta sframplockning! 73 % Minnesprestation 1 800 Svarstid (ms) Överlappande Påstående Cykeln var till vänster om loket Fritt Sant / Falskt Icke-överlappande 67 % 62 % 56 % 1 600 1 400 1 200 Cykeln var till vänster om loket 50 % 1 000 Överlappande Fritt Icke-överlappande Johansson & Johansson (2014). Psychological Science? Is an encoding-retrieval overlap always beneficial? Cost? Cost?? Eliminated benefit? Cost? Eliminated benefit? Cost? s depending on the context s diagnostic value? Cue-overload principle (Watkins & Watkins, 1975), fan effect (Anderson, 1974) Memory-as-discrimination (Nairne, 2002) s depending on the context s diagnostic value? Cue-overload principle (Watkins & Watkins, 1975), fan effect (Anderson, 1974) Memory-as-discrimination (Nairne, 2002) Bramão & Johansson (2016). Journal of Cognitive Neuroscience Memory accuracy Response latencies N = 25 Bramão & Johansson (2016). Journal of Cognitive Neuroscience Bramão & Johansson (2016). Journal of Cognitive Neuroscience Bramão & Johansson (2016). Journal of Cognitive Neuroscience?! Cost! INTERFERENCE s and costs depending on the context s diagnostic value Cue-overload principle (Watkins & Watkins, 1975), fan effect (Anderson, 1974) Memory-as-discrimination (Nairne, 2002) Systematiska förvrängningar Many people believe that memory When we remember something, works like recording device, but we're taking bits and pieces of decades of research has shown experience - sometimes from that s not the case. Memory is different times and places - and constructed and reconstructed. It s bringing it all together to construct more like a Wikipedia page what might feel like a recollection you can go change it, but but is actually a construction. so can other people. Vilseledande information Lagring
70 Minnet är känsligt för påverkan Vi konstruerar vår verklighet 65 60 km/h Film av bilolycka. Därefter frågan: How fast were the cars going when they -----smashed, collided, bumped, hit, contacted? 55 Lagring 50 Loftus and Palmer (1974) d he ed Sm as Co llid Bu Co nt a m Hi pe d t ct ed 45 Loftus and Palmer (1974) Minnesexperiment 834 Minnestest mörk stearin lampa sol blond dag värme advent låga sken tändsticka levande veke brinna paraffin Fri återgivning Free Recall Test.90 i) Fri återgivning? ii) Igenkänning värme banan ljus advent tjuv stearin Falska n GALLO 1.0 Brister i designen? Igenkänning Recognition Test Old Remember.80 Proportion of Words Memorera följande ord! ljus?.70 Related Lures.60.50.40.30 Studied Words.20.10 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 Position in Study List Studied Words t ex värme Related Lures Unrelated Lures ljus banan Kim Peek Rain Man Figure 1. The DRM illusion. Undergraduates studied several lists of 15 words for immediate free recall (left panel) or for a final old new recognition memory test with remember subjective judgments (right panel). The data are from Experiment 2 of Creating False Johansson (2002); Johansson & Stenberg (2002) Memories: Remembering Words Not Presented in Lists, by H. L. Roediger III and K. B. McDermott, 1995, Journal of Experimental Psychology: Learning, Memory, & Cognition, 21, pp. 803 814. Copyright 1995 by the American Psychological Association. Reprinted with permission. Roediger & McDermott (1995) amples of how the DRM illusion differs from autobiographical memories are cited. Memories for word lists are, by design, more constrained and less complex than autobiographical memories along many dimensions (e.g., personal relevance, emotional salience, perceptual details, social context, etc.). These differences limit any wholesale generalization from one phenomenon to the other. For example, the finding that DRM false memories are easy to create is not evidence that false autobiographical memories are common, just as the finding that more perceptually detailed DRM false memories are difficult to create is not evidence that detailed false autobiographical memories are rare. Too many factors differ across these phenomena for such overarching generalities. Setting aside the differences between the lab and life, researchers do assume that some of the principles uncovered with the DRM illusion apply more broadly. Otherwise, there would be little reason to do the research. As was argued by Roediger (1996), the DRM illusion informs our basic understanding of memory, just as visual illusions inform our understanding of perception. This research tradition embraces well-controlled laboratory tasks as an ideal method for developing theories (Banaji & Crowder, 1989). As a result, most DRM research has been focused on basic theoretical distinctions within cognitive psychology, with generalizability either assumed as a given or set aside to be figured out elsewhere. Within this research tradition, monolithic questions of generalizability such as whether the DRM illusion is rel- Vi minns händelser så som vi förstår dem! evant to false autobiographical memories are misguided. Instead, the appropriate questions to ask are what aspects of the DRM illusion are relevant to what aspects of au tobiographical memories. More specifically, researchers have advocated a process-oriented approach. Which mental processes do these phenomena have in common, and which are unique? In what ways are these commonalities important, and in what ways are they trivial? These questions are addressed in subsequent sections of this review. Before I delve into this research literature, however, the broader historical context of DRM research is briefly considered. The DRM illusion has had a large impact on memory research, and understanding why helps to put the research findings in perspective. The task s simplicity has caused some to question its generalizability, but somewhat ironically, this simplicity is one of the reasons that the task has been so successful. Impact: How DRM Changed Memory Research Roediger and McDermott s (1995) article is immensely popular, having been cited over 1,000 times. In the first decade following the article, the average rate of newly published DRM experiments was estimated as one experiment every 2 weeks (Gallo, 2006), and in the few years since then, citations have almost doubled. That is quite an impact by any standard, but why is this task so popular? What is new about it? DRM research has enhanced awareness of the fallible nature of memory. This impact is evident from coverage in Vilken är konsekvensen av att vi fantiserar och föreställer oss saker? Deklarativt (Explicit ) Semantiskt Fakta, generell kunskap, språk, t ex: Vad heter Frankrikes huvudstad? Vad kan man göra med en hammare? Är marvilan ett svenskt ord? Vad betyder H2O? Episodiskt Autobiografisk information om upplevda erfarenheter från en händelse bunden i tid och rum, t ex: Vad gjorde du igår kväll? Var parkerade du bilen i morse? Perception Mental föreställning Mental föreställning aktiverar huvudsakligen samma områden som perception Upprepad föreställning Äpple? Ökad risk för sfel Ganis et al., (2004). Cognitive Brain Research Föreställa sig handlingar Hjärnaktivitet vid mental föreställning predicerar senare sfel Upprepad föreställning Senare falska n Senare korrekt avvisade som fantiserade Har du brutit tandpetaren? Ökar risken för sfel Gonsalves & Paller (2002). Nature Neuroscience
Att skilja fantasi från verklighet Att skilja fantasi från verklighet PFC-MTL Prefrontala regioner Specifikation av ledtråd Gammalt - föreställt sig Gammalt - sett Nytt Övervakning Simons & Spiers (2003). Nat Rev Neurosci Johansson et al. (2003). Neuropsychologia PFC-MTL Mental föreställning aktiverar huvudsakligen samma områden som perception Bortträngda n Mental föreställning aktiverar huvudsakligen samma områden som perception Spend time imagining that you were sexually abused, without worrying about accuracy, proving anything, or having your ideas make sense ask yourself these questions: What time of day is it? Where are you? Indoors or outdoors? What kind of things are happening? Is there one or more people with you? then Who would have been likely perpetrators? When were you most vulnerable to sexual abuse in your life? Wendy Maltz (psykoterapeut) Simons & Spiers (2003). Nat Rev Neurosci förändrar t Retrograde amnesia Multiple Trace Theory Lagring Memory performance Hippocampus always involved in the retrieval and storage of episodic memories 80 60 40 Control Amnesia 20 0 Past Lesion Retrograde amnesia Present Anterograde amnesia e.g. Nadel & Moscovitch (1997) Hippocampal Competitive Trace Theory Yassa & Reagh (2013) 32 SCIENTIFIC AMERICAN MIND J a nu a r y/fe b r u a r y 2 01 2 2011 Scientific American Glömska och gynnsamma konsekvenser av repetition Hur når vi våra n? Minnesprestation är ledtrådsberoende 4:e repetitionen 3:e repetitionen 2:a repetitionen 1:a repetitionen Normal glömska Tid Minnesspår
Time (-200-2000 ms) Interferens en aktiverar ofta flera relaterade n Selektiv framplockning n trycks undan för att reducera interferens Inhibition n trycks undan för att reducera interferens Interferens Interferens sinducerad glömska sinducerad glömska Anderson et al. (1994). JEP:LMC Anderson et al. (1994). JEP:LMC Inhibitorisk kontroll Kan vi observera när framplockning leder till glömska? Dämpningen föregår framplockningen av det önskade t FRUKT Lite glömska Ki Selektiv framplockning Interferens DRYCK Anterior Electrodes Posterior Mycket glömska Alpha/Beta Power Soda Ingen interferens Dämpning (inhibition) Johansson et al. (2007). Cerebral Cortex Waldhauser et al. (2013). Journal of Neuroscience Inhibitorisk kontroll Motorinhibition Go/No-go Prefrontala cortex Stimulus Respons Stimulus Respons Medveten kontroll? Viljestyrd glömska? Viljestyrd Time to glömska? Fo Avbryta/undertrycka sframplockning? Kan vi glömma med viljekraft? Viljestyrd glömska Think/No-Think Paradigmet Minne Inlärning Think/No-Think Test Minnesframplockning Undertryckt sframplockning Minnesframplockning Deg-Salt Deg Deg (inhibitorisk kontroll) Minne Undertryckt sframplockning Vitamin-Citron Vitamin Vitamin Vila-Säng Vila Anderson & Greene (2001). Science Anderson & Greene (2001). Science Anderson et al. (2004) Science Undertryckt sframplockning - minus Minnesframplockning Ökad aktivitet - DLPFC/ VLPFC (BA 45/46) - ACC (BA 32) Minskad aktivitet - hippocampus (bilateralt) Selection is the very keel on which our mental ship is built. And in the case of memory its utility is obvious. If we remembered everything, we should on most occasions be as ill off as if we remembered nothing William James (1890) Glömska hjälper oss att minnas Emotion och
Dolcos et al. (2005) Johansson et al. (2004). Journal of Cognitive Neuroscience Emotion och Minnet Långtids Korttids/ arbets An impression may be so exciting emotionally as almost to leave a scar upon the cerebral tissues William James (1890) Deklarativt (Explicit ) Semantiskt Fakta, generell kunskap, språk, t ex: Vad heter Frankrikes huvudstad? Vad kan man göra med en hammare? Är marvilan ett svenskt ord? Vad betyder H2O? Episodiskt Autobiografisk information om upplevda erfarenheter från en händelse bunden i tid och rum, t ex: Vad gjorde du igår kväll? Var parkerade du bilen i morse? Icke-deklarativt (Implicit ) Procedur Färdigheter, t ex: Cykla Spela piano Perceptuellt Priming, underlättad bearbetning av sådant vi exponerats för tidigare, t ex: Identifikation Betingning Automatisk associativ inlärning, t ex Saliveringsreflex av en emotionell händelse Memory ERP memory effects Positive Negative Neutral Familiarity Recollection Cahill et al. (1996). PNAS Old New efter 1 år Emotion-induced memory enhancement Tunnel: t ex vapenfokus Visual cortex Visual cortex PFC PFC Hippocampus Hippocampus av en traumatisk händelse Pattern completion Pattern separation comm rc Sc CA1 Pattern completion Pattern separation CA3 mf DG pp fim input A A input A A output A output A A Pattern completion rc Pattern separation DG CA3 mf perforant path EC Stark et al. (2013)
Kheirbek et al. (2012) Dentate Gyrus - Neurogenesis Pattern Separation Övergeneralisering Kheirbek et al. (2012) Nostalgia was better in the old days Tack för er uppmärksamhet! Photo: Brian Thurman www.dearphotograph.com Dear Photograph, I ll always remember my first fish. Brian Thurman Svensson et al. (2015, 2016). Hippocampus