In fact theres evidence proving we actively and passively forget alot of information throughout the day, and this information dump of actively and passively forgetting things we deem unimportant, is precisely what allows us to learn. The balance between active forgetting during the day and memory consolidation during the night is what makes the brain so effective.
Fast-reverse memory replay reminds me of how eligibility traces and TD(lambda) in reinforcement learning work, by updating the Q value of each past visited state after receiving a reward in the "current" state, and how the reward filters back essentially in reverse order of visitation. Obviously it's not at all the same, but it's cool how even though TD(lambda) wasn't created with this biological process in mind, it still forms a loose analogue to how the "real thing" works.
Hey Artem, I just wanted to say that I absolutely love the content you make, specially the videos about specific neuroscience topics. Please never stop!! :)
I like how Artem had 9k while asking us to follow and now he has gotten ~x10 times more. He will grow to the million. This channel and the content is brilliant. Doing Quantum AI + theoretical physics related research right now. It is funny how biology inspires new models in AI a lot. Keep it up! Greetings by a Saint Petersburg’s 🇷🇺physicist from Brazil 🇧🇷🙌🏼
I had no idea the hippocampus was doing that while we were sleeping. I knew we had memory consolidation during REM, but not this hippocampal cell spiking. This is so fascinating wow. My god 😮
Reinforcement learning ends up recording events and processing them backwards because it's easier to compute the Bellman equation that way. Now I learn the brain already does that. Amazing!
This is such a fascinating topic, and I had never heard of the reverse order replay that you explained. Just an excellent video and explanation! Your animations are beautiful. By the way, I also make neuroscience videos so if you would ever be interested in collaborating, let me know!
This was crazy. Reminds me of a book by Eric Kandel: 'In search of memory' where he discussed the role of the hippocampus in memory. Also coincides with Jordan Peterson × Huberman Interview recently where they talked about the hippocampus when it comes to "trying on" different potential versions of your self via imagination and through the prefrontal cortex.
Peterson and Huberman have brought stunning examples of paradigm-remodeling insights from the neuroscience frontier to the layman. They have helped me with real practical problems as well as making the study field so much more engaging.
I wonder... If the reverse play is to learn what behavior led to either a positive or negative reinforcement event. Like the birds in Skinner's box, desperately trying to figure out what made the food come out, begin to show "superstitions" and repeat all sorts of odd behaviors (like turning around to the left, for example) in hopes of triggering a new feeding. It makes sense to me that it would be examined in reverse in order to suss out what behavior led to the positive or negative event in order to either suppress or reinforce those behaviors.
Omg this was amazingly exciting and done exceptionally ❤ One question: does the brain send those “reverse replay packages” during memory consolidation process only during specific phases of sleep?
If forwards is sensory sending stuff to the hippocampus, and the backward replay memories are being sent out to the sensory organs. They may not be a reverse replay, but a regular replay.
"Trajectories the mouse was taking during the day at night recapitulate during the shark wave ripple. And that means that the same place cells were activated one atfer another as if representing the same trajectory only their order was reversed and the time scale of the entire thing was much smaller."
Very interesting video. If the hippocamal replay occurs during daytime, what is so special about sleep? My understanding is that information in short-term memory that is deemed as unimportant will be forgotten so sleep could hinder lessons just before sleep, on the other hand they also reinforce memories being encoded into long-term memory. Your thoughts?
It is hypothesized that forward awake replay is used for planning ahead whereas reverse awake replay is used for encoding valuable behavioral sequences since it mainly occurs when the animal encounters an unexpected reward. As for sleep replays, they are thought to serve information transfer from hippocampal-dependent episodic memory to cortex-dependent semantic memory. Contrary to what is said in the video, I believe the replay of sequences during sleep are usually in the forward order.
Very interesting question! For starters, sleep has other important functions as well, such as clearing metabolic waste products from the brain. As for memory consolidation, the frequency of the ripples is much larger during slow-wave sleep, than during waking. Also, during sleep the balance of various neurotransmitters (such as dopamine, noradrenaline, acetylcholine) is changed, which could potentially affect the "effectiveness" of the ripple, providing a special surrounding for upregulation of synapses But this is just my own thoughts. There are still a lot of blind spots in our knowledge on this matter 🙂
Brilliant explanation! Thank you. I have already subscribed to your channel. That was in mouse. The same thing happens in humans? Do we plan the future with Ripley waves when sleeping? thanks Hugo
Your voice is hard to understand, because of the reflection of your table into the mic. Try to get it closer to you or use a Lavalier microphone. Love your vids. Keep it coming :) ♥
Sounds exactly like Backpropagation. I have believed this the moment I learned how to write Neural networks and even named some of my Backprop functions simply " sleep(double _delta){ "
![I.N "HALLUCINATION" | [Stray Kids : SKZ-PLAYER]](http://i.ytimg.com/vi/n5B5q1Hwt_U/mqdefault.jpg)
Visit brilliant.org/ArtemKirsanov/ to get started learning STEM for free, and the first 200 people will get 20% off their annual premium subscription.
You are preaching to the converted :). Nice videos!
Do these phonominon have any direct connection to dreams?
Keep it going man. The quality is insane, you deserve more! Cheers from Italy
Mi associo
Mi associo anche io !
In fact theres evidence proving we actively and passively forget alot of information throughout the day, and this information dump of actively and passively forgetting things we deem unimportant, is precisely what allows us to learn. The balance between active forgetting during the day and memory consolidation during the night is what makes the brain so effective.
wow you're incredibly good at explaining such complex things
i've not understood these concepts until now
Fast-reverse memory replay reminds me of how eligibility traces and TD(lambda) in reinforcement learning work, by updating the Q value of each past visited state after receiving a reward in the "current" state, and how the reward filters back essentially in reverse order of visitation.
Obviously it's not at all the same, but it's cool how even though TD(lambda) wasn't created with this biological process in mind, it still forms a loose analogue to how the "real thing" works.
Hey Artem, I just wanted to say that I absolutely love the content you make, specially the videos about specific neuroscience topics. Please never stop!! :)
Ну наконец новый видос! Ты уже так вырос… Настоящий медиагигант!
Когда 100к подписоты отмечать позовёшь?
Роста тебе в этом ремесле!
I like how Artem had 9k while asking us to follow and now he has gotten ~x10 times more. He will grow to the million. This channel and the content is brilliant. Doing Quantum AI + theoretical physics related research right now. It is funny how biology inspires new models in AI a lot. Keep it up! Greetings by a Saint Petersburg’s 🇷🇺physicist from Brazil 🇧🇷🙌🏼
Your videos are so well made and informative. As someone who has recently entered neuroscience, you're a fantastic and enthusiastic teacher!
Man this channel is insane. Can't believe I'm watching this for free
You are the best divulgator, Artem. Greetings from a cognitive neuroscientist from the Canary Islands, Spain
I had no idea the hippocampus was doing that while we were sleeping. I knew we had memory consolidation during REM, but not this hippocampal cell spiking. This is so fascinating wow. My god 😮
Woah. This is awesome content. IDK how I found you, but please keep making this!
Thank you!
Reinforcement learning ends up recording events and processing them backwards because it's easier to compute the Bellman equation that way. Now I learn the brain already does that. Amazing!
This is such a fascinating topic, and I had never heard of the reverse order replay that you explained. Just an excellent video and explanation! Your animations are beautiful.
By the way, I also make neuroscience videos so if you would ever be interested in collaborating, let me know!
Your video content is amazing. Also you edit video like a professional. Smooth and subtle sounds with near perfect animation
Amazing content and great teacher, thank you so much for this ❤
PERFECT PROFESSOR.
Incredible work. My future self and I thank you for enriching our brains :)
Now to refine the notes I've taken!
Excellent job! As a neuroscientist myself I can say great work!
Cheers from turkey! Great video again!
Incredible video about a fascinating topic. Great work man, I love these learning videos.
Keep it up!
so it is time-reversed dynamics during our sleep, lit data, thank you for this information
Thanks for your great work.
Really love this channel. Zettel minimalist Obsidian combo really chaged my note taking life. Really greatfull
Thank you so much man.
this helped so much, thanks!
Super helpful and well explained, thank you ! :)
Great video, very good explanation! Would love to see more
This was crazy. Reminds me of a book by Eric Kandel: 'In search of memory' where he discussed the role of the hippocampus in memory. Also coincides with Jordan Peterson × Huberman Interview recently where they talked about the hippocampus when it comes to "trying on" different potential versions of your self via imagination and through the prefrontal cortex.
Peterson and Huberman have brought stunning examples of paradigm-remodeling insights from the neuroscience frontier to the layman. They have helped me with real practical problems as well as making the study field so much more engaging.
Your channel is great
I wonder... If the reverse play is to learn what behavior led to either a positive or negative reinforcement event. Like the birds in Skinner's box, desperately trying to figure out what made the food come out, begin to show "superstitions" and repeat all sorts of odd behaviors (like turning around to the left, for example) in hopes of triggering a new feeding. It makes sense to me that it would be examined in reverse in order to suss out what behavior led to the positive or negative event in order to either suppress or reinforce those behaviors.
Amazing Video! Keep it up! :)
Just found u and liking all the videos
me watching a video in the middle of the night about the importance of healthy sleep
Omg this was amazingly exciting and done exceptionally ❤ One question: does the brain send those “reverse replay packages” during memory consolidation process only during specific phases of sleep?
thank you for recovering Gyorgy Buszaki's work in such an accesible and entertaining way. Wich software do you use to create the animations?
It happened during the gap effect too, yes.
Why is it 4 am
Artem, in which sleep mode does this "ripple" activities occur? deep sleep, light sleep or rem sleep?
If forwards is sensory sending stuff to the hippocampus, and the backward replay memories are being sent out to the sensory organs.
They may not be a reverse replay, but a regular replay.
You rock!
"Trajectories the mouse was taking during the day at night recapitulate during the shark wave ripple. And that means that the same place cells were activated one atfer another as if representing the same trajectory only their order was reversed and the time scale of the entire thing was much smaller."
Lemme take a nap to remember what this video was about thx
[4:34] fast forward to picture of cute sleeping mouse :)
Super
Very interesting video. If the hippocamal replay occurs during daytime, what is so special about sleep?
My understanding is that information in short-term memory that is deemed as unimportant will be forgotten so sleep could hinder lessons just before sleep, on the other hand they also reinforce memories being encoded into long-term memory. Your thoughts?
It is hypothesized that forward awake replay is used for planning ahead whereas reverse awake replay is used for encoding valuable behavioral sequences since it mainly occurs when the animal encounters an unexpected reward. As for sleep replays, they are thought to serve information transfer from hippocampal-dependent episodic memory to cortex-dependent semantic memory. Contrary to what is said in the video, I believe the replay of sequences during sleep are usually in the forward order.
@@chibrax54 interesting, it seems as tho the direction of replay could be impacted by the perception of information received by the individual... 🤷♂️
Very interesting question!
For starters, sleep has other important functions as well, such as clearing metabolic waste products from the brain. As for memory consolidation, the frequency of the ripples is much larger during slow-wave sleep, than during waking. Also, during sleep the balance of various neurotransmitters (such as dopamine, noradrenaline, acetylcholine) is changed, which could potentially affect the "effectiveness" of the ripple, providing a special surrounding for upregulation of synapses
But this is just my own thoughts. There are still a lot of blind spots in our knowledge on this matter 🙂
Артём, а в каком университете ты работаешь?
I spend 7/10 in sleep, no memory to consolidate
So the fast forward replay does not contribute to memory consolidation as reverse one does?
how long should we sleep ?? is 3/4 hrs enough for sleep?
Brilliant explanation! Thank you. I have already subscribed to your channel. That was in mouse. The same thing happens in humans? Do we plan the future with Ripley waves when sleeping? thanks Hugo
Are there place cells encoding place cell sequences?
Hope your doing well Artem. Can we expect new content from you considering the blocking of social media in Russia?
Thanks! Totally!
As far as I know, RUclips is not planned to be blocked yet. And I have a VPN subscription just to be safe ;)
ya boy watching this after pulling an allnighter amd school starts in 1,5 hours :p damn
The replay goes in reverse order to allow back propagation.
yeah
Deja vu?
Your voice is hard to understand, because of the reflection of your table into the mic. Try to get it closer to you or use a Lavalier microphone. Love your vids. Keep it coming :) ♥
Is this a biological equivalent to backpropagation
Bro is in 47K now from 9K
Артёмка, сделай русские субтитры пж(
Me watching this at 3.50, feeling guilty for my morning self.
anyboday else woken up yo lucid state during reverse replay.
Is that why dreams are so weird? Because your brain signals are literally going in reverse?
Me, watching this video at 4am: 💀🤡
(no worries I will sleep after, I'm juste more productive at night)
You do know that there are people that only need 2 HOURS of sleep a day. Sleep all depends on the person
Reverse replay sounds like backpropagation
YOU spend 1/3.
I spend 1/2.
I wished the quality of the voice and the volume of it were better
Okay, memory. So the plants do think-! They sleep too. They’ve even got the DMT molecule we know to cause our vivid dreams.
A girl asked me once if I thought dogs think… I lost faith in humanity that day.
Кип ит гоинг, мен
I couldn't watch because of the post-production nauseation effect. Stop that.
💤
Sounds exactly like Backpropagation. I have believed this the moment I learned how to write Neural networks and even named some of my Backprop functions simply " sleep(double _delta){ "