🧠 Mind-Reading Stable Diffusion Paper
HTML-код
- Опубликовано: 19 мар 2023
- A walkthrough of a recent research paper which had participants view images, and then reconstructed those images using Stable Diffusion and fMRI readings of the participants brains. This was made possible by excellent work from the Neural Scenes Dataset Team.
======= Links =======
High-resolution image reconstruction with latent diffusion models from human brain activity: www.biorxiv.org/content/10.11...
Neural Scenes Dataset: naturalscenesdataset.org/
Good intro to Neural Scenes Dataset: • 2021-02-11 Kendrick Kay
Yatharth's twitter: / reporterweather (get on it)
A nice diagram: / the_stable_diffusion_m...
======= Music =======
Music from freetousemusic.com
‘Butter’ by LuKremBo: • lukrembo - butter (roy...
‘Affogato’ by LuKremBo: • lukrembo - affogato (r... 
Наука
![Rich Dunk (Ft. DaBaby) - BIG DAWG [Official Video]](http://i.ytimg.com/vi/Pz2ewsSKAEM/mqdefault.jpg)
Freaking insane! Not only does this prove it's going to be possible to control stable diffusion by literally imagining, but it also implies we'll be able to record and watch our dreams.
Good luck with your NeuroLink BCI surgery!
In 5 years, we'll be able to watch our own dreams as if they're movies. Besides all the stuff that will be possible with this technology.
Really happy to see you cover this one! When I saw the news I was super skeptical, figuring there was some major gotcha they were cheating with to get such good results. For example I was positive they would have been feeding the text description to the model and only using the brain scan for the latent noise portion.
To see it explained and learn that this wasn't the case truly is impressive!
Thanks once again for providing an entertaining and informative vid on a fascinating topic!
Awesome vid. "Still frame from Full Metal Alchemist" made me cry tho.
I always thought of Stable Diffusion like this, the latent space steps looks like when you close your eyes and there's just noise on your mind... Mind blowing
this is why ai images look like images from your dreams.
Oh boi remember when this technology was in his infancy when someone claimed to do this with dreams and he had a very similar looking fold out 2d map of the brain 🧠 But the tech just wasn't there yet to produce images well
Now invert the process and give vision to blind people.
wait what? hahaha I don't think that's what this research is about
Holy smoke, never thought about that. One step closer to Matrix simulation
@koiboi if you would put the model inside the brain connected to the right parts of the brain Idk why it shouldn't work. (I am no brain expert tho)
@@kingpin4152 The optical nerve maybe ? Just guessing, i am a dumb compared to those genious researchers
The problem is that there is no way to activate specific cortical areas without electrodes. Brain surgery to insert electrodes is dangerous and electrodes dont integrate well into the brain for long times. It is possible to do in principle but very invasive. Fmri just reads indirectly oxygen consomption in brain voxels. Also keep in mind that some blind people have damaged visual cortices and perfect eyes, so not every blind person would be suitable. But still a possible outcome in the long run.
you have so many good vids explaining concepts, when will you do one on the basics about how the base stable diffusion actually works for beginners.
Thanks for the video, a bit harder to understand whats going on with this one! :)
Imagine training a model to use that reverse prediction method to substitute the human in RLHF so that linear model setup would be self training the base model with every creation it makes as an extension for stable diffusion.
Imagine predictor of text embedding and latent given MRI image is not linear but specifically crafted model with billions of parameters 😳
Hi man, can i ask you if does it possible exist a super computer that decoding the mind as we thinking?
What signifique predict, decodind and see the mind ?
So, i will grate for answer!!!
Thanks again
Cheers😮
Team Emad
point-e next ?
This is nuckin futs! Imagine if neuroscientists could use this to find out if you have brain damage.
All great, but that is not a screenshot from FMA, it's from One piece.
time to wear a colander hat .. for real
Like I needed an excuse
I'm impressed about doing brain activity to image mapping. However, image to brain activity mapping is overrated imho. Showing results that are better than random shows nothing. I bet you could train a pigeon to predict some voxels with accuracy that is better than random. Check, even if you predict all voxels randomly, there is a high possibility that you will still get some outliers that will show as "significantly better than random" from the statistical test. That's because of the sheer number of those voxels you are predicting.
Btw there was a study about training an ensemble of pigeons to predict cancer from a photo and they had pretty good results, better than the average doctor. So training pigeons is actually not as stupid as it may sound :P
Bahahaha thats so goood: www.google.com/amp/s/www.bbc.com/news/science-environment-34878151.amp
birds are smarter than you think
They can read your thoughts in real time. This is nothing new
You look exactly like my childhood family doctor. make of that what you will.
Oh yeah, I also wanted to tell you: you have measles
@@lewingtonn I thought I had ligma
@@RikkTheGaijin ligma balls
@@RikkTheGaijin LIGMA ? HMMMM WHAT'S THAT ?
This tech is crazy!
Can they read my thoughts now?
😂 Haha, don't worry! While this tech is indeed crazy, it's not quite at the level of reading minds... yet! So, for now, your thoughts are safe, and you can continue plotting world domination in peace! 😜🌍🔒
＼(º □ º l