It's so sad, man. I remember the few rare times I knew I was dreaming, but I slowly felt myself waking up and started to feel myself shift on the bed instead of moving in the dream.
So, AI Minecraft speedrun revolves around finding colours/patterns that look like required resources/places, rather than actually finding these places/resources. It's so absurd yet so interesting.
@@LucasFerreira-fp4nj I meant playing it like Minecraft (mining, crafting, looting, farming) is useless because when you do a 360 flip everything is replaced. Like at the very least other AI generative stuff you could maybe see as a (worse, poorer quality) version of the 'real thing', but this is more 'the backrooms' than it is 'minecraft'
@@adventofnullIt's also in its infancy, and is already amazing if you understand how it works. I'm baffled at how they managed to make it this coherent. It really should be even worse than this. Technology is getting crazy.
I specifically appreciate how they're trying to be descriptive, but since it's like reality soup that generates based on the palette of the image, the best they can do is stuff like "We need this orange" "Lets try to see what we can do with the floor" "Hold onto this red" "They're trying to take away the nether from me"
I feel like if the AI was a little less sloppy and had a slightly longer memory, it could actually be amazing. Of course, it won't be actual Minecraft and probably never can be, but the idea of having to find red blocks to convert to lava to get to the nether is really interesting. As it is, it's too random to actually be enjoyable for more than a one-off gimmick, though. If the AI could remember, like, a couple hundred frames in the past, then it might be cool. It'd still allow for converting your surrondings based on blocks; you'd just need to stare at the blocks for a bit longer. A couple hundred frames, or however long the AI memory is.
@@kalahatze One solution I’d propose is a scenario-detection model that changes the dataset depending on certain recognized images, I.E. nether portal/end portal blocks. From that moment forward, the AI model switches from its overworld training to strictly Nether/End gameplay, preventing an accidental return from looking at the wrong color. Granted, implementing segmented diffusion defeats the purpose of this being purely a tech demo. But if you wanted to turn this into a game, that would be the next step. Signed, armchair programmer.
@HoodedSpidey You don't need segmented diffusion. This creates images frame by frame, at least as far as my understanding goes. Just switch to a different AI after a certain frame is complete. Use some kind of grounding dino model to recognize a nether portal, then for the next frame, you can change the AI or something. It actually seems fairly easy to do, although I'm not quite sure exactly how this works in detail. Edit: Actually, you don't even need a new dataset. Just use a LoRA.
@@kalahatze My main concern about just using a LoRA is that there may not be enough footage in the nether, and I worry about how it’ll affect the “rules” of Minecraft (it’s broken enough as is.) I do agree that we *probably* don’t need an entirely new dataset, however there should definitely be more footage to supplement things like portal ignition, traversing fortresses, gravitational acceleration, and mob behavior. Admittedly I didn’t even know about DINO models until now, It’s really cool to learn that most of the tech exists already & that it’d be simpler than I imagined. Thank you for being willing to talking to me despite my limited knowledge. I’ll be doing more research on all of this.
More like trying to control a semi-lucid dream. Once it's lucid it's pretty easy, but when you're in that weird state where you aren't quite sure if you're dreaming and haven't stabilized it, then shit gets weird.
Wild. Almost seems like they trained it on a lot of simpler short videos, and only a few contained nether, so while it knows what nether looks like, it wants to maintain the overworld look instead.
I mean while most content is in the overworld that doesnt really change the fact that not enough nether footage means the ai cant simulate anything BUT the overworld too well
This is such an interesting concept, the game is trying to gaslight them and they are trying to gaslight the game back, it's like a boss fight against the entire world
I tried playing this the other day and seriously all day I was going around feeling like everything was shifting around me and nothing was real. Real-life cognitohazard.
It most likely did not have enough training footage for the nether, so it did not understand the difference well enough and that's why it was trying to take the nether away
In this demo I suppose, they used footage with keys clicked at exact time as training data. They had to use nether footage, because this algorithm wouldn't be generating those images without it. It was most probably less frequent in dataset, therefore occured the effect of nether vanishing.
You and your friend's commentary is absolutely immaculate. The way you call out things like it's some kind of official speedrunning terminology is too good. "It's reddening!" "Orangification." "THEY'RE TRYING TO TAKE IT AWAY" "They can't take this away from me" "It's starting to turn to dirt.." You should do something fun, like crazy BS modpack reviews or such, like those terrible Minecraft horror mods. Something fun just reviewing absurd Minecraft things
My eyes have never hurt so much, but its crazy to think its at all possible to fuck with the AI and force it to not only create the Nether but potentially the End with the right conditions
What did this player dream? This player dreamed of sunlight and trees. Of fire and water. It dreamed it created. And it dreamed it destroyed. It dreamed it hunted, and was hunted. It dreamed of shelter. - Minecraft end credits
Do you though? It’s just that it goes off of fed data. A lot of the times it was fed lava was likely pictures in the nether. It just assumes what should be there based off of the conditions of whatever it was trained on.
Holy fucking shit, I ain’t ever seen anything like this. AI generated videos felt weird themselves, now we can play an real-time AI generating game? This is actually fascinating.
this has to be one of my favorite demonstrations of AI right now. Tricking the AI into thinking you're in a certain biome/Dimension by looking at the right blocks is such an interesting skill
This feels EXACTLY like how you try to keep a dream from changing to something else, the most tripping thing about minecraft ai is that it's the closest thing we have to actual dreams
this is essentially painting an image with the help of ai trained on minecraft data. this will never replace games, as games are a minimum list of instructions to produce a pre-designed animation
The AI constantly guessing where the speedrunners are, while the Speedrunners themselves are trying to guess what the AI will interpret is absolutely funny
It’s interesting because this AI has been trained on millions of videos, but only of mainly the first 5 minutes of Minecraft gameplay. So I doubt many had videos of getting to the nether or the end explaining the AI essentially panicking trying to bring him back to the overworld
This is just the trippiest thing ever! The way things appear and dissapear out of nowhere, the way you end up in a completely different place when you look away, the way when you trying to enter a house, but instead enter a realm of wooden blocks is just MIND BREAKING!
One of the sad things of how "AI" like this one works is that it doesn't really learn anymore after being deployed/published. It's like crystallized intelligence. The forms of AI that can continously learn are more expensive to run and may require dedicated brain-like circuit chips to be feasible. All of the above is just the vague impression I have gathered so far about "AI", I'm no expert.
Minecraft AI it's like that one dream that got so good but you wake up too soon so you got to lock in back to sleep to imagine what would happened next
Wow this is incredible tech. Imagine in the future you will be able to have unique game experiences based on your play style with artificial intelligence changing the game do your gameplay.
Ever since this got popular I’ve been waiting to see someone just spin around and look up and down to keep generating new landscapes until something cool happens. That would be the first thing I would do in this game
i love how you got diamond tools when you got the stronghold. it is 100% likely that most of the stronghold data used to train the plays had diamond tools.
It feels exactly like a dream. I know that's been said before, but trying to control dreams is exactly like this. Sometimes you just don't quite have the control powers to do it.
![[#2024MAMA] G-DRAGON - 무제(Untitled, 2014)+POWER+HOME SWEET HOME+뱅뱅뱅+FANTASTIC BABY | Mnet 241123 방송](http://i.ytimg.com/vi/Ox29z5Nf1Uk/mqdefault.jpg)
Holding onto the nether sounds like holding onto a dream when you know you're about to wake up.
It's so sad, man.
I remember the few rare times I knew I was dreaming, but I slowly felt myself waking up and started to feel myself shift on the bed instead of moving in the dream.
2hu
Saw this listening to Wake Up by Travis
“I DONT WANNA WAKE UP” 🗣️🔥🔥
holy shit thats so accurate.
HAKUREI REIMU??? 😰😰😰
Guys the CEO of racism is here
After decades of progress we finally got an unplayable version of Minecraft.
bedrock is pretty unplayable
@@DivineLight661 your face is unplayable
@@davebob4973my balls are
@DivineLight661 ur feet is unplayable
So bedrock edition
3:01
*Task completed:* "Get into the Nether"
*Current task:* "Stay in the Nether no matter what"
"95% of people cannot achieve that"
So, AI Minecraft speedrun revolves around finding colours/patterns that look like required resources/places, rather than actually finding these places/resources. It's so absurd yet so interesting.
It hallucinates things not only into existence but out of it, so trying to experience the AI like an actual 'game' is an effort in futility.
@@adventofnull what futility? This itself is already hella fun lmao
@@LucasFerreira-fp4nj I meant playing it like Minecraft (mining, crafting, looting, farming) is useless because when you do a 360 flip everything is replaced. Like at the very least other AI generative stuff you could maybe see as a (worse, poorer quality) version of the 'real thing', but this is more 'the backrooms' than it is 'minecraft'
@@adventofnullIt's also in its infancy, and is already amazing if you understand how it works. I'm baffled at how they managed to make it this coherent. It really should be even worse than this. Technology is getting crazy.
I specifically appreciate how they're trying to be descriptive, but since it's like reality soup that generates based on the palette of the image, the best they can do is stuff like
"We need this orange"
"Lets try to see what we can do with the floor"
"Hold onto this red"
"They're trying to take away the nether from me"
I have not yet heard a better descriptor for this than “Reality soup”. 😂
Reality soup as simulated by linear algebra soup
i love the references to the ethereal "they", as if there are little men inside the computer making the image shift
"they" want you to think that "they" aren't real
Bro fighting his own dementia 💀
The woke left is trying to take away our nether
It's obviously the Machine Spirit
@@Subird The machine spirit on this case being, ironically, non-binary
this is actually so cool, having to try to trick the game into generating what you want is so fun
I feel like if the AI was a little less sloppy and had a slightly longer memory, it could actually be amazing. Of course, it won't be actual Minecraft and probably never can be, but the idea of having to find red blocks to convert to lava to get to the nether is really interesting. As it is, it's too random to actually be enjoyable for more than a one-off gimmick, though. If the AI could remember, like, a couple hundred frames in the past, then it might be cool. It'd still allow for converting your surrondings based on blocks; you'd just need to stare at the blocks for a bit longer. A couple hundred frames, or however long the AI memory is.
*gaslight the game into thinking😂
@@kalahatze One solution I’d propose is a scenario-detection model that changes the dataset depending on certain recognized images, I.E. nether portal/end portal blocks.
From that moment forward, the AI model switches from its overworld training to strictly Nether/End gameplay, preventing an accidental return from looking at the wrong color. Granted, implementing segmented diffusion defeats the purpose of this being purely a tech demo. But if you wanted to turn this into a game, that would be the next step.
Signed, armchair programmer.
@HoodedSpidey You don't need segmented diffusion. This creates images frame by frame, at least as far as my understanding goes. Just switch to a different AI after a certain frame is complete. Use some kind of grounding dino model to recognize a nether portal, then for the next frame, you can change the AI or something. It actually seems fairly easy to do, although I'm not quite sure exactly how this works in detail.
Edit: Actually, you don't even need a new dataset. Just use a LoRA.
@@kalahatze My main concern about just using a LoRA is that there may not be enough footage in the nether, and I worry about how it’ll affect the “rules” of Minecraft (it’s broken enough as is.) I do agree that we *probably* don’t need an entirely new dataset, however there should definitely be more footage to supplement things like portal ignition, traversing fortresses, gravitational acceleration, and mob behavior.
Admittedly I didn’t even know about DINO models until now, It’s really cool to learn that most of the tech exists already & that it’d be simpler than I imagined. Thank you for being willing to talking to me despite my limited knowledge. I’ll be doing more research on all of this.
i love this shit lol, its like trying to control a lucid dream
more like trying to control a verifiably non-lucid dream
More like trying to control a semi-lucid dream. Once it's lucid it's pretty easy, but when you're in that weird state where you aren't quite sure if you're dreaming and haven't stabilized it, then shit gets weird.
Yeah fr@@famlrnamemssng
It's more like trying to control someone else's dream
Superliminal if it were a real dream
Don't let them take it from you. You worked hard for that nether.
*neither
@@DoctorAlrightwhat
@@DoctorAlright what
@@DoctorAlrightwhat
It is like telling a dementia patient to remember a specific memory they had (not that I have any experience with that).
gaslighting speedrun
Of course you hadn't, you didn't remember it
Beating Minecraft With Dementia
Is it even Possible?
Dementia craft
Wild. Almost seems like they trained it on a lot of simpler short videos, and only a few contained nether, so while it knows what nether looks like, it wants to maintain the overworld look instead.
Your intuition is actually 100% true
Nah it's definitely because most of Minecraft content and gameplay is in the overworld
I mean while most content is in the overworld that doesnt really change the fact that not enough nether footage means the ai cant simulate anything BUT the overworld too well
I’d guess that virtually all Minecraft content is overwold since most smps and guides are mostly there
3:37 That carrot casually turning into a yellow bed
Metamorphosis
They’re trying to take away our nether, we need to stop this
Make the nether great again
We are now unburdened by what has been
We need to build a wall and make the piglins pay for it
They're eating the ocelots
This is such an interesting concept, the game is trying to gaslight them and they are trying to gaslight the game back, it's like a boss fight against the entire world
Definitely not gaslighting lmao 🤣
@@xlretardstop gaslighting
I love the whole
0:30 these are vines
0:33 nevermind they're magma blocks congrats
0:39 what blocks
It looks like it interpreted the magma texture as the block break particles, so they just exploded.
2 Magma blocks: *Mr.* *Stark* *I* *don't* *feel* *so* *good.*
This is like an SCP entry about containing a cognitohazard
The nether is an antimeme
Genuinely yeah this seems like an unimaginable dimension the scp foundation would contain or something
@@WanderTheNomad there is no antimemetic division, there is no antimemetic division, there is a body in that water, there is no antimemetic division.
I tried playing this the other day and seriously all day I was going around feeling like everything was shifting around me and nothing was real. Real-life cognitohazard.
It most likely did not have enough training footage for the nether, so it did not understand the difference well enough and that's why it was trying to take the nether away
In this demo I suppose, they used footage with keys clicked at exact time as training data. They had to use nether footage, because this algorithm wouldn't be generating those images without it. It was most probably less frequent in dataset, therefore occured the effect of nether vanishing.
Me and my imaginary friend trying to beat minecraft in a lucid dream
Ok, that's the best use of ai: dream games. Like, make it a little less erratic, optimise it, remove the time limit and it's just gonna be so much fun
FRRRR
omg such an amazing idea
screw AI art. embrace near unplayable non euclidian versions of well known videogames
You and your friend's commentary is absolutely immaculate. The way you call out things like it's some kind of official speedrunning terminology is too good.
"It's reddening!"
"Orangification."
"THEY'RE TRYING TO TAKE IT AWAY"
"They can't take this away from me"
"It's starting to turn to dirt.."
You should do something fun, like crazy BS modpack reviews or such, like those terrible Minecraft horror mods. Something fun just reviewing absurd Minecraft things
0:33 geologists when an eruption occurs
Duh
LMAOOOOO
Minecraft manifestation speedrun
“lock in”
*manifests harder*
5:45 there was a stronghold to the left
i was going to say that
How speedruning minecraft on good zaza feels like :
Your zaza got laced with dmt bro
"Are you sure you want all of them? it's gonna make you very very high"
"Yes, all of them."
"See? this zaza ain't shi-"
This video feels revolutionary in terms of what's possible with this "game"
4:21 You guys almost made it to the end if you had just kept up with the obsidian pillars and the purple.
I love how the whole speed run is just tricking the AI into giving them what they want
"i think I'll be ok with this amount of acid, i won't lose control of my mind or anything"
My mind 1 hour in:
getting enchanted diamond tools is crazy
My eyes have never hurt so much, but its crazy to think its at all possible to fuck with the AI and force it to not only create the Nether but potentially the End with the right conditions
This AI really is amazing. You've really shown how to manipulate it to get to different areas of the game. Amazing video
What did this player dream?
This player dreamed of sunlight and trees. Of fire and water. It dreamed it created. And it dreamed it destroyed. It dreamed it hunted, and was hunted. It dreamed of shelter.
- Minecraft end credits
It dreamed of feeling like being on drugs while playing minecraft.
Someone make a mod where you can play ai generated minecraft while you sleep
I'm convinced the guy talking in the background is just schizophrenia
I think having good items (enchanted tools, etc) triggers more endgame stuff, like the fortress and the end
2:10 You would have to really understand how AI sees the world to achieve this.
Do you though? It’s just that it goes off of fed data. A lot of the times it was fed lava was likely pictures in the nether. It just assumes what should be there based off of the conditions of whatever it was trained on.
@@cancerousnut7767 turns into orange
Holy fucking shit, I ain’t ever seen anything like this. AI generated videos felt weird themselves, now we can play an real-time AI generating game? This is actually fascinating.
This perfect encapsulated the feeling of trying to cling to the memories of a dream as I wake slowly and try and finish the dream
this has to be one of my favorite demonstrations of AI right now. Tricking the AI into thinking you're in a certain biome/Dimension by looking at the right blocks is such an interesting skill
this is what chasing that drugged out sleep trip was like
This feels EXACTLY like how you try to keep a dream from changing to something else, the most tripping thing about minecraft ai is that it's the closest thing we have to actual dreams
The ai seems to be trained on mostly overworld footage,hence why when you go to the nether it just turns into overworld so quickly,same with the end
it's crazy that you're playing minecraft without any of the original code, nor a functional physics engine. it's just pictures
This is how i am when i am in the middle of a good dream and keep waking up
this is essentially painting an image with the help of ai trained on minecraft data. this will never replace games, as games are a minimum list of instructions to produce a pre-designed animation
It’s like a game with no internal memory. It’s just generating everything in real time and culling it once it’s no longer on screen
"ah we got some magma, we can use this we can use this-" *magma dematerializes* "AH D:"
This is like playing non-euclidian Minecraft while being on 10 different psychedelics.
Accurate portrayal of me learning how to control my lucid dreams for the first time
The AI constantly guessing where the speedrunners are, while the Speedrunners themselves are trying to guess what the AI will interpret is absolutely funny
The way you look into lava and wait until it becomes nether feels like a lucid dream
It’s interesting because this AI has been trained on millions of videos, but only of mainly the first 5 minutes of Minecraft gameplay.
So I doubt many had videos of getting to the nether or the end explaining the AI essentially panicking trying to bring him back to the overworld
I’ve been periodically getting sicker throughout the day. I have a feeling my dreams tonight are going to mirror this…
This feels like a psychic prediticing your minecraft speedrun
this feels like a dreamscape i fw it heavily
This was like watching a recording of a dream about minecraft.
This is like trying to cling to a dream instead of waking up
This is just the trippiest thing ever! The way things appear and dissapear out of nowhere, the way you end up in a completely different place when you look away, the way when you trying to enter a house, but instead enter a realm of wooden blocks is just MIND BREAKING!
This is actually absurd lmaooo
Nice, never thought of doing a Speedrun using AI generated image game? idk how you call it
"i cant get to the end of this wood"
its literally a dream
The magma blocks disappearing was insane
Isso é tão absurdo, ele tem um limite de tempo pra continuar jogando e é tudo carregado aleatoriamente em tempo real, lenda 👊🔥
If you showed this to me in 2011 I think I would actually have an aneurism and die
I love how most of the process is purely based on colors and shapes.
In this Minecraft it is impossible to die because death takes a moment, which is not enough to train AI, unlike constant damage.
This is seriously meta, I can’t wait for the AI to adapt to the fact that you are taking the limitations of the AI and using it as part of the game.
One of the sad things of how "AI" like this one works is that it doesn't really learn anymore after being deployed/published. It's like crystallized intelligence. The forms of AI that can continously learn are more expensive to run and may require dedicated brain-like circuit chips to be feasible.
All of the above is just the vague impression I have gathered so far about "AI", I'm no expert.
playing this minecraft feel like when you recognize the dream, but trying to not wake up
This is like realizing your lucid in a dream and trying to make it go your way before waking up.
so ai minecraft is just trying to control a lucid dream
I love the dude's friend in the background 😭
the ais lack of object permanence makes it so much better lol
I DON'T KNOW HOW TO EXPLAIN IT, BUT I FEEL DISGUSTED WHEN I LOOK AT THIS
this is the type of shi that we play inside a dream and thinks that it's completely normal
I had a nightmare of the beginning part of being trapped in some wood area of just infinite overlapping roofs in angles like mc houses
Minecraft AI it's like that one dream that got so good but you wake up too soon so you got to lock in back to sleep to imagine what would happened next
This is like being able to consciously explore dreams with your friends
One day, someone should train AI to recreate LSD Dream Simulator for the PS1.
Edit: I got the name wrong,
it's called LSD Dream Emulator.
Thats impossible we dont have images of dreams dumbass!!
This is already an LSD simulator
Make LSD Dream Simulator²
Ai generated games are already LSD simulator
YESS
IT’D BE TRRRIFINYG
That looks like when you’re trying to control a lucid dream
*looks at like 6 warp blocks* OH MY GOSH THIS IS NETHER THIS IS NETHER THIS IS NETHER
Wow this is incredible tech. Imagine in the future you will be able to have unique game experiences based on your play style with artificial intelligence changing the game do your gameplay.
lucid dream speedrun
I love how they play Minecraft by colors and looks and it makes totaly sense the way it's generated
I love the shorthand you've developed for the wacky behavior
Time traveller: *Moves a chair*
The timeline:
Its so cool how this is very beginning of this Ai generated game tech stuff and people are still having lots of fun with it and making it work
Pov: my dreams after binge playing Minecraft for two weeks
Getting enchanted diamond tools in ai minecraft is actually insane
That honeycomb horizon to lava strat is so smart! I could never get past the lava honeycombing.
No way you just beat minecraft Ai personalization
This is shockingly similar to navigating in lucid dreams...
Ever since this got popular I’ve been waiting to see someone just spin around and look up and down to keep generating new landscapes until something cool happens. That would be the first thing I would do in this game
i love how you got diamond tools when you got the stronghold. it is 100% likely that most of the stronghold data used to train the plays had diamond tools.
We got an Ai Minecraft speedrun before GTA 6 😬
It's so disorienting it's making me seasick
Me: Plays minecraft
What my grandparents see:
Gaslighting AI to Dream playing through Minecraft
It feels exactly like a dream. I know that's been said before, but trying to control dreams is exactly like this. Sometimes you just don't quite have the control powers to do it.
*NOW YOU’RE PLAYING WITH AI.*
I’m so glad another YTer is using the short context span to its advantage.
I looked away for a second and suddenly it's yellowing