It's so sad, man. I remember the few rare times I knew I was dreaming, but I slowly felt myself waking up and started to feel myself shift on the bed instead of moving in the dream.
So, AI Minecraft speedrun revolves around finding colours/patterns that look like required resources/places, rather than actually finding these places/resources. It's so absurd yet so interesting.
@@LucasFerreira-fp4nj I meant playing it like Minecraft (mining, crafting, looting, farming) is useless because when you do a 360 flip everything is replaced. Like at the very least other AI generative stuff you could maybe see as a (worse, poorer quality) version of the 'real thing', but this is more 'the backrooms' than it is 'minecraft'
@@adventofnullIt's also in its infancy, and is already amazing if you understand how it works. I'm baffled at how they managed to make it this coherent. It really should be even worse than this. Technology is getting crazy.
I specifically appreciate how they're trying to be descriptive, but since it's like reality soup that generates based on the palette of the image, the best they can do is stuff like "We need this orange" "Lets try to see what we can do with the floor" "Hold onto this red" "They're trying to take away the nether from me"
More like trying to control a semi-lucid dream. Once it's lucid it's pretty easy, but when you're in that weird state where you aren't quite sure if you're dreaming and haven't stabilized it, then shit gets weird.
I feel like if the AI was a little less sloppy and had a slightly longer memory, it could actually be amazing. Of course, it won't be actual Minecraft and probably never can be, but the idea of having to find red blocks to convert to lava to get to the nether is really interesting. As it is, it's too random to actually be enjoyable for more than a one-off gimmick, though. If the AI could remember, like, a couple hundred frames in the past, then it might be cool. It'd still allow for converting your surrondings based on blocks; you'd just need to stare at the blocks for a bit longer. A couple hundred frames, or however long the AI memory is.
@@kalahatze One solution I’d propose is a scenario-detection model that changes the dataset depending on certain recognized images, I.E. nether portal/end portal blocks. From that moment forward, the AI model switches from its overworld training to strictly Nether/End gameplay, preventing an accidental return from looking at the wrong color. Granted, implementing segmented diffusion defeats the purpose of this being purely a tech demo. But if you wanted to turn this into a game, that would be the next step. Signed, armchair programmer.
@HoodedSpidey You don't need segmented diffusion. This creates images frame by frame, at least as far as my understanding goes. Just switch to a different AI after a certain frame is complete. Use some kind of grounding dino model to recognize a nether portal, then for the next frame, you can change the AI or something. It actually seems fairly easy to do, although I'm not quite sure exactly how this works in detail. Edit: Actually, you don't even need a new dataset. Just use a LoRA.
@@kalahatze My main concern about just using a LoRA is that there may not be enough footage in the nether, and I worry about how it’ll affect the “rules” of Minecraft (it’s broken enough as is.) I do agree that we *probably* don’t need an entirely new dataset, however there should definitely be more footage to supplement things like portal ignition, traversing fortresses, gravitational acceleration, and mob behavior. Admittedly I didn’t even know about DINO models until now, It’s really cool to learn that most of the tech exists already & that it’d be simpler than I imagined. Thank you for being willing to talking to me despite my limited knowledge. I’ll be doing more research on all of this.
This is such an interesting concept, the game is trying to gaslight them and they are trying to gaslight the game back, it's like a boss fight against the entire world
I tried playing this the other day and seriously all day I was going around feeling like everything was shifting around me and nothing was real. Real-life cognitohazard.
Wild. Almost seems like they trained it on a lot of simpler short videos, and only a few contained nether, so while it knows what nether looks like, it wants to maintain the overworld look instead.
I mean while most content is in the overworld that doesnt really change the fact that not enough nether footage means the ai cant simulate anything BUT the overworld too well
It most likely did not have enough training footage for the nether, so it did not understand the difference well enough and that's why it was trying to take the nether away
In this demo I suppose, they used footage with keys clicked at exact time as training data. They had to use nether footage, because this algorithm wouldn't be generating those images without it. It was most probably less frequent in dataset, therefore occured the effect of nether vanishing.
This feels EXACTLY like how you try to keep a dream from changing to something else, the most tripping thing about minecraft ai is that it's the closest thing we have to actual dreams
Comparing it to reconstructed dreams it's pretty accurate. Our brain does the exact same thing just like data moshing....You think of a lamp post for a few seconds but now you move and you're next to a wall, not a lamp post. also PilotRedSun's "Not so fast" is so incredibly dreamlike it's scary. I don't know how he created them so accurately
You and your friend's commentary is absolutely immaculate. The way you call out things like it's some kind of official speedrunning terminology is too good. "It's reddening!" "Orangification." "THEY'RE TRYING TO TAKE IT AWAY" "They can't take this away from me" "It's starting to turn to dirt.." You should do something fun, like crazy BS modpack reviews or such, like those terrible Minecraft horror mods. Something fun just reviewing absurd Minecraft things
What did this player dream? This player dreamed of sunlight and trees. Of fire and water. It dreamed it created. And it dreamed it destroyed. It dreamed it hunted, and was hunted. It dreamed of shelter. - Minecraft end credits
Do you though? It’s just that it goes off of fed data. A lot of the times it was fed lava was likely pictures in the nether. It just assumes what should be there based off of the conditions of whatever it was trained on.
trying to grab a glass of water off your nightstand half awake with a fever but then you realize your mom took the cup away and you're actually grasping at air
My eyes have never hurt so much, but its crazy to think its at all possible to fuck with the AI and force it to not only create the Nether but potentially the End with the right conditions
The AI constantly guessing where the speedrunners are, while the Speedrunners themselves are trying to guess what the AI will interpret is absolutely funny
Holy fucking shit, I ain’t ever seen anything like this. AI generated videos felt weird themselves, now we can play an real-time AI generating game? This is actually fascinating.
this has to be one of my favorite demonstrations of AI right now. Tricking the AI into thinking you're in a certain biome/Dimension by looking at the right blocks is such an interesting skill
One of the sad things of how "AI" like this one works is that it doesn't really learn anymore after being deployed/published. It's like crystallized intelligence. The forms of AI that can continously learn are more expensive to run and may require dedicated brain-like circuit chips to be feasible. All of the above is just the vague impression I have gathered so far about "AI", I'm no expert.
It’s interesting because this AI has been trained on millions of videos, but only of mainly the first 5 minutes of Minecraft gameplay. So I doubt many had videos of getting to the nether or the end explaining the AI essentially panicking trying to bring him back to the overworld
This is just the trippiest thing ever! The way things appear and dissapear out of nowhere, the way you end up in a completely different place when you look away, the way when you trying to enter a house, but instead enter a realm of wooden blocks is just MIND BREAKING!
Minecraft AI it's like that one dream that got so good but you wake up too soon so you got to lock in back to sleep to imagine what would happened next
Ever since this got popular I’ve been waiting to see someone just spin around and look up and down to keep generating new landscapes until something cool happens. That would be the first thing I would do in this game
Holding onto the nether sounds like holding onto a dream when you know you're about to wake up.
It's so sad, man.
I remember the few rare times I knew I was dreaming, but I slowly felt myself waking up and started to feel myself shift on the bed instead of moving in the dream.
2hu
Saw this listening to Wake Up by Travis
“I DONT WANNA WAKE UP” 🗣️🔥🔥
holy shit thats so accurate.
HAKUREI REIMU??? 😰😰😰
Guys the CEO of racism is here
After decades of progress we finally got an unplayable version of Minecraft.
bedrock is pretty unplayable
@@DivineLight661 your face is unplayable
@@davebob4973my balls are
@DivineLight661 ur feet is unplayable
So bedrock edition
So, AI Minecraft speedrun revolves around finding colours/patterns that look like required resources/places, rather than actually finding these places/resources. It's so absurd yet so interesting.
It hallucinates things not only into existence but out of it, so trying to experience the AI like an actual 'game' is an effort in futility.
@@adventofnull what futility? This itself is already hella fun lmao
@@LucasFerreira-fp4nj I meant playing it like Minecraft (mining, crafting, looting, farming) is useless because when you do a 360 flip everything is replaced. Like at the very least other AI generative stuff you could maybe see as a (worse, poorer quality) version of the 'real thing', but this is more 'the backrooms' than it is 'minecraft'
@@adventofnullIt's also in its infancy, and is already amazing if you understand how it works. I'm baffled at how they managed to make it this coherent. It really should be even worse than this. Technology is getting crazy.
@@adventofnull it needs to have enough nodes to render full 360° of the game and then it zooms in to produce the view
I specifically appreciate how they're trying to be descriptive, but since it's like reality soup that generates based on the palette of the image, the best they can do is stuff like
"We need this orange"
"Lets try to see what we can do with the floor"
"Hold onto this red"
"They're trying to take away the nether from me"
I have not yet heard a better descriptor for this than “Reality soup”. 😂
Reality soup as simulated by linear algebra soup
i love the references to the ethereal "they", as if there are little men inside the computer making the image shift
"they" want you to think that "they" aren't real
Bro fighting his own dementia 💀
The woke left is trying to take away our nether
It's obviously the Machine Spirit
@@Subird The machine spirit on this case being, ironically, non-binary
i love this shit lol, its like trying to control a lucid dream
more like trying to control a verifiably non-lucid dream
More like trying to control a semi-lucid dream. Once it's lucid it's pretty easy, but when you're in that weird state where you aren't quite sure if you're dreaming and haven't stabilized it, then shit gets weird.
Yeah fr@@famlrnamemssng
It's more like trying to control someone else's dream
Superliminal if it were a real dream
3:01
*Task completed:* "Get into the Nether"
*Current task:* "Stay in the Nether no matter what"
"95% of people cannot achieve that"
this is actually so cool, having to try to trick the game into generating what you want is so fun
I feel like if the AI was a little less sloppy and had a slightly longer memory, it could actually be amazing. Of course, it won't be actual Minecraft and probably never can be, but the idea of having to find red blocks to convert to lava to get to the nether is really interesting. As it is, it's too random to actually be enjoyable for more than a one-off gimmick, though. If the AI could remember, like, a couple hundred frames in the past, then it might be cool. It'd still allow for converting your surrondings based on blocks; you'd just need to stare at the blocks for a bit longer. A couple hundred frames, or however long the AI memory is.
*gaslight the game into thinking😂
@@kalahatze One solution I’d propose is a scenario-detection model that changes the dataset depending on certain recognized images, I.E. nether portal/end portal blocks.
From that moment forward, the AI model switches from its overworld training to strictly Nether/End gameplay, preventing an accidental return from looking at the wrong color. Granted, implementing segmented diffusion defeats the purpose of this being purely a tech demo. But if you wanted to turn this into a game, that would be the next step.
Signed, armchair programmer.
@HoodedSpidey You don't need segmented diffusion. This creates images frame by frame, at least as far as my understanding goes. Just switch to a different AI after a certain frame is complete. Use some kind of grounding dino model to recognize a nether portal, then for the next frame, you can change the AI or something. It actually seems fairly easy to do, although I'm not quite sure exactly how this works in detail.
Edit: Actually, you don't even need a new dataset. Just use a LoRA.
@@kalahatze My main concern about just using a LoRA is that there may not be enough footage in the nether, and I worry about how it’ll affect the “rules” of Minecraft (it’s broken enough as is.) I do agree that we *probably* don’t need an entirely new dataset, however there should definitely be more footage to supplement things like portal ignition, traversing fortresses, gravitational acceleration, and mob behavior.
Admittedly I didn’t even know about DINO models until now, It’s really cool to learn that most of the tech exists already & that it’d be simpler than I imagined. Thank you for being willing to talking to me despite my limited knowledge. I’ll be doing more research on all of this.
This is such an interesting concept, the game is trying to gaslight them and they are trying to gaslight the game back, it's like a boss fight against the entire world
Definitely not gaslighting lmao 🤣
@@xlretardstop gaslighting
Gaslighting the world is such a good term. Its just like "no we aren't in the overworld, look at all this red see?"
Don't let them take it from you. You worked hard for that nether.
*neither
@@DoctorAlrightwhat
@@DoctorAlright what
@@DoctorAlrightwhat
3:37 That carrot casually turning into a yellow bed
Metamorphosis
@@SchadenfreudeUY I can do anything! Ueheheh!
0:16 yellow bed casually turning into a carrot
They’re trying to take away our nether, we need to stop this
Make the nether great again
We are now unburdened by what has been
We need to build a wall and make the piglins pay for it
They're eating the ocelots
This is like an SCP entry about containing a cognitohazard
The nether is an antimeme
Genuinely yeah this seems like an unimaginable dimension the scp foundation would contain or something
@@WanderTheNomad there is no antimemetic division, there is no antimemetic division, there is a body in that water, there is no antimemetic division.
I tried playing this the other day and seriously all day I was going around feeling like everything was shifting around me and nothing was real. Real-life cognitohazard.
0:33 geologists when an eruption occurs
Duh
LMAOOOOO
Wild. Almost seems like they trained it on a lot of simpler short videos, and only a few contained nether, so while it knows what nether looks like, it wants to maintain the overworld look instead.
Your intuition is actually 100% true
Nah it's definitely because most of Minecraft content and gameplay is in the overworld
I mean while most content is in the overworld that doesnt really change the fact that not enough nether footage means the ai cant simulate anything BUT the overworld too well
I’d guess that virtually all Minecraft content is overwold since most smps and guides are mostly there
I love the whole
0:30 these are vines
0:33 nevermind they're magma blocks congrats
0:39 what blocks
It looks like it interpreted the magma texture as the block break particles, so they just exploded.
2 Magma blocks: *Mr.* *Stark* *I* *don't* *feel* *so* *good.*
Me and my imaginary friend trying to beat minecraft in a lucid dream
It most likely did not have enough training footage for the nether, so it did not understand the difference well enough and that's why it was trying to take the nether away
In this demo I suppose, they used footage with keys clicked at exact time as training data. They had to use nether footage, because this algorithm wouldn't be generating those images without it. It was most probably less frequent in dataset, therefore occured the effect of nether vanishing.
Well that explains how its IMPOSSIBLE to find the end without importing a picture
Minecraft manifestation speedrun
“lock in”
*manifests harder*
This feels EXACTLY like how you try to keep a dream from changing to something else, the most tripping thing about minecraft ai is that it's the closest thing we have to actual dreams
Comparing it to reconstructed dreams it's pretty accurate. Our brain does the exact same thing just like data moshing....You think of a lamp post for a few seconds but now you move and you're next to a wall, not a lamp post. also PilotRedSun's "Not so fast" is so incredibly dreamlike it's scary. I don't know how he created them so accurately
Ok, that's the best use of ai: dream games. Like, make it a little less erratic, optimise it, remove the time limit and it's just gonna be so much fun
FRRRR
omg such an amazing idea
screw AI art. embrace near unplayable non euclidian versions of well known videogames
@@GoroAkechi_Real Catacombs of Solaris my beloved
@@GoroAkechi_Real i misread your comment but still. also infinite pizza
How speedruning minecraft on good zaza feels like :
Your zaza got laced with dmt bro
"Are you sure you want all of them? it's gonna make you very very high"
"Yes, all of them."
"See? this zaza ain't shi-"
You and your friend's commentary is absolutely immaculate. The way you call out things like it's some kind of official speedrunning terminology is too good.
"It's reddening!"
"Orangification."
"THEY'RE TRYING TO TAKE IT AWAY"
"They can't take this away from me"
"It's starting to turn to dirt.."
You should do something fun, like crazy BS modpack reviews or such, like those terrible Minecraft horror mods. Something fun just reviewing absurd Minecraft things
for real, im in hysterics 😭 Orangification especially
5:45 there was a stronghold to the left
i was going to say that
This video feels revolutionary in terms of what's possible with this "game"
I love how the whole speed run is just tricking the AI into giving them what they want
getting enchanted diamond tools is crazy
"i think I'll be ok with this amount of acid, i won't lose control of my mind or anything"
My mind 1 hour in:
This AI really is amazing. You've really shown how to manipulate it to get to different areas of the game. Amazing video
What did this player dream?
This player dreamed of sunlight and trees. Of fire and water. It dreamed it created. And it dreamed it destroyed. It dreamed it hunted, and was hunted. It dreamed of shelter.
- Minecraft end credits
It dreamed of feeling like being on drugs while playing minecraft.
Someone make a mod where you can play ai generated minecraft while you sleep
I'm convinced the guy talking in the background is just schizophrenia
2:10 You would have to really understand how AI sees the world to achieve this.
Do you though? It’s just that it goes off of fed data. A lot of the times it was fed lava was likely pictures in the nether. It just assumes what should be there based off of the conditions of whatever it was trained on.
@@cancerousnut7767 turns into orange
this is what chasing that drugged out sleep trip was like
This is like playing non-euclidian Minecraft while being on 10 different psychedelics.
"ah we got some magma, we can use this we can use this-" *magma dematerializes* "AH D:"
trying to grab a glass of water off your nightstand half awake with a fever but then you realize your mom took the cup away and you're actually grasping at air
I think having good items (enchanted tools, etc) triggers more endgame stuff, like the fortress and the end
My eyes have never hurt so much, but its crazy to think its at all possible to fuck with the AI and force it to not only create the Nether but potentially the End with the right conditions
4:21 You guys almost made it to the end if you had just kept up with the obsidian pillars and the purple.
Normal Minecraft: you go to places to beat the game
AI Minecraft: the places go to you to beat the game
The AI constantly guessing where the speedrunners are, while the Speedrunners themselves are trying to guess what the AI will interpret is absolutely funny
This is actually absurd lmaooo
Holy fucking shit, I ain’t ever seen anything like this. AI generated videos felt weird themselves, now we can play an real-time AI generating game? This is actually fascinating.
Time traveller: *Moves a chair*
The timeline:
This is how i am when i am in the middle of a good dream and keep waking up
This perfect encapsulated the feeling of trying to cling to the memories of a dream as I wake slowly and try and finish the dream
this has to be one of my favorite demonstrations of AI right now. Tricking the AI into thinking you're in a certain biome/Dimension by looking at the right blocks is such an interesting skill
Trying to go to the nether and the end looks like they’re discovering how to warp reality for the first time 😂
Accurate portrayal of me learning how to control my lucid dreams for the first time
I love how they say "dont let THEM take it away!" as if it were a conscious person plotting against them
This is seriously meta, I can’t wait for the AI to adapt to the fact that you are taking the limitations of the AI and using it as part of the game.
One of the sad things of how "AI" like this one works is that it doesn't really learn anymore after being deployed/published. It's like crystallized intelligence. The forms of AI that can continously learn are more expensive to run and may require dedicated brain-like circuit chips to be feasible.
All of the above is just the vague impression I have gathered so far about "AI", I'm no expert.
The way you look into lava and wait until it becomes nether feels like a lucid dream
This feels like a psychic prediticing your minecraft speedrun
The ai seems to be trained on mostly overworld footage,hence why when you go to the nether it just turns into overworld so quickly,same with the end
It’s like a game with no internal memory. It’s just generating everything in real time and culling it once it’s no longer on screen
This is like trying to cling to a dream instead of waking up
This is like realizing your lucid in a dream and trying to make it go your way before waking up.
This was like watching a recording of a dream about minecraft.
this feels like a dreamscape i fw it heavily
lucid dream speedrun
it's crazy that you're playing minecraft without any of the original code, nor a functional physics engine. it's just pictures
It’s interesting because this AI has been trained on millions of videos, but only of mainly the first 5 minutes of Minecraft gameplay.
So I doubt many had videos of getting to the nether or the end explaining the AI essentially panicking trying to bring him back to the overworld
The magma blocks disappearing was insane
"i cant get to the end of this wood"
its literally a dream
I’ve been periodically getting sicker throughout the day. I have a feeling my dreams tonight are going to mirror this…
I love the dude's friend in the background 😭
I love how most of the process is purely based on colors and shapes.
the ais lack of object permanence makes it so much better lol
*NOW YOU’RE PLAYING WITH AI.*
I’m so glad another YTer is using the short context span to its advantage.
This is like being able to consciously explore dreams with your friends
Me: Plays minecraft
What my grandparents see:
This is just the trippiest thing ever! The way things appear and dissapear out of nowhere, the way you end up in a completely different place when you look away, the way when you trying to enter a house, but instead enter a realm of wooden blocks is just MIND BREAKING!
playing this minecraft feel like when you recognize the dream, but trying to not wake up
I love the shorthand you've developed for the wacky behavior
This is what it feels like to be half-lucid in a dream
It is like telling a dementia patient to remember a specific memory they had (not that I have any experience with that).
gaslighting speedrun
Of course you hadn't, you didn't remember it
Beating Minecraft With Dementia
Is it even Possible?
Dementia craft
Best AI minecraft content so far. You were able to exercise some sort of control over this thing!
Nice, never thought of doing a Speedrun using AI generated image game? idk how you call it
it's like listening to a guy calling out commands to his nascar driver on how to race
AI minecraft is like playing in a world being held together by the universe’s most schizophrenic alchemist
That looks like when you’re trying to control a lucid dream
Minecraft AI it's like that one dream that got so good but you wake up too soon so you got to lock in back to sleep to imagine what would happened next
like the other commenter pointed out, mentions of "them" trying to take "it" away from you are extremely funny
They finally beat Minecraft with dementia.
Pov: my dreams after binge playing Minecraft for two weeks
That honeycomb horizon to lava strat is so smart! I could never get past the lava honeycombing.
This feels kinda like when you’re in a lucid dream and you’re trying to shift the dreamscape into something else lol
Truly fresh and novel entertainment, what an era to be alive...
New title: Trying to beat mincraft but its a drug trip
finally the first AI mincraft run
Trying to speedrun a Minecraft world in which reality no longer exists is super interesting to me.
I had a nightmare of the beginning part of being trapped in some wood area of just infinite overlapping roofs in angles like mc houses
In this Minecraft it is impossible to die because death takes a moment, which is not enough to train AI, unlike constant damage.
Oh man, can't wait until we see a highly personalized games in 20 years!
Its so cool how this is very beginning of this Ai generated game tech stuff and people are still having lots of fun with it and making it work
I love how they play Minecraft by colors and looks and it makes totaly sense the way it's generated
this is the type of shi that we play inside a dream and thinks that it's completely normal
*looks at like 6 warp blocks* OH MY GOSH THIS IS NETHER THIS IS NETHER THIS IS NETHER
Ever since this got popular I’ve been waiting to see someone just spin around and look up and down to keep generating new landscapes until something cool happens. That would be the first thing I would do in this game
4:42 pale garden moment