Playing Minecraft Inside Terraria | Project Showcase 4
HTML-код
- Опубликовано: 9 июл 2024
- Fairly quick project I cooked up using Terraria as a digital display for anything you want including images, videos, and games. Took me about 3 days to fully implement in code and another week or so to edit.
This project was tons of fun, thanks for watching! I hope you all enjoyed.
Quick note: the code for the Terraria mod is super spaghetti, I didn't program it very structured at all. I might clean it up in the future and update the github but for the time being it'll be pretty messy and convoluted. Also all the file paths in the mod/python files are removed since they were for my local machine so you'll have to put those in and recompile the mod yourself but it's pretty straight forward. If you want to get it up and running just create a template mod in tmod loader then replace testsword.cs with mine.
GitHub - github.com/Brendan-Kirtlan/Te...
Music Used (in order)
Scott Lloyd Shelly - Overworld Day
Scott Lloyd Shelly - Alternate Day
Scott Lloyd Shelly - Corruption
jin601 - underwater potion ( / underwater-potion )
jin601 - magic pixel ( / magic-pixel )
jin601 - cafescene ( / cafescene )
jin601 - SOMeONE!! ( / someone )
jin601 - explanation ( / explanation )
jin601 - phlegm ( / phlegm )
jin601 - / jin601
Video Chapters
0:00 - Intro
0:24 - Background
0:53 - Converting pictures to blocks
3:21 - Playing videos with blocks
3:40 - Displaying games
4:00 - Huge problem
6:48 - Attempting to find diamonds in MC in Terraria
23:17 - Outro
obligatory forsen reference
>no identification header
>no checksum
>no blocks
Absolutely based, best image format
Will probably become the industry standard for storing images I’d imagine
i prefer it this way
does away with a couple extra bytes for maximum compression
It has no checksum, but does it have .chumseck?
Chum actually isnt a bad idea if you wanna have something really computationally innexpensive to export with. Not practical after that tho.
For someone’s first terraria mod this is insane.
You know, when Terraria first came out, a lot of people were calling it 2D Minecraft. Now I can safely deny those claims, because Terraria is apparently just 3D Minecraft.
You mean minecraft is just 3D terraria 😂
huh?
Minecraft is 3D forager, and even forager has more content.
terraria actually released before minecraft
Out of 4 replies how did no one understand the comment 💀
The problem you are trying to solve is called real time color quantization, and there are a number of cool ways to optimize it. If you represent RGB as 3D space, you could store your pallet in an octree which would drastically reduce search times
Never heard of these, thanks! Will definitely look into these
@@BKBinary Would be cool to have a follow up where you optimize it, maybe have the computation shared on more cores(if possible) and try and win a CS go bot match
@@jambosussSince the pixels are largely independent, it should be trivially parallelizable
sRGB is honestly a pretty terrible color space for this kind of thing. Converting to a perceptual cookie space would take more processing power, but should make things more visible with less cookie distortion.
+ one other idea would be to just precalculate a big lookup table. All 256,256,256 would only be 16MB (or 32 if you need 16-bit index for blocks). Should be real-time even without threading assuming terraria can keep up
edit: since you're quantizing anyway, you could group nearby rgb values as well. Divide everything by 4 and you save 64x the storage. You could also use 2 tables - one for converting rgb to hsv or whatever color scheme you want (doesn't matter how expensive the conversion is), then another for converting hsv to terraria block. though at this point, I'm sure the biggest bottleneck is probably Terraria updating the blocks/map, I doubt getting the screenshot is so expensive
1:50 Congratulations, you just invented .BMP format
*ppm
It's literally just a ppm.
Bmp doesn't has alpha?
@@quedtion_marks_kirby_modding bmp has a secret hidden third half assed 32 bit export option in gimp
@@quedtion_marks_kirby_modding He made a binary-ppm it's physically the same.
@@quedtion_marks_kirby_moddingit does but according to the Wiki it requires compression to support the alpha channel, so default bitmap is just a header with RGB bytes repeating until EOF
For more accurate colors, maybe you could have considered converting RGB to YCbCr and calculating according to the distance of the Y (luminance or relative brightness) component. You could consider CbCr slightly in your calculations, but matching to Y first will get much better results since humans see differences in relative brightness much more than differences in chroma (the Cb and Cr)
This is a principle used in image compression algorithms if you are curious, where most of the Cb and Cr information is thrown away with very little loss in perceived image quality
Very interesting I didn’t know this, thanks for the comment!
My first version of picture conversion used luminance with seemingly random scalars (but didn’t take account for color so it was grayscale). I didn’t know you could combine luminance as well as the colors to make it more accurate.
This is often seen in the JPEG format if I am not mistaken
Using a picture of ray william johnson for the word "until" is hilarious
My guy did something so unthinkable, so undone before to such a degree that people thought he was trolling.
what my cs teammates are playing on:
what im playing on:
Most controller mods specifically disable Minecraft's pausing and keep registering inputs when unfocused, because a primary use for them is running multiple games on the same computer for a 'split screen' experience.
_Primary_ use? I thought the primary use was to play it with a controller.
@@blu3260
_A_ primary use.
Obviously the _main_ purpose is to just have the game with a controller, but doing it split-screen has been a big thing for these controller mods since 1.7.10 at least, and that tradition has carried on.
this video is infact epic
You are epic sir
Instead of calculating the euclidean distance for each vector, you could take the dot product. The largest dot product will signify the most similar vector. For vectors x and y, rather than calculating dist(x, y) = sqrt( (r_x - r_y)^2 + (g_x - g_y)^2 + (b_x - b_y)^2 ) for the euclidean distance (or even calculating the squared distance to avoid computing square roots every check), you can save computation time by instead calculating dot(x, y) = ( r_x*r_y + g_x*g_y + b_x*b_y ) this has the same number of additions and multiplications, but saves on 3 subtractions and potentially a square root per calculation.
Though, this is probably a micro-optimization and you won't see too much benefit. Love chum btw, never change it.
Thought the same. Hidden advantage is that you can batch many dot products in a vector matrix multiplication
Could also trade memory for computation time and instead create a lookup array where the index is R + G
The association of RGB color to terraria block is called color quantization. The way you are quantizing RGB color pixel wise is, while simple, suboptimal in term of result quality. The problem with this algorithm can be seen with the following example. Let say you want to quantize an image full of the same purple pixel but you only have red and blue color in your quantization set (no purple). The result of your algorithm would be an image full of red or full of blue (depending on the distance between the purple color and the red and blue color). A better result would have been to place blue and red pixel next to each other to obtain an image that, for the human eye, would look purple ! This process is called dithering, you can check the Floyd-Steinberg dithering algorithm that does exactly that. Great video nonetheless, looking forward for the next one !
I also think it would be possible to use a kd-tree with 3-dimensional coordinates (rgb values) and find the closest euclidean distance in logN time, instead of the linear search he was preforming
Dithering would result in better image quality, but it would also take more processing power.
im so happy i found this channel, just binged watched all your uploads and excited for whats tuned keep it up bro💪💪
Bro decided to do the opposite of the computer in Minecraft where you can play terraria on 💀, this madlad
excuse me it's not a leather helmet, it's a leather cap
Leather helmet til the day I die baby
I think if you wanted to improve performance, you could use a custom texture pack that limits MC's colors to what your screen supports, and then apply fullbright.
Your image format is cool, but why didn't you just use the Bitmap image format?
🤔
bump
We appreciate the torture you put yourself through to make this ❤😂
OMG, your mining luck seemed terrible - which adds to the reward for sticking to it until achieving it.
Cool project!
this is insane man, gj
I can't wait to see .chum used everywhere
Not sure if you check but terraria has 32 paint which can be applied to almost every block which will provide you with a very broad spectrum of colors, also not 100% sure but I believe in the configs file you can also change the render distance as I believe resolution is somewhat of a limiting factor in this.
pretty sure paints only show the paint color in the map， without regards for the original map appearance。
1:45 it also lets you store an image with a width or height of 0, even if the other dimension is not 0
I think part of the horrid frame rate is due to the fact that you’re making screenshots, converting them to CHUM, picking up the file in Terraria, then converting that to Terraria blocks.
I think you could cut the first png to CHUM conversion entirely by instead of screenshotting, individually taking each pixel of the screen and writing it into a CHUM file.
I’d personally do it in C (or at least Cython) to make it faster as well.
Also writing and reading files is really slow, some form of in-memory IPC would help i think
You’re a friggin legend wtf
The palette looks amazing, i'd definitely play that (in Minecraft, full speed and resolution)
man I can't wait for part 2
Ok, this is crazy
Loved the video!
I just wanted to share a couple of tips that might be useful to you or others from my experiences with topics close to this. For reading the window without obs showing up above it or if other windows are dragged over the window I like to use win32 and PrintScreen from that module as it allows you to read the windows image even if other windows are above it or the window is inactive. I also like to use win32 for sending keypresses and cursor movement (tho that's a bit buggy) as it also allows you to control the game from inside other games with something like a custom item. Instead of like in your case having to plug in a seperate controller and changing config files, however this can restrict some movement as it isn't as easy to control. Also I don't fully know if you in counted this issue with minecraft opening the pause menu every time you tabed out but if you did you can press F3+P to stop auto pausing from happening when minecraft goes out of focus.
Anyways sorry for such a long paragraph. Hope that is helpful to someone atleast.
this is giving me such like minecraft beta vibes for some reason. I feel like this is what my memories of playing minecraft beta look like in my head. Would love to play this way or at least have like a texture pack or something with these colors
3:20 THE DANIEL LARSON IM CRYING
This is ludicrously cool
I'm impressed.
“Also try terraria!” - The Minecraft splash text
the graphics are certainly something but my god the aesthetic is unparalleled.
next video be like: "playing minecraft inside terraria inside minecraft inside terraria"
Very cool! for future reference your chum file exists and is the .BMP format
Terraria: Try Minecraft!
Minecraft: Also try Terraria!
* Static sound. *
Terraria: WAIT-
Minecraft: NOT LIKE THIS-
* Demon core sounds. *
Now there’re the caveats of the paint colours which can radically change the colours of the blocks and possibly improve image clarity significantly
It would be cool if you gave this tech to Luke The Notable , i am sure he is notable enough to survive 100 days in it , maybe even beat the game .
Bro actually played it pretty awesome
Great video
Funny Project, I might have a idea to adjust the color rendering speeds, which would also make it possible to add more variations
Did u try to split your big table of colors into smaller ones?
Idk if it is doable to sort the coloring to sub tables, but if yes u could safe like alot of time for each pixel, so you search like a equal thing on the colors or like a range or smth
and then u can check if the desired color for this pixel is inside of this sub table
if the sub tables still have like alot objects, u could try to put them in another table etc
Only a Conceptional Idea, cant promise its doable, but might be in my opinion
this is pretty cool
One thing you could try for a larger color palette (other than dot products as people have mentioned) is divide the 256x256x256 RGB cube into equally-sized cubes (ex. 64x64x64) with 1 Terraria block per cube, then integer divide each Minecraft pixel's rgb values by the cube size (ex. 64) and use them to refer to a 3D array of Terraria blocks. Basically constant-time lookup at that point, and 64x64x64 would allow for a 64-block palette I think
You could have premade a lookup table for each colour, if you used 2 bytes per colour and excluded the alpha value then it'd only be around 35mb of ram, then you can store the block to map each rgb pixel to in a massive array and then you can look up the colour in constant time.
great video though!
An idea:
Instead of streaming the image from Minecraft - create a mod for Minecraft, which streams a slice of world from player into the -Z +Z direction. Stream that straight into the terraria worldgen class. Terraria's worldgen is not multithreaded (unlike Minecraft) so it should be easy to just suspend the thread to wait for the connection with Minecraft and just stream blocks right into the Terraria worldgen and map the blocks from one game to another (you could default to stone if a block is "exotic"). Then make the games communicate such that a move forward in terraria - moves your player in Minecraft forward. If you also handled destroying blocks - you technically can PLAY Minecraft from inside of Terraria.
Crafting could also be theoretically possible as Terraria has similar items as Minecraft - you would just need to map them. And Minecraft's Mobs could be spawned inside of terraria, but that would require overriding AI and a lot of work in general.
But the simple concept of walking on Minecraft's world in terraria is very possible.
If you're considering this - hit me up, I can help.
now he just needs to play terraria in minecraft, and then use terraria to play minecraft to complete the loop
1 minute in and this guy has already made an entire new file format💀
No way checking his channel was the person who also created the "file storage on RUclips" video time ago when I wasn't even interested in Terraria and this video wasn't created. You for sure deserve my sub
Thank you! Really appreciate you sticking around since day one :)
Isn’t your .chum file just a slightly simplified .bmp?
I’m not sure, I looked into using BMPs to use but there was a lot of junk I didn’t need for my use case so I quickly abandoned the idea
It's not bmp its more like ppm
"playing" minecraft inside terraria.
Honestly thought any kind of game like this would likely come through to be able to display something, using some way to do it. Cool.
Qoi may have been an image format worth considering.
What about trading resolution for palette/performance? Would that help?
you could cache the block palette in a lookup table so it would have to do it 16 milion times and after the entire lookup table it should run pretty smooth. it would be nice if you had access to the minecraft frame buffer but i don't know how hard that would be but it would be more efficient than taking a screenshot then encoding it in a different format
Now I can’t wait to play terraria in minecraft
I know there already is kind of a pixel feature but would anyone be able to make the minecraft in terraria filter in minecraft? like without the technical limitation just as a visual thing in minecraft?
1:29 HOLY SHIT A DEV JUST REFUSED LITTLE ENDIAN LETS GOOOOOOOOOOO
Real neat!
have you tried making in higher do frames per second, maybe deleting the screenshots after they are used? idk that just seemed like a cool idea
Soon enough we will have terraria inside terraria inside minecraft terraria
wasn't a .bmp file possible to be used aswell for this instead of making a custom file format?
You are a genius
you could try using the dot product for the palette, less expensive to compute afaik and maybe even more accurate
The fact that ive seen a playing Terraria inside minecraft and seeing this the day after
Here is a silly idea, you could precompute all of the tile IDs as an array and use the RGB color as an index into the array.
With RGB color 8 bits per channel there are only 2^24 different options, in other words about 16 megabytes worth of memory usage assuming the tile IDs are 1 byte.
Another way to potentially speed it up or save memory is to discard every other bit, that way your 24 bit RGB color becomes a 12 bit RGB color.
So if i see correctly, you have a lot of knowledge when it comes to coding and encrypting.
I am writing this because i have a question to ask.
So the story first:
I have a playstation 3 with a 500gb harddrive in it. I wanted to use the safe files on it to be used for the PS3 Emulator. I did the stupidest thing however. I accidentally formatted the drive when going through the disk management. I didn't use the drive and never put anything on it afterwards. Later i tried using TONS of recovery software to recover those files. One of those programs was actually succesful and recovered some weird and interesting data. It found several .DTA files and most of them have a file size either equal to a gamefile or a savefile for the playstation3.
Now for the question:
Since PS3 Data is usually encrypted i want to know if it is possible in ANY WAY to get those files back to their original state and to be readable again by the PS3?
To optimize transformation from color to block you could precompute the mapping of blocks (16mb of data is not much) into the array
Terraria in minecraft is one thing, but this is just mad
wouldn't it be faster to directly convert the pixels into tiles and output that into a file instead of the colors?
I feel like a fairly simple optimization that could be made would be to precompute which block represents each color and then reference that instead of calculating which block has the closest color for every pixel in each frame.
Woah mister chill with the big words
Instrad of doing euclidian distances to find the best block, you could do a dot product and pick the greatest value.
Performing dot product by many vectors at the same time is a matrix multiplication and it would be very efficient to do thzt in numpy. At least more so than looping xD
Wait why did you meed to find the aberage of each block? Just find the color the map used for each block
As an alternative to play minecraft with a controller, you could've used a small local Minecarft server.
You play minecraft in another computer that opens it's world in LAN.
Then, connect to that world in the computer you're gonna be recording and make the player spectate the server's host player, so you'll be seeing all of that player's actions and then, just stream that directly into terraria, while being able to play MC with no problems in the other computer.
very cool
MAKE BAD APPLE :) in terraria for sure
every block does have a color it displays on the map coded into the game, i assume those colors would be better to use if you were to upgrade this display
have you considered threading haha. sick project
Now we need minecraft in minecraft in Terrarien
The quicker way to do the mapping is to use the dot product of the terrarira vector and the rgb. Then take the maximum of the dot products.
I used this technique for mapping analog controls to WADS controls for a game I’m working on.
It’s faster because you avoid doing the sqrt in the distance functions since dot product is just multiply and add
now we need playing terraria in minecraft!
Been done before.
Finally, actually 2D Minecraft
Warzone in viva pinata next pls
I love you Benjamin
Chum sounds like a fancy bmp
>Have to calculate block for each pixel
Feels like something you could use threading for, are you doing them one by one I'm assuming?
Now we just have to wait for somebody to make Minecraft in Terraria, in Minecraft.
Just now need some how to play terraria in minecraft
It's evolving, just backwards.
Would it have looked better if you made the screen take up more of the world for a higher resolution?
is there a way to make the game run faster in terraria
I am still in the beginning part of this video, but already wondering if you could use Terraria as a graphical shell for Linux lol.
Your work is amazig!
Appreciate it!
Perfect
Wouldn't it be easier for the image ti have the pallet colours before saving it?
Like do the transfortion to the pallet colours directly and then load it into terraria.
This would be a cool affect from a potion or plant in Minecraft
now use that thing fundy made to display videos in minecraft to play terraria in minecraft in terraria
I REALLY, REALlY want him to see this, so please, like this comment. alr, so if you wanna fake focus a window and restrain xinput on terarria, u can use neucleus coop by getting the terraria handler and making it your own, the doc is shit, but it works, so if u wanna play another game in another game, this will be your friend
Have you considered using your GPU to speed up the conversion of RGB values to terraria blocks in parallel? You could also try disabling smooth lighting in Minecraft to dumb down the colors and improve visibility in Terraria