How Bad Apple was played inside Super Mario Bros.
HTML-код
- Опубликовано: 8 июн 2024
- In this video, I break down the steps I took to create a TAS of Super Mario Bros. wherein I play the Bad Apple music video on screen.
Here's the TASVideos submission for more information: tasvideos.org/8991S
My game Fantastic Fist can be found here: store.steampowered.com/app/21...
If you want to follow my TAS tomfoolery, join my discord: / discord
All the background music used in this video (If it isn't coming out of the NES) is from my game's soundtrack.
This video makes some assumptions on your 6502 Assembly programming knowledge. Many of the concepts used in this video would require an entire course on 6502 ASM, and I'd probably lose 90% of the audience halfway through explaining all that. Instead of explaining all that, I'll just assume my target audience is people who already have a decent idea of what's going on, and are willing to pause the video to read the comments on my ASM code if needed. (The ASM code can also be found in the TASVideos link)
On top of explaining how the recent Bad Apple TAS was put together, I also show some ways to improve this TAS, such as playing colored videos.
I don't usually make videos with commentary, so if you want to provide feedback in the comments, all is welcome! If the subtle music in the background is distracting, if I sound too monotonous, or if I completely forgot to explain something, I'll keep that in mind for future videos.
Timestamps / chapters:
0:00 Introduction
0:16 Step 0 - Glossary: TAS
1:10 Step 0 - Glossary: ACE
2:03 Step 0 - ACE in Super Mario Bros.
6:14 Step 0 - Writing our own custom code
9:09 Step 1 - The Graphics: Convert the video into "Mario tiles"
11:47 Step 1 - The Graphics: How to draw to the NES background
14:29 Step 1 - The Graphics: Compress the data into "packets"
15:39 Step 1 - The Graphics: The limitations of VBlank
16:56 Step 1 - The Graphics: Create packets and convert into inputs
18:11 Step 2 - The Audio: How to play PCM audio on the NES
21:03 Step 2 - The Audio: Generate the inputs, and give it a listen
23:02 Step 2 - The Audio: Fixing the audio
24:27 Step 3 - Return to Stable Gameplay
25:34 Step 4 - Bonus Audio: Multiple interlace functions
26:06 Step 4 - Bonus Audio: 26.6Khz audio loop
26:38 Step 4 - Bonus Graphics: Larger resolution
27:07 Step 4 - Bonus Graphics: 60 Frames per second
27:21 Step 4 - Bonus Graphics: Color video: Intro
28:10 Step 4 - Bonus Graphics: Color video: Determine color palettes
29:12 Step 4 - DOOM
30:10 Conclusion 
Игры
using this method it might one day be possible to play super mario bros (1993) inside of super mario bros
Finally making Super Mario Bros. (1993) A mainline game.
toki, nasin seme li suno sina?
@@AzamMujahidProductions TOKI PONA LESGO
Im genuinely curious how it would look if you were to pass a video of smb through it
@@AzamMujahidProductions most random toki pona encounter
Oh so we're just casually skimming over coding an emulator?
nesalizer:
Probably a fork tbf but
if the emulator dosnt need to be visualy and real time accurate and just needs to count cycles it is a good bit easier than a normal emulator that needs to display grqaphics and audio and be properly paced
source: ive wrote a super basic emulator for the 6502 that has a subset of insturctions to be turring complete
@@hedwig7s Nah, it's an original emulator. I've made a handful of NES emulators before (A lot of the visuals in my video about how Mario 3 loads levels were generated through emulating), though this one was from the ground up so it could have open bus support. Not that it needed open bus support to count cycles, but it was nice to learn more about open bus.
to clarify its still takes a good bit of time and requires you to be a good programmer
This was the smartest way to advertise an indie game
I gotta learn how to market my game somehow!
@@HyperVanilostfu about Touhou nobody cares
I like how he shows maybe 10 seconds of Bad Apple, 3 seconds of his own game, but for some reason showed almost a full minute of a DOOM speedrun.
Super Mario is a gateway drug to comuter science
How so? Mario travels everywhere by pipe :3
you enter the compsci pipeline
@@ChadMcCall42i don’t want any child of mine commuting by pipe system
Be careful of the Mario pipeline.
I like how he shows maybe 10 seconds of Bad Apple, 3 seconds of your own game, but for some reason showed almost a full minute of a DOOM speedrun.
Step 0: Get a Bad Apple video
Step 1: Write a NES emulator in C#
Step 2: ??? (Hand waving intensely)
Step N-2: Profit
Any and all video players will play Bad Apple, and anything that isn't a video player will be forced into one so it can play Bad Apple.
For being the video equivalent of "Can it run Doom" It is criminal that almost none of these Bad Apple videos and barely any of the comments mention Touhou.
I wonder if there will ever be something new, but similar in the future.
@@MintTheProtogenThere’s some guy on YT Shorts that requested for People to play his Video on the weirdest Devices.
Sadly it actually got more popular than Bad Apple, since his Video played on a Times Square billboard… which Bad Apple hasn’t done yet.
There sadly still isn’t a Video of Bad Apple on a Times Square Billboard…
But that gives me an Idea… Bad Apple, on Super Mario Bros, on a hacked NES Mini??
Nobody cares about Touhou
@@AgentLazarus Ah yes. An indie multimedia series with 19 games (31 including spin-offs) that has been going on since 1997, and whose fan game catalog probably surpasses Sonic's. Nobody cares about.
"Nes ROMs don't have enough storage for full length PCM music" Should've just made the player spam buttons for the music to play
I watched until you casually said "so I'll just write a nes emulator". I had to pause there. I just had to. Lmao! So awesome.
Just wow
especially considering he is already in an emulator to even have that kinda possibility (or a hardware modded nes to make cardrige swapping possible)
@@QuintarFarenor Hm, pretty sure you can swap cartridges on an NES.
@@flameofthephoenix8395 You don't understand what kind of swapping they are talking about
@@jokerofspades-xt3bs Interesting, I don't know much terminology.
Honestly, asking "why" of any arbitrary code execution attack is probably another way of saying "this video wasn't made for me"
why is it possible? bugs and oversights!
2:11 Hey, look, there I am! :D
Incredible stuff!! Can't wait to see what you get up to next :]
WOW! ITS PIXELCRAFTIAN NO WAYKGJDFGIUIOSUHGSGREGG
hey look! there you are!!!!!!
hmm i can only WONDER who is under the blur....
@@saikitonia Yes, I too WONDER that.
hey look, there he is
no way, 100th coin voice reveal? hell yeah.
No.
Yes.
Instead of using a 1x1 kernel when searching for mario tiles, I wonder if a different shape could be better. Maybe a 3x3 gausian spread could help make some of the edges less jagged.
I also like how the piano roll analogy became a reality. Its a sequence of button presses to make music. It's just the the first part of the piano roll builds the piano itself.
After taking an assembly class in college these videos actually make sense to me now.
16:00 well guess what? I want math. I want to see dirty and naughty math and nasty assembly code, that's my entertainment
guys will watch this and think "hell yeah"
Hell yeah
Yeah Hell
I'm girls and I think "hell yeah"
Hell yeah
Hell yeah
30:42 video quality level: pareidolia
I guessed a lot of how this was done, but going into the details was so fun! I figured you used a black-and-white video because of the color palette limitations, but it's insane how it still just about works with color video. Also, I can't believe you wrote your own cycle-accurate NES emulator as a side-project for this. Insane
The audio playing the NES part is what amazed me the most. Honestly, I was expecting Bad Apple added as SMB custom music
I had a ton of fun watching this. Incredibly impressed you pulled this off, and even more that you explained it in a way that made sense to me. Normally technical glitch explanation videos fly a bit over my head but I was able to get this one with a minimum of pausing and rewinding.
This is pretty interesting. As a computer science major and a massive fan of Touhou and programming, this really hits the spot!
Great video. You're absolutely fantastic at what you do. :D
incredible breakdown, we need more videos that go into the nitty-gritty asm shenanigans 🤩
and as always "why? why not!"
The constant back and forth between entry level explanations and _"I wrote an NES emulator"_ level madness is beyond hilarious. Great job !
...wrote an emulator, what a madman!
This is unironically the first video I watch in 1440p
Great video! I’ve seen so many other people talk about ACE but no one really explains fully how it works. But I do have a question, if you had not swapped a cartridge but did have a cheat code or something to get to world N, could you write/execute code?
If you use cheats, like a game genie, to reach world 'N', you could still defeat bowser and execute whatever data exists at address $0181. The issue though, is that's uninitialized RAM, and since SMB1 doesn't write there under normal gameplay, it's going to simply have whatever pattern is used by the console's "resting state", which is usually "00 00 00 00 FF FF FF FF FF FF FF FF 00 00 00 00", which will lead to a 'BRK' instruction, moving the PC to the location determined by the interrupt vector, which SMB1 doesn't use, so the game crashes.
If you have a massive list of game genie codes, you could use those to replace some of SMB1's data with code that writes data at address $0181 though!
The best alternative would be world 0xFC (found by negative_seven), which would execute RAM at address $03D0, which isn't impossible to manipulate, but the bytes that you could control simply aren't enough to prevent a game crash, as far as I can tell. These bytes are "masking flags" SMB1 uses to check if objects are off screen. For instance, Mario is composed of 8 objects. if half of mario is over the screen (leaving just his feet on screen) then half of the bits in one of these bytes will be set. I haven't looked into it all that much, but I wasn't able to form a jump instruction, so I looked elsewhere, and found world 'N'.
that intro to the audio chapter, fucking great so seamless
i thought you peaked at beating mario 3 in the title screen but GOD DAMN THIS IS FIRE
all of your content is so high quality how arent you more popular ...
way too niche and technical content to reach mainstream interest
Have you been out there? 😂 It's idiocracy....literally. We got to stay together. ❤
so glad to see coin finally getting the recognition he deserves
The fact that the entirety of bad apple with good audio quality within the 2kb RAM is beyond me
It's not lol
@@CreationCarlos explain how is not
smb in itself is a very simple game and its code takes up 32kb
you might say visuals ain't that impressive since it reuses tiles from CHR ROM and resolution is very low
But a whole long 7bit-PCM sample fitting within 2kb of RAM sounds unbelievable
it was multiple megabytes of data. the ram only contains the code to read that data streamed through the controller port.
it's basically like playing Guitar Hero except you're strumming a thousand times a second.
@@angille so It's mostly the CPU working on it?
@@ssg-eggunner ...I'm not sure how to explain this any better in a comment than the video already does, lol.
Now make it run your video
lol
Bad Apple is the new Doom
Bad apple is just doom easy mode
They coexist
Nah, Bad Apple is Doom’s Japanese Cousin.
I am aware that someone made Bad Apple in DooM’s MIDI, so Bad Apple in DooM, and technically PART of DooM in Bad Apple
Cute seeing WinForms used in 2024
Love to see more videos combining programming and speedrunning
14:46 fun fact, this is how PNG compresses images
this video was insane. The whole time, I just could not believe you put so much time into making this work so well.
I love how when random people on the internet do some crazy tech stuff, it’s either, doom (1993) or bad apple.
you sound like stryder7x, makes me nostalgic for when i was watching his videos in middle school, anyways great video!
Super good video, love the little jokes and animations. Gave me a good laugh and learned a whole lot! Keep it up! I'd love to see you just take off on RUclips and your games like Fantastic Fist to absolutely pop-off and you get the recognition you deserve!
while i get why most youtubers dont do it, i really appreciated this video assuming the viewer knows the basics of the background knowledge, which saves so much time and in general allows for more specific explanations.
22:45 okay but it actually sounded good, you keep impressing me more on as the video goes
Imagine you're watching someone play super mario bros when suddenly they kill bowser, start mashing 5000 buttons, and bad apple starts playing
Controller data streaming, one of my absolute favorites.
13:30 lmao that brief moment of Chill Programming was way funnier to me than it has any right to be
Thanks a ton for describing the details of this project! A lot of RUclipsrs might have resorted to dumbing things down for a general audience, so I'm glad you described things with an introductory level of cs/cpe terms. Who knows, maybe some kid who understands none of this but really likes video games will see this video, become fascinated, and use this video as a sort of gateway drug to kickstart their interest in cs/cpe.
Absolutely wonderful video. Definitely far surpassed my expectations when I clicked on the video, I wish you a good algorithm ❤
I originally believed your video was a clever april fools joke. This is incredible!
Your best work yet by far
Loved the video this was very interesting to watch. I can actually understand a lot of it after playing turing complete and nandgame. This sort of engineering feels adventurous, like you are trying to hack the matrix its so fun
15:05
Litterally my first thought was, you were inspired by Pokemon Sprite Decompression. Absolutely love seeing another video deal with that.
Nust love this deep dive in general!
Simply amazing, I love this stuff!
that was the best analogy for TAS ive ever seen. great job.
The audio quality is impressive.
Amazing video, that was really fun to watch.
I read through the write-up of this on TASVideos but it went way over my head, this is a much easier way to understand what exactly happens in the tas itself
P.s. the fantastic fist soundtrack in the background did not go unnoticed
Finally a worthy rival to using half A presses to travel to parallel worlds
i like how this video is in 4:3
I didn't plan that, but now that you mention it I could render my own video inside SMB1! Any 4:3 video will work.
Imagine going back in time with a tasbot and plugging it into Nintendo's own famicom and showing them this - back in 1985.
Excellent explanation, loved this
Superb work.
two small improvements that could be made to the tile selection:
A. the Floyd-Steinberg diffusion matrix could be used to get a slightly better fit.
B. Instead of merely looking at the current frame, you could look at a blend of the current and the previous frames, and the previous tile for that position. (this allows for slightly more fluid tile level animation and/or a few more grays/colors through temporal dither)
I like the idea for the Floyd-Steinberg diffusion matrix!
I think temporal interpolation wouldn't work too well here. Especially on frames that completely swap black and white, which would likely just be grey for a frame, reducing the impact of the immediate swap.
next you gotta play mario bros inside of the bad apple music video
A rule of the internet: if it can computer, can bad apple and doom
absolutely amazing video. remember me when you hit a million subs
So much expertise and time spent to produce bad apple in super Mario bros on the nes. I applaud the effort but goddamn man 😂
A lot of people will ask "why do this?", because from their perspective this was a waste of time or something, completely missing the point. I'm fascinated by old hardware, and I want to learn more about it. I think making a game that runs on the NES some day would be neat (even if it's not the best financial decision)
This was an exercise for myself to become more familiar with NES hardware and it's limitations. You might as well do something nobody has ever done before if you really want to prove to yourself that you got everything figured out.
@@100thCoin That's totally valid! Sorry if It came off as condescending. It's impressive as all hell, and I was just surprised it went into such a niche idea. The generic video player playing doom was the chef's kiss of the video in my opinion. It was all amazing, and i'm amazed at the skills involved.
Awesome video man!!
you kinda sound like stryder7x
sick video. creating an entire emulator just to get the audio working was definitely a shocker honestly lol
3:50
1: Kill bowser
2: He turns into object
3: Jump to open bus
4: ??????????
5: Profit
14:25 my man just reinvented the Pokemon 1st Gen sprite compression scheme
lovely video, informative and entertaining. thx
This video was a whole out of body experience, incredible lmao
Imagine if a game used a controller on the second port to stream data into the console for more advanced games
i like how your compression method is accidentally very similar to the way smb levels are compressed, lol
Great job really enjoyed the video :)
I like how you show maybe 10 seconds of Bad Apple, 3 seconds of your own game, but for some reason showed almost a full minute of a DOOM speedrun.
I figured showing more Bad Apple would be unnecessary since I already have the full video in a separate video. Since I don't have DOOM in a separate video, I might as well show it off.
Finally some good content on youtube
I actually want every video I see or make to look like Doom inside Super Mario Bros
Solid video dude. 10/10
The people that asked those questions should have read the submission in the description
genius way to advertize your game. ngl might actually get it later
if it exists, it (for whatever reason) will have bad apple on it
The entirety of SMB1 is probably a thousandth of the size of bad apple
wowee. I read the whole tasvideos writeup but this is far more understandable lmao
ok u left me drooling with this one
Thank you. I was wandering why do, when I casually play Super Mario Bros in world N after swapping cartridge, the Bad Apple video started.
Love that Pixelcraftien is such a popular commenter on literally everything that I can recognize that pfp anywhere
18:47 Okay I can't lie, something about 1,000 just feels. Right? Something about it being so simple, idk
so you basically used page flipping like GBA bitmap but with tiles? what an interesting way of pushing hardware that was slower than the DMG.
Good job on the video. I especially like the segments where you made changes in TAStudio in real time (such as at 14:03) to demonstrate how absolute control works. Its a very intuitive visual, and I imagine recording them without making mistakes and while keeping a pace that could be paired with your commentary wasn't easy.
I thought of an optimization to the controller reading code at 26:23 that could increase the sample rate and potentially (but probably not) allow the video to be rendered with a resolution of 32x24 tiles. Your method of reading controller inputs only uses standard controllers, and by extension only uses data line D0 (bit 0) of $4016. Consequently, forming a full byte of data takes eight controller pulses, or EOR instructions. If you instead used peripherals as input, you could use four data lines (D0-D3, bits 0-3) and could form a byte in only two pulses with this code:
EOR $4016
ASL A
ASL A
ASL A
ASL A
EOR $4016
EOR #$40 ; changed to #$40 from #$C0 since only bit 6 will be inverted
Doing this in the audio code would save 24 CPU cycles per byte (4 per EOR * 6 EORs saved). The code for reading inputs in the 32x24 video would no longer need to be a loop, since this code is small enough to remain unrolled. This would save the CPU cycles that loop overhead introduces. Unfortunately, I still don't think it saves enough cycles to allow all 384 bytes to be written in time, but it could be worth looking into.
I don't know what capabilities TAStudio has in regards to accessing peripheral slots, but they are accessible on real hardware. According to the expansion port page on the nesdev wiki, the unused expansion port at the bottom on the NES can access all five data lines of both $4016 and $4017 if nothing is plugged into the main controller ports. Therefore, a TAS that used the peripheral slots for input could still be console verified on an NES. Unfortunately, it would lose Famicom support since the Famicom expansion port cannot access every data line.
I was talking to people in the TASBot discord, and that's what they were suggesting too. I don't believe TAStudio has the ability to use the peripheral slots? One priority with this TAS was the ability to submit this to TASVideos, so making it work with TAStudio was a limitation.
Another suggestion I received (that's also not viable in TAStudio) was to never strobe the controller, and exclusively read from the A button, one bit at a time. This would save time in the loops since I no longer need to spend time strobing the controller.
I'm definitely considering working more on this to get a higher resolution video out of it.
Love to see computers absolutely fucking CLOWNING on Hammer Bros.
Woah, can't remember the last time I saw a new 4:3 youtube video
Awesome video as always! And you bet I paused and read every single explanations that you skipped over :D
Whats this about an even faster smb3 ace? XD
I'm glad you liked it! For the even faster SMB3 completion, I had to reach out to the nesdev discord and TASBot discord just to make sure my plan would work on actual hardware, and as far as I can tell, yes! I don't want to spoil too much, though the entire run in 9 CPU cycles. We're getting loose with the rules here, ha!
IT'S HERE
Now we need You're Mine playing in Super Mario Bros.
A bit of detail on how the SMB3 total control thing works to put you into World N, and on what it even means to be in a world that isn't 1 through 8, would have been neat. But considering how much detail you went into, that's really a nitpick. Very cool stuff!
I showed ASM code for reading controllers, though let me explain in a bit of detail what's going on. When the console reads from the NES controller, the first step is to "strobe" it. This records whatever buttons are pressed inside a shift register contained on the controller. Then, this data is read one bit at a time through 8 separate read instructions. After a bit is read, the shift register automatically shifts the bits over in preparation for the next bit to be read.
The nes has two different ways of playing audio samples. PCM, and DPCM. In this video, I covered PCM audio (writing samples to address $4011), so let's talk about DPCM for a minute.
Instead of manually writing each sample to the audio chip, DPCM audio is handled entirely by this chip! All the programmer needs to do is write to registers to set up the samples length (how many bytes), location (where does the sample begin?) and sample rate (how many samples per second). Then, the audio chip will automatically fetch bytes from the ROM whenever it's time for another sample to be played.
However, there is a hardware-level malfunction in fetching DPCM samples. If this happens on the same cycle the CPU is also fetching data from the controller, the controller gets "clocked" twice. This results in a single bit being read, yet the shift register will shift over 2 bits, effectively corrupting it. (at least, I'm pretty sure this is what happens...) In any case, DPCM audio samples can corrupt the controller.
Super mario bros 3 uses DPCM audio samples to play extra drums in the music, so they needed a way to prevent the controllers from being corrupt. Their solution is to read the controllers multiple times in a row. With a bit of math, we can confirm that the controllers will never be corrupt twice in a row. (it takes several hundred cycles between DPCM samples being fetched, but the audio loop only takes about 120 cycles.) SMB3 reads the controllers in a loop until two consecutive reads match.
The order of operation at the start of a frame in SMB3 is to swap out PRG banks to load code for updating the graphics, update graphics, read the controller, then restore PRG banks to whatever they were before loading in the graphics code. If we were to create a TAS that maliciously has alternating inputs, no two consecutive inputs will match, and the loop will go on forever!
SMB3's title screen seems to have two layers to it. The moving curtains, and a checkerboard floor that doesn't move. This effect is done by scheduling an interrupt request to happen after 196 scanlines have been rendered, in which case the code that's currently running will briefly be interrupted to run some code for updating the screen, then an RTI instruction will return back to whatever was running before the interrupt.
However, if we're still inside the controller reading routine when this happens, the wrong PRG banks are loaded! Instead of an RTI instruction, a series of RTS instructions get executed. This eventually leads to address $0001, so now RAM is executed as code. Once the controller reading routine finishes, it stores the data in RAM. I can use these bytes to write code in RAM that gets executed. I begin by making a JMP instruction back to address $0000, so I can continue to execute the first 256 bytes of RAM over and over again. Every frame, SMB3 will once again run the controller reading loop, updating the values in RAM, which I can then execute as code. This lets me carefully write a better input reading loop, which I then execute, allowing me to write anything I want anywhere I want, which I use to set up the payload at address $0181, and manipulate the bytes around $07C0+ to allow SMB1 to begin in world 'N'.
@@100thCoin Wow, thanks!
With such an elaborate SMB3 setup, is there any reason why is it not directly used for the entire TAS instead of swapping to a different cartridge?
Or was it specifically for entertainment purpose that SMB1 was swapped in to be used for the final step?
@@VinsCool The end goal is to run ACE inside SMB1. Ideally no cart swapping is needed, though there isn't a known way to do that yet.
Everyone knows about the SMB3 ACE, though ACE in SMB1 is fairly unheard of. I definitely could have done all this inside SMB3, I would have even had an extra 8 Kibibytes of RAM to work with, though I think the limitations of SMB1 are more interesting.
@10:28 Under the assumption the video is 3:32 long, runs at 30 fps and you would take 10 seconds to compare two pixelvalues it will take a bit less than 25.274 years to do it manually, no brakes
Where did you play Bad Apple in Super Mario? When?
Just wanted to cover all questions.
It was in world 'N' about a minute after the console was turned on.
As for "Who?" and "Which?", we may never know.
I know a rule is a rule, but this is going above and beyond.
The original famicom has two hard-wired controllers, and adapters exist which turn the expansion slot into two controller ports for American/European NES controllers.
And all four controllers are read independently, so you could have four controllers providing inputs at the same time. More controllers means more bandwidth!
The zapper also uses its own thingamajigger compared to normal controllers.
I actually improved my audio/graphics interlacing code for the DOOM demonstration to use one controller for audio and another for graphics. They both get strobed simultaneously when writing to $2006, so yeah, that does save a few cycles for each loop!
@@100thCoin I didn't watch that far into the video yet (assuming it's in the same video). I'm currently multiplexing my attention between multiple unrelated things.
@@100thCoin As for the Bad Apple music... Probably could have found a way to use the square and triangle wave channels to reduce the number of PCM samples required. A genetic algorithm or deep learning algorithm might help for generating the necessary NES soundchip data.
Alright hear me out: Realtime transcoding of a video source and streaming to the NES. It would be tight asf, and you'd need to overcome some fun challenges to get it going.
Also hottub streams would be wild lmao
I love that this video is 4:3