I tried setting this up at LAN parties a couple of years ago, definetely more hassle and also DNS would crap out at some point. Glad to see it is now a lot smoother operation.
We had DNS Setup at out local Lan as early as 2005. We announced our MAC of the LAN card on entry which got setup into the system and simply plugged in the cable. Worked without any issue at all!
@@Canady117 got a 3060 gaming laptop about 4 months ago. After experiencing 60fps and above for 4 months, I can't play on my ps4 slim anymore. I now feel dizzy playing on ps4.
This kind of experience is only marginally different than the average IT project. Every new piece of software is simple. Every implementation takes 3-4x longer than expected.
Surprising to see this - we did exactly this back in good ol 2001-2009 era. We basically had zipped copies of all installs on a webserver and everyone would get it from there. In the odd case where we needed something new, the admin would simply go out to the internet and provide it on the portal page.
I remember one lan I was the only person who rocked up with the latest updates but the site only had dialup. Luckily you could just copy steam files to other computers and the dialup was enough to verify
Me and my friends used to rent a cyber cafe for the weekend to play Warcraft 3, DotA 1 and Half-Life, they just put the games on the main computer to deliver the latest versions (Warcraft 3 was still receiving patchs at the time)
One quick tip, from fellow Lanparty organizer. Configure your router to steal all traffic for dstport 53 and redirect it to this cache! Mikrotik can do that. So many people will leave static configuration of their DNS and that will keep you wondering why the cache do not work... No matter how many times, you tell (even IT) people to configure DNS from DHCP they will not do it, because they are too lazy ;-)
Do you really run into that many gamers who have static DNS setup? I feel like that would be extremely uncommon as most folks just rely on their ISP DNS.
@@msavage960 Using your ISP DNS mean when they crash, you crash. using external DNS prevents crashes and allows you to continue using your service, while the guy down the hall from you yells because his Battlefield game was interrupted.
@@Kitosa_Hinoyosha exactly. Another reason is that ISP dns servers used to be very slow, so most of people (at least in my country) simply uses Google DNS, it is much faster to resolve and practically do not crash. And if you have a lot of people from IT, which is usually type of people on lan, they have it manually changed.
One side note: you cannot redirect traffic on cache directly, because packets would have bad source IP. But on Mikrotik you can enable local DNS server, make it ask your proxy. Then steal all traffic for port 53 (TCP and UDP) and redirect it to local DNS on Mikrotik. Also do not forget to create exception for your proxy server, so it can access port 53 without this, otherwise you will end up with infinite DNS loop 😎 if anybody needs I can send you working configs.
Love when you guys dive deep into actual IT components rather than just pc builds or talking about new consumer products! Don’t get me wrong I love them too but these types of videos grasp my attention
thats the least impressive part, most impressive part is that windows didnt just fall over when they changed DNS o wait it did, Well this video didnt impress me even a tiny bit
@@icanmakeeverythingilovedie9861 im not a linux snob but i deal with both on daily basis as i use both on daily basis (linux for work and windows for gaming) and i can say linux is much nicer to do stuff with, and when it comes to networking its specially bad
@@icanmakeeverythingilovedie9861 each operating systems sucks its just that for me linux sucks slightly less but at the end of the day windows is a great kernel saddled with horrible ux linux is good kernel saddled with 1000 uxs some ranging from horrible to usable ish
once you get access to a lot of hardware, and being paid to research and implement cutting edge tech we would pick stuff up. But we can all do it on a smaller scale too, my messing around with cheaper hardware and simulating it via open source software.
At his age I knew way more, but at the same time wasn't exposed to as much tech as I worked in a poor company in a poor country (Slovakia, eastern EU). I envy him too as he makes way more money in a way nicer job with way more tech and needs to know way less. And all this in a civilized country of Canada.
@@PLANTROON yeap, it is what it is, It's aight we just do what we can do. Like, I feel like I also probably know the same stuff, if not more, just cuz I mess with cheaper labs but simulate using software, It's really how spongy you are at absorbing stuff. For any of us, if we have interest and try, then there won't be a huge difference, its just a matter of not having that hardware on hand. Also, I live in a country which makes Slovakia 10 times better than mine lol. So yea, circumstances are a big part, but deep down, circumstances won't limit us as much as we think it does.
@@ahmedifhaam7266 what i thought as well. I told myself that I'll be fine here working online, but you still have to deal with local people, service providers, contractors, doctors, and there's just such a divide between the "western" way of doing things and this eastern idiocy, that it catches up to you. Despite working online, despite having money. So with advancing age I realized that any kind of life here is a compromise.
Formerly at the small ISP I manage we accomplished the same thing using a company called Qwilt. It was a game changer when we only had a small amount of backhaul. Once we upgraded our backhaul to way more that our subscriber base could use we decommissioned the server. It was so nice having about 100TB of cached content. Windows updates, Playstation and Xbox games as well as Netflix and many more video streaming sites. I've never seen PS4 games download that quick on any other network.
I imagine at some point it's the more sustainable solution. Throwing more compute/bandwidth/money at is a solution in general, but we really need to cut back on consumption.
I always hated requiring internet for local LAN play. I remember the days when we had LAN parties specifically because it was the fastest connection between computers.
That's not the problem here. Local LAN still exists in many games. The problem was the inability for everyone to download the games fast enough, due to a lack of bandwidth (each user would only get ~5-8mbps).
@@tbuk8350 Thats why we put People into Groups at Lan Partys so they could download it in a normal time, after that the other Group could download the Updates etc.
Is this cope because you LAN'd at a place with shit internet when you needed it? Your low latency LAN experience isn't going to be affected by the fact that people don't have the game pre-installed or by the authentication server that requires less than a kilobit per second. I am playing the world's smallest violin for you, gramps.
Any large professional lan party has a cache server like this so it's good to see that they're also following suit. The lan party I go to has between 500 and 700 people and absolutely needs one.
NPF in Denmark there's 5000 atendies with no caching server, they just ask people to download games from home. So yeah, not all Lan's are created equaly (this is the biggest in denmark fyi)
@@mrmotomoto that’s what I keep thinking but I guess it goes broader than that, for instance if the cache server gets to actively and smartly cache everything that goes through it, if it makes sense
Back in late 90s, we used Squid Cache with a dial up connection as a transparent cache, a bit like Linus is doing here, and it managed to support about 12 gamers without an issue browsing web 1.0 content. Granted, there wasn't RUclips, webpages were pretty simple and the majority of the games were still LAN based, but we got 4.5kb/s of that dial up shared between 12 computers, and it cached all our 'big' patch files and flash animations just fine. We had a 100Mbit hub, not even a switch IIRC for the LAN and honestly the cache was amazing when it worked allowing download speeds we could only dream of at the time. T1 all the way baby! hah... but terrible when it doesn't work. I'm sure cache servers got a lot better since the 90s as well.
yup did the same with squid, and a bunch of solaris servers, and later we added memcache servers as well :) good old days... my first modem was a supra modem 2400 baud.. after I decommissioned the diy acoustic coupled modem... lol...
That's how I had my share house set up, Linux server running on a bitsa P200 with a Bigfoot HDD, that's the non-MMX Pentium 200! The house was long and thin though so I had coaxial cable running in a loop past all the spots friends would plug into on the weekends, the network was fine for gaming until someone decided to copy a file in Winblows, then we'd all lag out and yell, "Who's copying what?!"
@@m-j107 I didn't say I was doing it now, I replied to a post which started, "Back in late 90s". Even if you'd missed that didn't the 200Mhz, non-MMX- Pentium CPU give you a hit it was a while ago? "Bigfoot HDD"?
After the windows 98 video I’m ungodly impressed with Jake’s incredible knowledge of server and network tech especially the really advanced stuff they play with on LTT. I’m a decade older and proud of setting up my wifi.
I think advanced networking stuff is one of those things you either get it really easily or you struggle bad. I dont think theres an in between. some peoples minds are just wired extremely well for troubleshooting.
@@Fanta.... I disagree with this, I mean, I dont know an incredible amount yet, but I think this is true only for the beginning. It doesnt make much sense until some things start clicking and everything falls into place
Well to be honest some people are just interested in it, others might need to use something simular for something at work and want to figure out how it works. So its nice that they do it tbh
That's also what I thought. If it is not aimed at us, then it should be demonstrating the technology used behind big Lan events. Even though it is probably what's being used, Linus should talk a bit about it.
I used to be capped at 4 GB a month until 2016, when the local rural cable TV monopoly got tired of clients calling to complain about the face book running out. I still only get about 5-6 Mb/s, when nobody else is online.
In the early 2000s, right when Steam was born, i attended a LAN party with _thousands_ of people ("Northcon"). Most of them still hauling CRTs to their place (including me). The _whole_ venue had like a 2 mbit/s dsl connection. 2 mbit/s for _everyone_. Downloading your games otf wasn't a thing, we still juggled discs, but this was the first year when people were playing Steam titles who had to be activated online for offline use. This was fun! 😎
linus: has an IT problem also linus: *gets free enterprise grade servers from mega-corporations* wow thanks everyone who liked and commented on this comment.
I mean, yeah; how many people making the purchase decisions for corporate IT projects do you think watch LTT vids? Converting just one of those people can pay for this entire project within a couple years.
I love this so much , back in the day , literally years ago I would of had no imagination as to what any of this was . But by being inspired by your videos , studying in uni and working my amazing job , all of this seems so obvious to me and very heard of as I work with the exact equipment every day ! I just wanted to thank you linus for the years of entertainment and educating , you have shaped me into the IT technician I am today !
I live here with 12Mbps (1.5MB/s), shared with a family of six, 4 of whom actively use it every day. We have to keep negotiating and coordinating our downloads, video watching and online gaming to avoid causing lags for one another. One day fiber will reach us... one day.
get a old PC and grab something like PFsense and setup a Cacheing DNS/Content Cacheing server you can do this Transparently. and no one will even know its there.. you will find even youtube etc/ will be a little smoother.
@@NicolaiWeitkemper is correct, pfsense is more trouble than its worth (can only offer negligible improvements if done right, but will hurt performance compared to consumer routers if done incorrectly), and there is 0 point in building a caching server as virtually everything that can be cached will have already been done so by the browser. Starlink is an option if you get lucky in terms of waitlist and can spend $100/mo on internet. If you're not in rural america look up the available ISPs in your area, there may be competition or the same ISP may offer faster speeds and have never upgraded you as they have no incentive to do so unless you are a new customer
At the very least in terms of (EDIT: streaming services like netflix and amazon video [two that I know have that option]), couldn't you guys have some stuff downloaded for offline viewing overnight or during downtimes? Another possible thing that could help is making sure they change to 480p or less for youtube vids if the actual picture quality isn't important. Another thing you ould do if you have a configurable router is to force speed limits on the devices so no single device can choke the others out.
I’m in exactly the same place as you, my solution : Buy a router, stick it to your pc through Ethernet, get your family on the houses wifi. Turn off the wifi at will through the web portal. I also created a hidden ssid guest network for myself.
The fact that your home has faster internet than your business is a problem I’d dream to have. Does the new house have 10 Gbps internet? I recall you & Jake mentioning that it was possible.
My house already has better internet, but that’s because I work at AutoZone 😂😭 our internet is so slow Speedtest won’t even work, it doesn’t even fail, it simply doesn’t go anywhere at all lol.
Thats a wasteful dream that you wouldn't even notice a difference between 1 Gbps to a 10 Gbps on a daily driver run. Doubt you would download warzone daily.
@Trippy SZN I don't think he'd drink right before arranging a 200 people LAN party.. he probably just woke up before shooting that last clip.. also there was a lot of noise in that server room, they probably had to process his voice audio a lot.. I'm a video editor and it's a real nightmare to make audios like that sound somewhat normal. All this combined, you get a perfect drunk weird linus voice.
Love how the whole purpose of the video is that 8Mb/s per player is not enough, while my home connection doesn't even reach that. Really makes you feel good hearing that
Linus, I honestly wish I was able to experience internet speeds like this. My download should be somewhere around 10mbps but I pretty much only get half of that, and my upload speed cap is 1mbps. It's honestly painful that most Canadian internet service providers don't give any proper attention at all to isolated First Nations reserves. I've got 10/1 speeds in 2022 and I literally cannot keep up with everybody else anymore.
In Turkey a one internet company changed meaning of 1gbps they sold 1000 mbps upload and download with regular internet price and they are giving this service with their own infrastructure I don't believe that I am using 1000 mbps in turkey its like a dream
Back in 2016 when I was living in Costa Rica I had to get used to 330kbps download speed 😂 GTA would take 48 hours to download, now I have 35mbps download and even though it isn’t fast by 2022 standards it feels Lightning speed in comparison.
I remember going to LANs (my last one was in 2013 though) and they also did this. Actual download speed was garbage, also around 5-8 MBit, but the caching method was amazing.
You clearly don’t understand how internet works 🙄😬 /s Edit: that was obviously a joke but as I’m watching the video, it seems like that kind of was Linus’s solution
I been looking at making this kind of cache since I plan on hosting some LANs down the line. It also has a lot of benefits for average use since the local cache can cache a lot of web content that can just be fed back to you on your local net instead of having to constantly redownload a bunch of content all the time.
I think LAN Cache is only setup for actual downloads like particular games servers and Windows Update. It's not a web cache which grabs anything the user looks at. In fact that concept is practically obsolete unfortunately due to https encryption used everywhere. You simply can't switch the source that way on https like you could on http.
In the last decade cache web content has gotten much harder. HTTPS basically requires you to man-in-the-middle every user to inspect whether a request is cachable. Game downloads work because the whole system is designed to be cachable via CDNs and ISPs. They purposely send the large files over insecure HTTP then verify the files over a seperate secure channel.
Yeah, TIL that apparently a lot of heavy payloads for game services and Windows are sent over http and it is not a big problem. Windows Update, for example, does a special https handshake before the payload is transmitted and this secure channel shares a hash of the payload signed by a Microsoft certificate. On the your end, Windows verifies the payload hash using Microsoft's public certificate. So, in theory, an attacker would have to forge a certificate or compromise https, none of which are feasible. Even though the payload is sent in plain! It's very neat!
500watts is probably most common if you have 200 watts of overhead on the server . they dont generally let you O.C. server gear . potentially psu efficiency curve or future cpu thoughts
I don’t know which I like more: That Linus went there with the EPIC/Steam joke or that Jake threw objects at Linus for going off script. Best. Intro. EVAR!
@@LikeABawzs Can’t say I’m worried if it was actually in the script or not. I just heard, “It’s going to be EPIC!” and had the immediate reaction that “you _can’t_ let that one go!” Linus did not disappoint and it only went downhill from there in the best way possible. 😄
just a random thankyou for doing what you do. Through the good the bad and the ugly your videos cheer me up. the world may be messed up but you are one of the things that keep me going, thankyou and i mean it. things are not good but you and your videos are one of the few lights to my long dark nights. keep on teching, we all got this one way or another. let LTT live on forvever
I run a 10-person LAN on 30mbps with this technique plus some aggressive traffic shaping. 👌 Not quite this hardware though...a cobbled together machine full of spare SSDs LVM-striped!
@@ahmedifhaam7266 traffic shaping is where you limit certain kinds of network activity. So cutting things like file sharing in favour of online gaming.
As someone who worked at a gaming hubs/computer cafes/computer shops, i have learned that you can just download the game once and just share/copy the files via a server to every PC that needs the files, its more efficient and downloading is only done once
I actually followed that same Raid tutorial at the beginning of the year to setup my media drive for my Ubuntu 20.04 server and I also use Netdata on it As a helpdesk tech, watching Linus bork a DNS flush is funny
This solution could work really well for us steam deck owners, being able to install a game on my PC, have it cache to a local server for when I install that game on my steam deck sounds awesome My current solution has just been a network share on my windows PC, but that has had issues, main 2 issues are that if I want to play that game on my PC while it transfers to my steam deck the transfer speed dies since the files are being read by my steam deck and my PC playing the game, and the other issue is with any game I have mods installed for, since the local copy on my PC will have those mods installed they will be transfered to my steam deck
I think you can make a Steam Cache server, it will copy/download it's own copy of a Steam as your PC is downloading it. When you're home and you want to download that same game to your Steam Deck (or any other device), it will pull it from the Steam Cache server if it's faster to do so. If it still exists, I have never used it myself but I heard a friend about it once.
@Lurch7861 lmao why are you in all the comments talking about WWIII and about how "smart" you are for hoarding shit. If another world war were to happen, having access to offline gaming would be the LEAST of anyone's worries, believe me.
I'm surprised that you only went with a dual 25 GbE NIC instead of either dual 100 GbE or something like that. The fact that you were able to peg it to 50 GbE pretty quickly and easily suggests that you could've given it even more bandwidth to pull from. It works, but it can always work better.
The V2 version of the LTT screwdriver should have a LED light at the end to light up when detetecting pressure on the screw bit, making it easier to use in dark places or inside cases. Just putting that out there ;-)
Id prefer a button in the handle. Because in your solution you could be already pokin on a harmfull place before you see what you are pokin at. And once you lift it up to change position you still could miss because light has gone off.
I can appreciate coming up with some premise for this video to help justify the project, and admittedly 2GBs for 250 people may not be adequate, it cannot be forgotten that it is unlikely that all 250 people will be pegging their connections simultaneously. This is how companies that have far far far more employees in a single building using the Internet all day for their jobs (online docs/sheets, meetings, voip and chat support, and casual music and youtube streams) can get away with 10GBs or less office connections. An inverse analog could be an application server that might traditionally only have a 1GBs link that might be serving an app to hundreds of thousands of people per day, or a hundred'ish such apps spread over a few machines all flowing traffic through a single 10GBs nat, waf, vswitch, switch, or edge. The key is the amount of data each use, and when and for how long they actually use it. You overprovision network just like you overprovision other resources to maximize the usage of those resources so you're not spending money needlessly. It is a fun video though. It is probably fine to let that many people have access to 2GBs, unless they're all downloading all at once. This *is* however the appropriate solution to the potential problem of choking the edge.
At a LAN party however I would suspect that there would be a lot of traffic for people downloading games, say if people decided they wanted to play another different game, that would easily saturate the connection and having this server would free up bandwidth for things that can’t be cached (like actually playing the games).
Exactly like Luke said, why burn up your external link when you can just transfer it at local network speeds in a fraction of the time. Bonus is you have more people playing games for more time and not waiting on a download.
Running this on our LAN party for years now. Very nice piece of software. Together with a traffic shaper and policy based routing it enables us to use ~100 devices on two 50MBit connections. One for the cache, one for the users.
As much as I love beautiful stabilised shots of B-roll, the one shot at 4:15 of the back of the server having that little shake to it brings an air of humanity to b-roll in a way I can't describe. Still beautiful
7:08 I'm all for getting creative and making things when you need to make them work... but damn it, that mini-sas u.2 cable chain monstrosity is going to haunt my dreams for weeks.
This can also be used when you have really slow internet and more than 1 person who is a gamer / has a pc / windows machine (windows updates anyone) in your house. It helps save what little B/W you have by caching it locally. And if you are a tech person or someone who builds pc/formats on a regular basis having 90%+ of your stuff cached on your LAN can be a life changing experience!
fortunately for me, our ISP does all the caching, and they do not charge for cached stuff, even youtube videos and cached netflix, not only on fiber, but also on mobile data, they do not charge for the cached stuff as much, very cool
i love that steam has that feature build in, i have like 2,5 tb games on my pc all on ssd. last week i had a friend over and he was able to download from my pc with like 2,5 gig per sec
Regarding the CPU usage (Or lack thereof), nginx tries hard to use sendfile(), which is a Linux API that speeds up sending data by a lot while saving on CPU cycles. Personally I don't have much to do with networking so it's nice to see in action :)
AS funny as massive overkill is I'd much rather see a video like this with more reasonable hardware. e.g. if you had a budget of a few thousand dollars what is the best caching server you could build?
LTT: We're doing a lan Sponsors: Here's some cool equipment. Slot us in somewhere, you'll figure out how to use it ;) Legitimately impressed by how much you all are able to accomplish with the equipment provided. Being able to know the technical side of things, but also sell it in front of a camera is amazing skill.
10:34 Speaking of Ubuntu. After 10 years of daily driving Ubuntu, and suffering through the last three years with a crazy glitch that infinitely fills my hard drive with log files (expecting every major update to fix the problem but they never did), I have now finally ditched Ubuntu for Arch (due to Steam OS 3.0 using Arch I figured I may as well make the leap). It's actually good timing because Arch recently got updated with the "Archinstall" command, which makes installation a million times easier (or in my case "Infinitely Easier" because after two days of trying to resolve a signature key error the ONLY way to install Arch was through the automated Archinstall process).
Can you provide a link to the bug report? I came across a bug like that ten years ago or something, but I was never able to recreate it, so I just bypassed it and forgot about the whole thing until you mentioned it.
"you're likely not redownloading the same game very often" I feel called out because my internet usage on my home network was something like 18 TB in a month because that is all I do.
I was actually thinking if a solution like ipfs would be viable for such as a scenario since the computers could file share between them in peer to peer fashion
Reminds me of the server rooms from college. I would visit there on a frequent basis as my father knew one of the lecturers when I was a kid, so he just got me to go complain about small things instead of walking all the way to the techs. Half the time they didn't have a clue what I was on about until I explained it in more simple terms like "There is a malicious program eating all the files".
"only gig" (to each station). Gotta love 2022. I remember LAN parties on dual ISDN 64k channels, playing Rainbow Six: Eagle Watch/Rogue Spear/etc, back in 1998ish.
Always put a dummy compressed file on mission critical server boot files that takes up ~ 10% of the drive when you install it. Then when things go wrong and the boot drive gets filled, you have a simple way to free space and work out what's going on.
Around a decade ago, I used to think "when will I ever need more than 1MB/s on my downloads". Now I'm a happy 1.5Gbit symmetric internet connection customer
1 mb/s is still okay, it's slow, but it's workable as long as you don't need it all the time (for example downloading a game only every week or so). It's enough to play and discord I think (I did it with 400 kbyte/s...and this got shared with my brother at the same time!) Although this was me and him playing combat arms 10 years ago, and skyping. Then we noticed we could just get 800kbyte/s by calling our provider, was like a dream.
oh boy I remember going from 125 Kbps to 1 Mbps download speed, it was FAST! those were the days that when you wanted to play an online game you had to leave it downloading over night, or sometimes even for a couple days lol
@@ReptilianLaserbeam once I was trying to download a game and it said it's going to take a year, and I actually didn't mind, I let it run for a few weeks, before some interruption stopped it
There's actually an unraid ready docker that uses monolithic lancache, I set it up at my house like 2 weeks ago :)... dns wasnt very fun with pihole though
Just one minor correction: In true CNCF form, you *should* run each service you want to cache in its own container. Docker containers should be designed to be lightweight and single purpose. You will ultimately have better performance sequestering your: caching services, routing layer (nginx / traefik), storage layer (dbs, redis / memcached) and other components Sure its easier having one instance - however thats why things like docker-compose & kubernetes exist, they allow for declarative orchestration of containers
17:31 that explains why this one game I got for free (ark survival evolved) takes hours to download 12 GB meanwhile fallout 76 can be downloaded in less than an hour despite being significantly larger. to clarify, i have gigabit internet. this shouldn't be a problem, but it is
This channel has gone
0
DAYS
without Linus dropping something.
lmao
Keep it up, if there is no drop, that is no linus
WE ALL HOPE LINUS IS GONE!!!!!!
Someone hand him a mic!
*0.001 hours
"That's 1MB/sec" - That is literally my normal internet speed. On a good day.
1 MB /s is 8 Mb / s
Same
Same
I have 5-15 MB/s download speed
Same
I wonder what generates more heat in this scenario... the PC's, or the sweaty gamers?
pcs lol
@@MrPruske I bet the PC's will shower more
Pcs
I remember hearing somewhere that humans are like ~250 watts.
"we are sponsored by intel" oh so you admit you are subsidized by the government.
I tried setting this up at LAN parties a couple of years ago, definetely more hassle and also DNS would crap out at some point. Glad to see it is now a lot smoother operation.
And as soon as you have two connections, the system breaks more often than it really works. Have seen that happening to often 😂
We had DNS Setup at out local Lan as early as 2005. We announced our MAC of the LAN card on entry which got setup into the system and simply plugged in the cable. Worked without any issue at all!
you know, after having gigabit internet, it *is* really hard to go back. it's a lot like having an SSD and going back to a HDD speed-wise
Or going from 60+FPS back down to 30
@@Canady117 got a 3060 gaming laptop about 4 months ago. After experiencing 60fps and above for 4 months, I can't play on my ps4 slim anymore. I now feel dizzy playing on ps4.
@@Canady117 not really the same
@@Canady117 I play at 144hz usually, and I immediately notice when it is below 90-ish
@@MrScorpianwarrior yeah its like still smooth but then your like "this is kind of choppy" even though its at 90 fps lol
This kind of experience is only marginally different than the average IT project. Every new piece of software is simple. Every implementation takes 3-4x longer than expected.
And the project manager only allocated so much labor
True story.
@@lordcommander3224 1 story point only 😅
Bugs are basically the mythological Hydra.
If only i had 8mb a second
Surprising to see this - we did exactly this back in good ol 2001-2009 era. We basically had zipped copies of all installs on a webserver and everyone would get it from there. In the odd case where we needed something new, the admin would simply go out to the internet and provide it on the portal page.
👍
Back when you could actually get an install file
I remember one lan I was the only person who rocked up with the latest updates but the site only had dialup.
Luckily you could just copy steam files to other computers and the dialup was enough to verify
Me and my friends used to rent a cyber cafe for the weekend to play Warcraft 3, DotA 1 and Half-Life, they just put the games on the main computer to deliver the latest versions (Warcraft 3 was still receiving patchs at the time)
Old times are gold today
I swear every time Linus and Jake are in a video together it's like two brothers arguing for the entire length of the video and I love it.
One quick tip, from fellow Lanparty organizer. Configure your router to steal all traffic for dstport 53 and redirect it to this cache! Mikrotik can do that. So many people will leave static configuration of their DNS and that will keep you wondering why the cache do not work... No matter how many times, you tell (even IT) people to configure DNS from DHCP they will not do it, because they are too lazy ;-)
the lan has already happened but this is a great tip
Do you really run into that many gamers who have static DNS setup? I feel like that would be extremely uncommon as most folks just rely on their ISP DNS.
@@msavage960 Using your ISP DNS mean when they crash, you crash. using external DNS prevents crashes and allows you to continue using your service, while the guy down the hall from you yells because his Battlefield game was interrupted.
@@Kitosa_Hinoyosha exactly. Another reason is that ISP dns servers used to be very slow, so most of people (at least in my country) simply uses Google DNS, it is much faster to resolve and practically do not crash. And if you have a lot of people from IT, which is usually type of people on lan, they have it manually changed.
One side note: you cannot redirect traffic on cache directly, because packets would have bad source IP. But on Mikrotik you can enable local DNS server, make it ask your proxy. Then steal all traffic for port 53 (TCP and UDP) and redirect it to local DNS on Mikrotik. Also do not forget to create exception for your proxy server, so it can access port 53 without this, otherwise you will end up with infinite DNS loop 😎 if anybody needs I can send you working configs.
Love when you guys dive deep into actual IT components rather than just pc builds or talking about new consumer products! Don’t get me wrong I love them too but these types of videos grasp my attention
yeah, i loved to see them using netdata. it's such a great software
I have never heard RAID anything on this channel so it's surely refreshing and a solid video!
@@JohnAdams-bh9zc they made a lot of videos about RAID, NAS and stuff ruclips.net/user/LinusTechTipssearch?query=raid
@@davidak_de must have missed it, good to know for future reference 💪
to bad he was calling the sas card u.2 and u.2 card sas
The most impressive part here is probably Linux handeling all the caching and hardware control perfectly out of the box and for free
thats the least impressive part, most impressive part is that windows didnt just fall over when they changed DNS o wait it did, Well this video didnt impress me even a tiny bit
o7🐧
@@bigpod Found the Linux snob.
@@icanmakeeverythingilovedie9861 im not a linux snob but i deal with both on daily basis as i use both on daily basis (linux for work and windows for gaming) and i can say linux is much nicer to do stuff with, and when it comes to networking its specially bad
@@icanmakeeverythingilovedie9861 each operating systems sucks its just that for me linux sucks slightly less but at the end of the day windows is a great kernel saddled with horrible ux linux is good kernel saddled with 1000 uxs some ranging from horrible to usable ish
I love it when LTT delves into these highly technical projects. Who'd have thought this is how LAN events might be setup.
Who hadn't thought that? When you get 200+ ppl accessing the same resource, it's damn obvious to cache things, no?
@@th0bse_ if you have more knowledge than the average computer user, sure, but most people dont even know what caching does
Learning how old Jake is now I am really envious of him to know so much in the server space and having such a cool job
once you get access to a lot of hardware, and being paid to research and implement cutting edge tech we would pick stuff up. But we can all do it on a smaller scale too, my messing around with cheaper hardware and simulating it via open source software.
Ya probably doesn’t even feel like a job to Jake lol
At his age I knew way more, but at the same time wasn't exposed to as much tech as I worked in a poor company in a poor country (Slovakia, eastern EU). I envy him too as he makes way more money in a way nicer job with way more tech and needs to know way less. And all this in a civilized country of Canada.
@@PLANTROON yeap, it is what it is,
It's aight we just do what we can do.
Like, I feel like I also probably know the same stuff, if not more, just cuz I mess with cheaper labs but simulate using software,
It's really how spongy you are at absorbing stuff. For any of us, if we have interest and try, then there won't be a huge difference, its just a matter of not having that hardware on hand.
Also, I live in a country which makes Slovakia 10 times better than mine lol. So yea, circumstances are a big part, but deep down, circumstances won't limit us as much as we think it does.
@@ahmedifhaam7266 what i thought as well. I told myself that I'll be fine here working online, but you still have to deal with local people, service providers, contractors, doctors, and there's just such a divide between the "western" way of doing things and this eastern idiocy, that it catches up to you. Despite working online, despite having money. So with advancing age I realized that any kind of life here is a compromise.
Formerly at the small ISP I manage we accomplished the same thing using a company called Qwilt. It was a game changer when we only had a small amount of backhaul. Once we upgraded our backhaul to way more that our subscriber base could use we decommissioned the server. It was so nice having about 100TB of cached content. Windows updates, Playstation and Xbox games as well as Netflix and many more video streaming sites. I've never seen PS4 games download that quick on any other network.
same here, now we cache, youtube, netflix, heroku, ms updates, steam, facebook and many more !
I imagine at some point it's the more sustainable solution.
Throwing more compute/bandwidth/money at is a solution in general, but we really need to cut back on consumption.
@@lennihein Consumption in what sense? Also, who is "we"?
JAKE'S JOB DESCRIPTION IS JUST PERFECT RIGHT NOW. I love when he just sort of helps Linus and Linus gets miffed.
Also EVERYONE says MW2 lol
@@YakulDeath it's the same number of syllables, but far fewer consonant sounds to slow you down.
Its fewer syllables if you pronounce W as "dub" for shortness as I do
I always hated requiring internet for local LAN play. I remember the days when we had LAN parties specifically because it was the fastest connection between computers.
That's not the problem here. Local LAN still exists in many games. The problem was the inability for everyone to download the games fast enough, due to a lack of bandwidth (each user would only get ~5-8mbps).
@@corporealcasimir4885 Might not know what games others at the LAN party would want to play. I've had it happen to me before.
@@tbuk8350 - even enabling local LAN play, newer games still require you to be logged in
@@tbuk8350 Thats why we put People into Groups at Lan Partys so they could download it in a normal time, after that the other Group could download the Updates etc.
Is this cope because you LAN'd at a place with shit internet when you needed it? Your low latency LAN experience isn't going to be affected by the fact that people don't have the game pre-installed or by the authentication server that requires less than a kilobit per second. I am playing the world's smallest violin for you, gramps.
Any large professional lan party has a cache server like this so it's good to see that they're also following suit. The lan party I go to has between 500 and 700 people and absolutely needs one.
Do people not show up with the game they’re gonna ply already installed?
NPF in Denmark there's 5000 atendies with no caching server, they just ask people to download games from home. So yeah, not all Lan's are created equaly (this is the biggest in denmark fyi)
@@mrmotomoto that’s what I keep thinking but I guess it goes broader than that, for instance if the cache server gets to actively and smartly cache everything that goes through it, if it makes sense
@@mrmotomoto if Windows pushes an update or you want too download a new game you didn’t know before. Too keep if off the internet.
@@llamaduden3397 yikes thats some bad IT setup
Back in late 90s, we used Squid Cache with a dial up connection as a transparent cache, a bit like Linus is doing here, and it managed to support about 12 gamers without an issue browsing web 1.0 content. Granted, there wasn't RUclips, webpages were pretty simple and the majority of the games were still LAN based, but we got 4.5kb/s of that dial up shared between 12 computers, and it cached all our 'big' patch files and flash animations just fine. We had a 100Mbit hub, not even a switch IIRC for the LAN and honestly the cache was amazing when it worked allowing download speeds we could only dream of at the time. T1 all the way baby! hah... but terrible when it doesn't work. I'm sure cache servers got a lot better since the 90s as well.
yup did the same with squid, and a bunch of solaris servers, and later we added memcache servers as well
:) good old days... my first modem was a supra modem 2400 baud.. after I decommissioned the diy acoustic coupled modem... lol...
That's how I had my share house set up, Linux server running on a bitsa P200 with a Bigfoot HDD, that's the non-MMX Pentium 200!
The house was long and thin though so I had coaxial cable running in a loop past all the spots friends would plug into on the weekends, the network was fine for gaming until someone decided to copy a file in Winblows, then we'd all lag out and yell, "Who's copying what?!"
@@m-j107 I didn't say I was doing it now, I replied to a post which started, "Back in late 90s". Even if you'd missed that didn't the 200Mhz, non-MMX- Pentium CPU give you a hit it was a while ago? "Bigfoot HDD"?
Linus and his tradition to drop things never gets old
The fbi is here and they're very angry at you and if you don't care you'll be brutally executed
Seems scripted at this point haha, seems to be only SSDs.
what's up
@@dmhamw5982 not much lol
As a networking fan and self-learner, there is something that just gets me so excited seeing networking gear, I absolutely love it
After the windows 98 video I’m ungodly impressed with Jake’s incredible knowledge of server and network tech especially the really advanced stuff they play with on LTT. I’m a decade older and proud of setting up my wifi.
I think advanced networking stuff is one of those things you either get it really easily or you struggle bad. I dont think theres an in between. some peoples minds are just wired extremely well for troubleshooting.
It's just too bad about his attitude, he'd be a really unpleasant co-worker.
@@Lu-db1uf Why, because he's not licking Linus' boots?
@@Lu-db1uf isn't the attitude just a character on screen?
@@Fanta.... I disagree with this, I mean, I dont know an incredible amount yet, but I think this is true only for the beginning. It doesnt make much sense until some things start clicking and everything falls into place
Linus: 8mb/s is slow
My internet half the time: "not too bad'
got 10 in germany and that is like standard XD F
i get 3 lol
Tfw 120 a month for maybe 25 down... More realistically 12...
@@ThunderTurkey100 lol. 65 a month and 500/500. fiber baby
@@Stackali I had 500/500. Im now running 100/10. Had no use for it and price went from 70 euro a month to 35.
i love it when they explain it to us like we're gonna spend $100k on a LAN party like it's an every day thing
Well to be honest some people are just interested in it, others might need to use something simular for something at work and want to figure out how it works. So its nice that they do it tbh
They could have got away with a lot cheaper hardware, though it'd have taken up a bit more physical space.
It scales. You might have a 6 person LAN party and only a 20Mbit Internet.
That's also what I thought. If it is not aimed at us, then it should be demonstrating the technology used behind big Lan events. Even though it is probably what's being used, Linus should talk a bit about it.
@@grimzkunk This was developed by the people behind the big LAN events of Insomnia and epic.lan.
He did say "Slash Slash"
He says "Slash Flush", but he says it so quickly that you can barely tell. Either way, I'm not blaming Linus for that one.
"We're running out of Internet"
*I literally tell myself this every day*
If we're running out of anything, it's "intelligent internet".
go egypt they still have download caps on very slow dsl or fiber if u r lucky .
2GB/day vibes.
@@0xDEAD_Inside I have 1.5 lol
I used to be capped at 4 GB a month until 2016, when the local rural cable TV monopoly got tired of clients calling to complain about the face book running out.
I still only get about 5-6 Mb/s, when nobody else is online.
In the early 2000s, right when Steam was born, i attended a LAN party with _thousands_ of people ("Northcon"). Most of them still hauling CRTs to their place (including me). The _whole_ venue had like a 2 mbit/s dsl connection. 2 mbit/s for _everyone_. Downloading your games otf wasn't a thing, we still juggled discs, but this was the first year when people were playing Steam titles who had to be activated online for offline use. This was fun! 😎
I remember a Half Life 2 review that marked away a few points because of forced online activation.
Northcon was a German LAN a friend told me anecdotes about it
linus: has an IT problem
also linus: *gets free enterprise grade servers from mega-corporations*
wow thanks everyone who liked and commented on this comment.
yes
seems like intel is always the one saving the day
Sponsored by intel-aka ur salvation
@@turtleguy8914 fr
I mean, yeah; how many people making the purchase decisions for corporate IT projects do you think watch LTT vids? Converting just one of those people can pay for this entire project within a couple years.
I love this so much , back in the day , literally years ago I would of had no imagination as to what any of this was .
But by being inspired by your videos , studying in uni and working my amazing job , all of this seems so obvious to me and very heard of as I work with the exact equipment every day !
I just wanted to thank you linus for the years of entertainment and educating , you have shaped me into the IT technician I am today !
What kind of university program did you study?
I live here with 12Mbps (1.5MB/s), shared with a family of six, 4 of whom actively use it every day. We have to keep negotiating and coordinating our downloads, video watching and online gaming to avoid causing lags for one another. One day fiber will reach us... one day.
get a old PC and grab something like PFsense and setup a Cacheing DNS/Content Cacheing server you can do this Transparently. and no one will even know its there.. you will find even youtube etc/ will be a little smoother.
@@NicolaiWeitkemper is correct, pfsense is more trouble than its worth (can only offer negligible improvements if done right, but will hurt performance compared to consumer routers if done incorrectly), and there is 0 point in building a caching server as virtually everything that can be cached will have already been done so by the browser.
Starlink is an option if you get lucky in terms of waitlist and can spend $100/mo on internet. If you're not in rural america look up the available ISPs in your area, there may be competition or the same ISP may offer faster speeds and have never upgraded you as they have no incentive to do so unless you are a new customer
At the very least in terms of (EDIT: streaming services like netflix and amazon video [two that I know have that option]), couldn't you guys have some stuff downloaded for offline viewing overnight or during downtimes? Another possible thing that could help is making sure they change to 480p or less for youtube vids if the actual picture quality isn't important.
Another thing you ould do if you have a configurable router is to force speed limits on the devices so no single device can choke the others out.
I’m in exactly the same place as you, my solution : Buy a router, stick it to your pc through Ethernet, get your family on the houses wifi. Turn off the wifi at will through the web portal. I also created a hidden ssid guest network for myself.
Nothing some queues couldn't solve. High-resolution videos might still take time to buffer, but services like VoIP and gaming are protected.
The fact that your home has faster internet than your business is a problem I’d dream to have. Does the new house have 10 Gbps internet? I recall you & Jake mentioning that it was possible.
My house already has better internet, but that’s because I work at AutoZone 😂😭 our internet is so slow Speedtest won’t even work, it doesn’t even fail, it simply doesn’t go anywhere at all lol.
Thats a wasteful dream that you wouldn't even notice a difference between 1 Gbps to a 10 Gbps on a daily driver run. Doubt you would download warzone daily.
Shut up or they...
Will brutally torture you and it's gonna be eextremely painful
Bell is now offering multi-gig home internet in my area... 3 gbps up/down.. very tempting!!!
@@UnoZero1 Except for downloading games you probably won't notice much above 100mbps
Jake asking his boss "Are you drunk, buddy?" while Linus struggles to type the correct command is some ballsy shit. lmao
@Trippy SZN I don't think he'd drink right before arranging a 200 people LAN party.. he probably just woke up before shooting that last clip.. also there was a lot of noise in that server room, they probably had to process his voice audio a lot.. I'm a video editor and it's a real nightmare to make audios like that sound somewhat normal. All this combined, you get a perfect drunk weird linus voice.
Canadians are always drunk unless confirmed otherwise.
Timestamp?
@@Yoaru 16:18
Love how the whole purpose of the video is that 8Mb/s per player is not enough, while my home connection doesn't even reach that. Really makes you feel good hearing that
Linus, I honestly wish I was able to experience internet speeds like this. My download should be somewhere around 10mbps but I pretty much only get half of that, and my upload speed cap is 1mbps.
It's honestly painful that most Canadian internet service providers don't give any proper attention at all to isolated First Nations reserves. I've got 10/1 speeds in 2022 and I literally cannot keep up with everybody else anymore.
That sucks.
In Turkey a one internet company changed meaning of 1gbps they sold 1000 mbps upload and download with regular internet price and they are giving this service with their own infrastructure
I don't believe that I am using 1000 mbps in turkey its like a dream
15% of Germany has theses speeds aswell don't you worry. Just push the car lobby, who needs Internet even?
is StarLink a viable option for you?
Back in 2016 when I was living in Costa Rica I had to get used to 330kbps download speed 😂 GTA would take 48 hours to download, now I have 35mbps download and even though it isn’t fast by 2022 standards it feels Lightning speed in comparison.
just make a local cache of the whole internet and you'll have infinite download speeds
My friend and I back in gradeschool used to make a similar joke about putting the shortcut for Internet Explorer on a floppy disk
@DONT READ MY PROFILE PICTURE ok i wont
If you lived here you'd be home by now
Basically every web search engine like Google
A small company called cloudflare had the same idea a few years ago ;)
I remember going to LANs (my last one was in 2013 though) and they also did this. Actual download speed was garbage, also around 5-8 MBit, but the caching method was amazing.
I always love it when you’re telling us about your “slow” internet speeds when they are like 5-10 faster than what I experience
just download more internet lol
You clearly don’t understand how internet works 🙄😬 /s
Edit: that was obviously a joke but as I’m watching the video, it seems like that kind of was Linus’s solution
@@quintonconoly it’s a joke 💀
@@quintonconoly whoooooooosh
yeah DUH
lol
I been looking at making this kind of cache since I plan on hosting some LANs down the line. It also has a lot of benefits for average use since the local cache can cache a lot of web content that can just be fed back to you on your local net instead of having to constantly redownload a bunch of content all the time.
I think LAN Cache is only setup for actual downloads like particular games servers and Windows Update. It's not a web cache which grabs anything the user looks at. In fact that concept is practically obsolete unfortunately due to https encryption used everywhere. You simply can't switch the source that way on https like you could on http.
In the last decade cache web content has gotten much harder. HTTPS basically requires you to man-in-the-middle every user to inspect whether a request is cachable.
Game downloads work because the whole system is designed to be cachable via CDNs and ISPs. They purposely send the large files over insecure HTTP then verify the files over a seperate secure channel.
@@handspiker1994 thanks for explaining this, I was wondering why they weren't having any certificate issues
Yeah, TIL that apparently a lot of heavy payloads for game services and Windows are sent over http and it is not a big problem. Windows Update, for example, does a special https handshake before the payload is transmitted and this secure channel shares a hash of the payload signed by a Microsoft certificate. On the your end, Windows verifies the payload hash using Microsoft's public certificate. So, in theory, an attacker would have to forge a certificate or compromise https, none of which are feasible. Even though the payload is sent in plain! It's very neat!
500watts is probably most common if you have 200 watts of overhead on the server . they dont generally let you O.C. server gear . potentially psu efficiency curve or future cpu thoughts
Also, far less thermal loading and general stress on the silicon of the switching FETs & diodes used in the PSU
seeing you guys download 8gigs in like 15 secs made me cry, i usually have to wait like 3-4 hours for that lol
Try 14+ hours for me. It's sad. Faster internet options can't come fast enough!
You guys do it in less than a day?
Thank you Linus! I tried this hardware and my downloads went from 1 hour to 60 minutes
that still a hour LOL
@@traytar3193 r/wooosh
Been about 25 yrs since my first LAN party... Those were the days. Bring back LANs :)
I don’t know which I like more: That Linus went there with the EPIC/Steam joke or that Jake threw objects at Linus for going off script. Best. Intro. EVAR!
settle down nancy.
I was wondering if it might be because of battlenet... Because rip battlenet.
maybe that was also in the script. Big brain thinking.
@@LikeABawzs Can’t say I’m worried if it was actually in the script or not. I just heard, “It’s going to be EPIC!” and had the immediate reaction that “you _can’t_ let that one go!” Linus did not disappoint and it only went downhill from there in the best way possible. 😄
these guys make it feel like a turtorial. I WILL NEVER HAVE ENOUGH MONEY FOR THIS XD
just a random thankyou for doing what you do. Through the good the bad and the ugly your videos cheer me up. the world may be messed up but you are one of the things that keep me going, thankyou and i mean it. things are not good but you and your videos are one of the few lights to my long dark nights. keep on teching, we all got this one way or another. let LTT live on forvever
I run a 10-person LAN on 30mbps with this technique plus some aggressive traffic shaping. 👌
Not quite this hardware though...a cobbled together machine full of spare SSDs LVM-striped!
whats aggressive traffic shaping?
@@ahmedifhaam7266 traffic shaping is where you limit certain kinds of network activity. So cutting things like file sharing in favour of online gaming.
1:07
Linus: It's gonna be freaking EPYC
Intel: ...
Out of this video I have learned a huge lot of internal storage servers, thank you!
I would love to see a following up video after the LAN about how good (or bad) it went.
Oh they're definitely doing one (or more), you think LTT would miss such a video(s)? Lmao
It is up on floatplane as BTS (nearly 24 mins)
I just ordered the backpack I can’t wait for it. keep up the good work.
As someone who worked at a gaming hubs/computer cafes/computer shops, i have learned that you can just download the game once and just share/copy the files via a server to every PC that needs the files, its more efficient and downloading is only done once
That is exactly what they are doing in the video. Except It is completely transparent to the end user.
I literally only get 1 MB/s download . (7-9 mb/s) Scotland.
I actually followed that same Raid tutorial at the beginning of the year to setup my media drive for my Ubuntu 20.04 server and I also use Netdata on it
As a helpdesk tech, watching Linus bork a DNS flush is funny
I was already chuckling at Linus failing to type the command and Jake's "Are you drunk?" absolutely sent me
Super cool stuff.
Would love to see more of this "practical" self hosting and home server videos
This solution could work really well for us steam deck owners, being able to install a game on my PC, have it cache to a local server for when I install that game on my steam deck sounds awesome
My current solution has just been a network share on my windows PC, but that has had issues, main 2 issues are that if I want to play that game on my PC while it transfers to my steam deck the transfer speed dies since the files are being read by my steam deck and my PC playing the game, and the other issue is with any game I have mods installed for, since the local copy on my PC will have those mods installed they will be transfered to my steam deck
I think you can make a Steam Cache server, it will copy/download it's own copy of a Steam as your PC is downloading it. When you're home and you want to download that same game to your Steam Deck (or any other device), it will pull it from the Steam Cache server if it's faster to do so.
If it still exists, I have never used it myself but I heard a friend about it once.
@Lurch7861 lmao why are you in all the comments talking about WWIII and about how "smart" you are for hoarding shit. If another world war were to happen, having access to offline gaming would be the LEAST of anyone's worries, believe me.
@Lurch7861 if you worry that much, there is an offline mode you know? Otherwise buy your games from GOG.
@Lurch7861 if WWIII starts were all dead, we are in the nuclear weapon age, WWIII starts and the nukes will fly
@Lurch7861 let's just hope it won't happen and if it happens that we come back better
I'm surprised that you only went with a dual 25 GbE NIC instead of either dual 100 GbE or something like that.
The fact that you were able to peg it to 50 GbE pretty quickly and easily suggests that you could've given it even more bandwidth to pull from.
It works, but it can always work better.
The V2 version of the LTT screwdriver should have a LED light at the end to light up when detetecting pressure on the screw bit, making it easier to use in dark places or inside cases. Just putting that out there ;-)
That will take 9 years to make due to all the revisions Linus will demand.
Id prefer a button in the handle. Because in your solution you could be already pokin on a harmfull place before you see what you are pokin at. And once you lift it up to change position you still could miss because light has gone off.
@@FINRaver Yeah I actually agree with you on that. Would also be simpler.
"That's 8mb per person!" That is better internet than I have literally ever had in my life
Update your shitty internet then
he is talking 8megabit, so thats only 1MB per second..... im sure you have had better internet than 1MB/s
I know, right? When I get 2 Mb/s I am thrilled and he speaks about 8 like it's nothing haha
@@gobliniarz7393 i think you are confusing MB and mb .... 8mb is only 1MB....
@@raafmaat oh yeah. My bad. Thanks!
I can appreciate coming up with some premise for this video to help justify the project, and admittedly 2GBs for 250 people may not be adequate, it cannot be forgotten that it is unlikely that all 250 people will be pegging their connections simultaneously. This is how companies that have far far far more employees in a single building using the Internet all day for their jobs (online docs/sheets, meetings, voip and chat support, and casual music and youtube streams) can get away with 10GBs or less office connections.
An inverse analog could be an application server that might traditionally only have a 1GBs link that might be serving an app to hundreds of thousands of people per day, or a hundred'ish such apps spread over a few machines all flowing traffic through a single 10GBs nat, waf, vswitch, switch, or edge. The key is the amount of data each use, and when and for how long they actually use it.
You overprovision network just like you overprovision other resources to maximize the usage of those resources so you're not spending money needlessly.
It is a fun video though. It is probably fine to let that many people have access to 2GBs, unless they're all downloading all at once. This *is* however the appropriate solution to the potential problem of choking the edge.
At a LAN party however I would suspect that there would be a lot of traffic for people downloading games, say if people decided they wanted to play another different game, that would easily saturate the connection and having this server would free up bandwidth for things that can’t be cached (like actually playing the games).
Exactly like Luke said, why burn up your external link when you can just transfer it at local network speeds in a fraction of the time. Bonus is you have more people playing games for more time and not waiting on a download.
Running this on our LAN party for years now. Very nice piece of software. Together with a traffic shaper and policy based routing it enables us to use ~100 devices on two 50MBit connections. One for the cache, one for the users.
Every single day this dude test me on how much he knows.
As much as I love beautiful stabilised shots of B-roll, the one shot at 4:15 of the back of the server having that little shake to it brings an air of humanity to b-roll in a way I can't describe. Still beautiful
7:08 I'm all for getting creative and making things when you need to make them work... but damn it, that mini-sas u.2 cable chain monstrosity is going to haunt my dreams for weeks.
Its not even that bad.
My wifi has 2, 5 Mb/s ;(
Mine too ; (
Yeah life was hard with that speed, I just upgraded to 100mbps
My wifi is only 600mbps 😢
My internet is exactly 100x more
I love how when mentioning game libraries like steam, battle net, etc, he mentions “windows updates” goes to show how slow it is.
the subtitles broke
This can also be used when you have really slow internet and more than 1 person who is a gamer / has a pc / windows machine (windows updates anyone) in your house. It helps save what little B/W you have by caching it locally. And if you are a tech person or someone who builds pc/formats on a regular basis having 90%+ of your stuff cached on your LAN can be a life changing experience!
fortunately for me, our ISP does all the caching, and they do not charge for cached stuff, even youtube videos and cached netflix, not only on fiber, but also on mobile data, they do not charge for the cached stuff as much, very cool
i love that steam has that feature build in, i have like 2,5 tb games on my pc all on ssd. last week i had a friend over and he was able to download from my pc with like 2,5 gig per sec
me when their "unacceptably slow" speed is my average speed
Regarding the CPU usage (Or lack thereof), nginx tries hard to use sendfile(), which is a Linux API that speeds up sending data by a lot while saving on CPU cycles. Personally I don't have much to do with networking so it's nice to see in action :)
I love watching these Father and Son collab builds 🤘😍
I can tell from your sore throat that you filmed your last piece after the event, when everyone had left 😂 no worries, it cool.
Watching you guys work on this makes me so glad I spent my career working with real steam. 😵💫 As always, fascinating stuff.
I was confused until I noticed what you mean with real steam xd
You a nuke?
@@pyroavok No, real Snipe, Boiler Technician
I love your videos man they help me so much
Fax v1nce
Finally, a solution common folks at home can implement easily with their off-the-shelf hardware! 🤣
AS funny as massive overkill is I'd much rather see a video like this with more reasonable hardware. e.g. if you had a budget of a few thousand dollars what is the best caching server you could build?
The off script banter creates the best vids. This was a great piece!
I am in tears. These two working together is hilarious.
Ah the memories of building a LAN server... Good times
0:54 Not even a minute in and already closing my eyes and taking deep breaths. I was convinced he was gonna drop it.😂
“You’re not gonna download Warzone with 1/mbps”
You have underestimated my abilities for the last time, Linus.
LTT: We're doing a lan
Sponsors: Here's some cool equipment. Slot us in somewhere, you'll figure out how to use it ;)
Legitimately impressed by how much you all are able to accomplish with the equipment provided. Being able to know the technical side of things, but also sell it in front of a camera is amazing skill.
10:34 Speaking of Ubuntu.
After 10 years of daily driving Ubuntu, and suffering through the last three years with a crazy glitch that infinitely fills my hard drive with log files (expecting every major update to fix the problem but they never did), I have now finally ditched Ubuntu for Arch (due to Steam OS 3.0 using Arch I figured I may as well make the leap).
It's actually good timing because Arch recently got updated with the "Archinstall" command, which makes installation a million times easier (or in my case "Infinitely Easier" because after two days of trying to resolve a signature key error the ONLY way to install Arch was through the automated Archinstall process).
Can you provide a link to the bug report? I came across a bug like that ten years ago or something, but I was never able to recreate it, so I just bypassed it and forgot about the whole thing until you mentioned it.
Linus makes me realise how much we sound like robots to normies.
🤣🤣🤣🤣 "bEeP-BoOP-bEEp" 🤣🤣🤣🤣
Others: 😐
"you're likely not redownloading the same game very often" I feel called out because my internet usage on my home network was something like 18 TB in a month because that is all I do.
Yes, my favourite game is windows update
I was actually thinking if a solution like ipfs would be viable for such as a scenario since the computers could file share between them in peer to peer fashion
Reminds me of the server rooms from college. I would visit there on a frequent basis as my father knew one of the lecturers when I was a kid, so he just got me to go complain about small things instead of walking all the way to the techs. Half the time they didn't have a clue what I was on about until I explained it in more simple terms like "There is a malicious program eating all the files".
"only gig" (to each station). Gotta love 2022. I remember LAN parties on dual ISDN 64k channels, playing Rainbow Six: Eagle Watch/Rogue Spear/etc, back in 1998ish.
Always put a dummy compressed file on mission critical server boot files that takes up ~ 10% of the drive when you install it.
Then when things go wrong and the boot drive gets filled, you have a simple way to free space and work out what's going on.
thats a good one ill have to tell the guys about it
Around a decade ago, I used to think "when will I ever need more than 1MB/s on my downloads". Now I'm a happy 1.5Gbit symmetric internet connection customer
1 mb/s is still okay, it's slow, but it's workable as long as you don't need it all the time (for example downloading a game only every week or so). It's enough to play and discord I think (I did it with 400 kbyte/s...and this got shared with my brother at the same time!)
Although this was me and him playing combat arms 10 years ago, and skyping.
Then we noticed we could just get 800kbyte/s by calling our provider, was like a dream.
oh boy I remember going from 125 Kbps to 1 Mbps download speed, it was FAST! those were the days that when you wanted to play an online game you had to leave it downloading over night, or sometimes even for a couple days lol
I used to have 128kbps up and down
Streaming video was just a dream at that time
@@ReptilianLaserbeam once I was trying to download a game and it said it's going to take a year, and I actually didn't mind, I let it run for a few weeks, before some interruption stopped it
@@benjaminnau8462 damn thats way worse than already "suck" isp in my country which is third world country
There's actually an unraid ready docker that uses monolithic lancache, I set it up at my house like 2 weeks ago :)... dns wasnt very fun with pihole though
when is DNS fun
@@bigpod When it works without even thinking about it. So, never.
@@jonny6702 😂🤣😭
DNS never works bro.. had nightmares,
@@ahmedifhaam7266 just start memorizing IPs lmao
Thank you for pointing out the exact same number of syllables in mw2 vs modern warfare 2.
Man I wish I had access to 8 mbps down before going to Uni. That breakdown in the beginning feels like a non-issue to me.
Just one minor correction:
In true CNCF form, you *should* run each service you want to cache in its own container. Docker containers should be designed to be lightweight and single purpose. You will ultimately have better performance sequestering your: caching services, routing layer (nginx / traefik), storage layer (dbs, redis / memcached) and other components
Sure its easier having one instance - however thats why things like docker-compose & kubernetes exist, they allow for declarative orchestration of containers
I like to use systemd-nspawn, full systemd in containers, no need to make one-role containers :D
For all of the shit Linus has gotten last week this shit is still really cool.
Dang, bro, you swear so cool. How can I be as cool as you?
sorry i am outside the loop. what happend?
You can tell Jake is one of the real tech guys, he has his machine plugged into the 10GB Core. Also, nice job on breaking DHCP!
Hey linus. Could you talk about the new teleprompter controller you are using and how you manage all the things you are doing while reading?
I know they used one before too but somehow I find the new promoter annoying.
In my days, the whole point of LAN parties was not needing the internet!!111oneeleven
In your day, you didn't have people forgetting to pre-download/install or update their games before arriving?
@@CouchPotator Then you could just transfer the files from someone else on the LAN.
17:31 that explains why this one game I got for free (ark survival evolved) takes hours to download 12 GB meanwhile fallout 76 can be downloaded in less than an hour despite being significantly larger.
to clarify, i have gigabit internet. this shouldn't be a problem, but it is
LTT videos are always awesome, always feels like I’m watching buddies do a movie skit for high school!