Eight Gaming PCs in a 1U Server - Cloud Gaming Server Part 16
HTML-код
- Опубликовано: 26 сен 2024
- Visit Porkbun today, and get any niche TLD from .ai to .xyz, with prices you won't see anywhere else. Plus support is all US-Based in Portland, OR. Thanks to Porkbun for sponsoring this video. Click the following link to get $1 off a new domain today bit.ly/3UDhAKD .
Microcenter is the place to find all your PC hardware under one roof, or order online at Microcenter.com.
New Customers Exclusive - $25 off all processors micro.center/yyq
Submit your build to Micro Center’s Build Showcase: micro.center/7vd
Check out Micro Center’s PC Builder: micro.center/lm9
Samsung 980 Pro 2TB SSD: micro.center/qzs
WD Black SN770 2TB SSD: micro.center/k5a
Ah, the return of my Cloud Gaming Server series. This time, we're cramming three nVidia Tesla GPUs, two CPUs, 8TB of SSDs and 256GB of DDR4 RDIMMs into a 1U rackmount server, all to run EIGHT gaming VMs at the same time.
But first... What am I drinking???
Kla3 from my Patreon server sent over some Norwegian goodness in the Nøgne Ø Imperial Stout. Definitely a stout like no other... rich and thick, but with a flavor profile closer to figs and cinnamon rather than dark chocolate and coffee.
Links to items below may be affiliate links for which I may be compensated
Set up your own vGPU Server with Proxmox and nVidia GPUs: • Proxmox GPU Virtualiza...
iSCSI Configuration for Game Libraries: • Use your NAS as a Stea...
ZFS DeDuplication in TrueNAS: • ZFS Deduplication in T...
Private Cloud Gaming - Parsec and Moonlight: • Private Cloud Gaming -...
Check out the parts from today's build...
1U GPU Servers: ebay.us/BtwxUr
HPE 32GB DDR4 REG-ECC 2133: ebay.us/MAJyvc
nVidia Tesla M40: ebay.to/3DlPPxu
nVidia Tesla M60: ebay.us/A4C0Zz
4x NVMe m.2 Adapter (require PCIe bifurcation support): amzn.to/3DORY7x
Grab yourself a Pint Glass or Hoodie at craftcomputing...
Follow me on Twitter @CraftComputing
Support me on Patreon or Floatplane and get access to my exclusive Discord server. Chat with myself and the other hosts on Talking Heads all week long.
/ craftcomputing
www.floatplane...
The following music was used for this media project:
Music: Disco Of The 70’s by Frank Schroeter
Free download: filmmusic.io/s...
License (CC BY 4.0): filmmusic.io/s...
Artist on Facebook: / frank.schroeter.52
No Good Layabout by Kevin MacLeod
Link: incompetech.fi...
License: filmmusic.io/s...
I am glad your channel has found success, so that we can continue getting content like this.
Interesting to see Pork Bun buying sponsorships. Bought mine from them over a year ago and just renewed. They are cheaper than cheap.
you rent it, not buy
@@majstealth "YoU rEnT iT nOt BuY iT"
😆
Same. Have a handful with them. No issues.
I know that I will never ever set something like this up.
But, the possibilities of the hardware and the setup is what is cool!
"so far so good' joke was on point! I love that you're building on all the other videos and just linking back for tutorials.
On projects like this, there's just SO MUCH to cover. One of those tutorials by itself is nearly 40 minutes, so no way I could cover it all in this video :-)
Plus, I like getting clicks.
Okay, that intro competes with the Manscaped video for best ad
I can't believe how powerful this Hyper-Visor is. An amazing case study, a fantastic demonstration and proof of concept. Giving you all the virtual thumbs I can brew. Great job, thoroughly entertaining and informative! Cheers 'tink'.'tink'
Had to rewind and take a second listen when you said you put the 2 drives in TrueNAS into a raidz1. For those who may not be well versed in ZFS or TrueNAS, it was a zfs Mirror, not a RAIDZ1.
I love your content so much, always such great ideas and helpful ways to set things up!
Yep, RAIDZ1 is akin to RAID5 (also which not a great idea since long ago with drives getting huge). If you must, RAIDZ2 (2 parity recovery members). I prefer striped mirrors (like RAID10). Much easier to extend existing arrays (no backup, destroy/reconfigure/restore) - just add a new mirror ZVOL to the array and -- done!
(There's lots of good info on TrueNAS and ZFS over on Lawrence Systems channel.) Like here, the signal-to-noise ratio is very good, unlike LTT seems to have become (with the exception of ones with Anthony).
I wonder if you'd get better deduplication efficiency if you set the volblocksize of your zvols be the same as the cluster size of the FS you format them with. BTW, what are the values for your setup? The default volblocksize is 8kB, I think, whereas the default NTFS cluster size is 4k. I would suggest setting both to 16kB to cut down on the metadata overhead. Jeff, do you feel like giving it a try?
That's a great idea. In a quick setup like this, I've left everything at the defaults (8K in ZVOL). I'm working on some testing methodology to start sussing some of this out.
Don't you just love it when Papa Jeff talks tech ... Gets your bits all messed up in a cluster of ones and zeros. Someone defrag me before I toss an error code or BSOD 😂
That intro was fuckin hilarious.
Your shirt in the inro...
White-Orange
Orange
..... LMAO... I have always mumbled to my self while making RJ45 connections ALmost singing it on each line... I've done this for soooooooooo many years that back in 2000 in Highschool in the newly formed "Computer Tech" class, we learned out to make our own Cat5 cables. I know your shirt if right with WHITE-Orange, but i've always had it drilled in my head as the colors first as it helps me remember and sing my little tune.
Orange-white
Orange
Green-White
Blue
Blue-White
Green
Brown-White
Brown
Fascinating stuff - was great fun see all the instances of Crysis running at the same time. Would for sure call this project a win !
That intro skit OMG Soooo hilarious!! Cool video too.... my maaan!!
Aw thanks bro
I would still would love to see you do a cloud video editing or similar variation on this eight games one PC idea
Thanks to your series, I've been able to build my cloud gaming server
PowerEdge R720 with 128GB of RAM, 2x Xeon E5-2697 V2's, and 2x TESLA K80's.
My Operating Systems run locally on a NVME drive, however all my steam library games run off TrueNAS VIA iSCSI with zfs de-dup, which was also the result of one of your videos.
I really want to upgrade to M60's but they're very expensive right now.
I just looked around for M60s on ebay and it's too much for me to spend on one right now. M40 as an experiment is good enough for me to try.
@@spicylemon53234 I didn't. I'm using the Dell redundant SD card module for boot.
Love the cloud gaming! I'd really like to see a... public cloud / private cloud deployment with a self service portal with vGPU support. It's been something I've worked on before and would love to see your rendition of it.
Porkbun are great! I bought my domain there a few years ago and I recently renewed it with them, they are cheap and the service is great.
I've never heard of porkbun will definitely check them out.
Outstanding, I'm glad you're sticking with this.
Just imagine what 180W of fans would sound like. You could just use your server as a leafblower now that we are getting into fall
i wonder if they would be any better using some noctua fans?
Ear protection required. Those things are like a leaf blower straight into your ear. Built like tanks though...
Oh my god you were right... the pork bun ad spot. God that tickled a good side this morning.
This is essentially the perfect hardware target for roughly 30 years of videogames. With a rom library AND a PC gaming library you could categorically load and stream 8 instances of humanities videogame history (or at least the "top hits") from 1980-2010. Some of those instances could feasibly handle multiple players on older multiplayer titles OR indie titles.
Given that older roms are so small and quick to load, you could offload THAT library to a NAS.
pretty much perfect for the computer games that came before that too - most of them were terminal based and ran on mini/mainframe systems this would have no trouble emulating
I'm really wanting to do this exact project! But I gotta get the necessary hardware to do so. I'm close to getting it tho!
I love these videos, I usually aim for quite stuff now a days though
hahaha the intro was pretty damn good!
This might be the longest series on RUclips and I love it
Best series on RUclips
I think I'm in 4th place.
1) Colin Furze Tunnel
2) JerryRig Electric Hummer
3) ALCH Apartment Renovation
4) Me
@@CraftComputing personally this series is the best. I would love to see a practical 2 gamer one system cloud machine. But the real question is how much do you use your cloud gaming system??
Fun! This is what playing with hardware is all about.
Intro was so funny almost made me cry thanks guys
Love the flash back shirts!
That grin @17:32 when playing eight instances of crysis at the same time.
The best part is the detailed of whiskeys on your shelf in the now and before section
I have never seen the E5-2898 v3 before lol. 4:05
Very cool glad you got this working
"Crysies Machine", LOVE IT!!!!
I need that RJ45 wire layout shirt 😂😂😂
vkc.sh
Are there any issues with anti-cheat in a system like this? IIRC Linus abandoned his network gaming server project because of that.
That was a great sponsor plug 😂
Awesome video! I think Crysis Remastered has benchmarking tools. You could get some numbers out of that.
what a legend. nice project.
Freakin space ship man. Gotta get into this server building thing. Sure messing with laptops is cool and fun. Certainly building a pc tower from the floor up is great. But geez dude 😅 the server thing looks amazing. Had to subscribe.
Jesus wept, another S tier sponsor spot!
Watching the Build Montage gave me Mr Roger's Neighborhood vibes idk why 🤣🤣
You pulled it off, and with allot less components than LTT.
And a budget somewhat below $40K. 🙂
Awesome seeing you get a win at last. I look forward to the LAN video ;P
They need to pay you well for that commercial. Very funny
Fantastic video!! Keep the great content coming
The "board meeting" being at 04:20am
That opening add 💀💀💀
Jeff lookin like Sammy Hagar 😂
Imma buy a few more beer glasses because of that opening. 😂
Check out the new TOS shirts too ;-)
@@CraftComputing Will do, love your content.
[FitGirl Repack] 13:38 I died 🤣🤣🤣🤣🤣🤣🤣
Great! I love this setup
Ok, I'm sold. I'm gonna do this soon. They make a 24Gb version of the M40. did you choose the 12Gb because there isn't enough GPU to split?
thank you good sir
Is it possible to play multiplayer between all of the VMs?
I Loooooove that custom 45 Drives storage.
ME TOO!!!!!
Amazing video, thank you. Would this be applicable to a LAN set up? I.e. 1 machine with 8 separate players stations. How would the displays and keyboards/mice work? Would be amazing if you could do a video for this to!
Used your tutorials to create a remote gaming VM within Proxmox, setup iSCSI to said VM and other PCs, and some other things regarding Plex all using HP Z840s.
I can only imagine that server is hella loud
This is amazing, is a complete walk through video coming?
Full tutorials are linked in the description for everything you see here.
@@CraftComputing thanks for your tireless efforts to make these videos, i did try the vGPU / Proxmox video you linked above and must admit that i sadly failed, both times :-)
Then i went with the Hyper V approach and that seems much more promising, but admittedly doesn't feel as "cool" as the proxmox stuff.
As you i have been hunting for a VDI solution since the "dawn" of computers and with the new streaming clients that uses the NVENC hardware we are finally getting there but what really confuses me is that the nvenc streaming tech isn't just a native the host that the virtual machines run on...
I will try to replicate a portion of this on my TR1920X and Radeon S7150 homelab system.
Hi. Did you success?
Love your content, it is both chilling while informative, hope this kind of things reach out to more people so other tech youtuber can also try it for as niche this sadly is..
I know this is a rather unrelateable thing to ask, but can you do a showcase of gpu passthrough on gaming laptops?
I am looking to build like a unified setup, therefore i don't know if it'd be worth to have gaming and workloads to both in and out of my house. Or else just a desktop pc with linux and some vms to work/gaming at home and provide the cloud and a laptop to access it on the cloud and just work/game otg.
Keep up the great work :)
Wondering if it is possible to deal with the GPUs in a completely different way - having multiple GPUs for a single gaming VM instance? Using two M40s or P40s could bring some real performance if the thing scaled well. I remember that we used to have SLI/Crossfire in the consumer grade PCs, but I guess it is not the thing anymore.
This was my first time watching you and I subbed during your in video ad, that's a fucking first for me . Love that you even changed your booze for the skit when you recalled the past lmao. Bunch of stoners, loved the vid.
It would be oddly disconcerting if one day you started off your video "For once I am not Jeff" and then pulled off your Jeff mask and revealed __________
It was me, Linus, the whole time! Amazing, considering I'm a foot taller.
@@CraftComputing Aha! :D
Wasn't paying attention and had to rewind that intro
Wondering if the NVME SSDs were not actually heavily loaded by all 8 instances, since most of the data that the Cryses needed for that first level were only read ~once (because of dedup) and therefore cached in RAM for the other instances. Could turn off dedup and reinstall Crysis to test.
The reason for the dedup is to save on disk space not for performance. Would love to buy several 4TB NVME SSDs for ZFS raid but too pricey at the moment.
@@Darkk6969 I understand. I'm just saying the performance test in this video might not perfectly match reality if the machines are loading different levels.
Very good viedo, i find more easy to run CCBoot on windows server and deploy games as ISCI with only one copy to all 40 diskless PC with very low latency and 4gib ethernet pci as a team for load balancing, and in the end it took only 600GiB of disk space,
Jeff you do a great Sammy Hagar impression.
Time to start running an old WoW or Diablo Multibox setup for that sweet loot
PCI-Express slot: nice and tight
It cleared the memory by ~3mm!
Maxwell GDDR5 😅 i hope google put it for sale those P100 servers so we can play with better cards
This is legendary
Strange config! In your video and in the links I see SuperServer 1027GR-TRF with X9DRT-HF. Right?
This motherboard supports Xeon E2 processors with 12 Cores and DDR3 as much as possible, but you have something more advanced stated in the video! Or do I not understand something?
pretty cool Jeff, I have been following you for the last few years. Also it would be pretty cool if there were a way for you to control all 8 instances simultaneously.
I'd love to see you checkout newer Tesla's like the P100 as those are starting to go down in price
They're starting to, and I definitely have my eye on them.
I can see he's getting ready to pull a Linus
Now try 8 instances of Chrome with multiple tabs open 😜
interrestung you using sata drives, this means you using a standad SAS controller? or can you use nvme on this system too? if yes why you dont buy a adapter bord thats hase the size of a 2.5 inch drive and has on its self a m.2 connector for nvme drives if you want fast drives
3:20 your camera lost focous , i thought my picture quality shifted to low resolution.....
I need to follow along with this eventually. I've wanted to make a gaming server so I can play games on my (non-gaming, fully arting) laptop without issues on the go. It would have been nice to have a total cost listing for a generalisation on what people looking to follow along can expect to pay. I get with eBay it's a bit of a crap shoot. Your $20 Tesla M40 may be $2000 for the next guy. But generally it gives an expected project value from $2k to $20k.
where can I find a NVIDIA driver for the guest VMs that doesn't require a vGPU license?
By anychance can you link the GPU power cables that you are using I am having a hard time finding them off ebay?!
I'm looking to put together a home, rack, gaming server together just for the server, to connect to, not to game directly from. Being new at this do you need graphics cards when all the server is doing is processing incoming player computers ? I've been surprised at how little i've been able to find about making gaming servers when it's not an old PC / Laptop you are converting. Anything would be a great help.
I’m just starting to look into building a virtualization server and I want GPUs for AI projects/gaming. How much power cost does something like this introduce?
Great video. How loud is the server? I imagine even though its passively cooled the case and PSU fan's would be quite loud due to their diameters?
If you have to ask how loud it is, you've never been around 1U servers ;-)
@@CraftComputing Yeah I guess I will keep searching for those unicorns.
What would be the best way to connect remotely to these VMs? Lowest latency and best performance.
I mean, if I have a powerful workstation and I want to run proxmox with 3 VMs for 3 people on a local network.
Why not get a $200 end up to plug for PCI Express slots. You can get one with a bridge chip that allows you to plug twice as many nvme drives to maximize throughput
How do you see the temperature on the video cards?
nvidia-smi on the host shows current utilization and temps.
The M40s ran around 45-50C. The M60 dies peaked around 72C.
@@CraftComputing Thanks I was just courious.
How did you get the vgpu driver from nvidia? I tried making an enterprise account with them, but it seems as though they just ghosted me.
Where did you get Nøgne Ø beer? I’ve only seen it in Norway.
I was wondering if you could run say Star citizen or Tarkov in a VM with kind of maxed resources?
Awesome!
I'm wondering how to go about connecting eight monitors, eight mice, and eight keyboards to this server. Could you provide guidance on the process?
I enjoy learning from the information that you put out there. I was wondering if it is possible to have multiple windows OSs in the DeDup? Or will that not work? Or does each Windows OS VM need it's own non-DeDup zvol?
Is it possible to use your mouse and keyboard to play on all instances simultaneously? If there is some way you could benchmark it.
You can use Barrier.
Its a open-source fork of an older (now commercial?) app called Synergy. It allows you to have a single keyboard and mouse controlling an arbitrary (and heterogeneous) collection of network-connected machines which each have their own locally attached display. The mouse controls the keyboard/mouse input "focus", much like pressing a button on a hardware KVM switch.
When setting it up, you designate one machine as the "server" and the rest as "clients" and describe the positional relationship of the "client"(s) screens relative to the screen of the "server" (right-of, left-of kind of thing). You can use it across an arbitrary mix of Linux, Windows and Mac machines seamlessly. Highest recommendation.
Craft on any of your x79 adventures did u have psu coil while happen when using a sata ssd doing random things? It might just be my board and psu
How do you handle Windows Licensing? MSDN/VSS? Also, RUclips has been around long enough that watchers know where the links are and pointing to "the usual spot below" isn't required.
This rocks
Out of curiosity, would Tesla P4 cards work with this build, and if so, would it be considered a worthwhile upgrade? I recently watched the P4 video and it would seem that those cards out perform by quite a bit.