- Видео 69
- Просмотров 525 394
AveryPlays757
Добавлен 29 июн 2016
AI Server Series: Pt.1 Build a Server for LLMs and Inference Training + Benchmarks
Parts Used:
DL380 Gen 10 SFF (Barebones, will need heatsinks, and PSUs)
2x Xeon Gold 6132 2.6GHz 14-Core CPUs
128GB DDR4-2400 ECC
1TB NVMe
2x Nvidia Tesla 12G HBM2Cards (Supposed to be the 16G HBM2cards)
DL380 Gen 10 SFF (Barebones, will need heatsinks, and PSUs)
2x Xeon Gold 6132 2.6GHz 14-Core CPUs
128GB DDR4-2400 ECC
1TB NVMe
2x Nvidia Tesla 12G HBM2Cards (Supposed to be the 16G HBM2cards)
Просмотров: 5 575
Видео
Building a Apple Xserve Rack for Xsan! Pt.1
Просмотров 892Месяц назад
Cool Xsan project coming up, alongside the other rack builds :)
2024 Homelab Build Part 6: Working On The AI Rack! (Mini Rack)
Просмотров 3,6 тыс.5 месяцев назад
Exciting Times! just re-arranging networking stuff in this vid.
2024 Homelab Build: Part 5: Quick Lab Recap / Progress Report
Просмотров 2,9 тыс.5 месяцев назад
Quick Progress report
2024 Homelab Build Part 4: 40Gb pfSense Router!
Просмотров 3,6 тыс.6 месяцев назад
Heres the new overkill router!!
2024 Homelab Build Part 3: The Great Rack Migration
Просмотров 2,2 тыс.6 месяцев назад
2024 Homelab Build Part 3: The Great Rack Migration
2024 Homelab Build: Pt.1.5-Hardware and Software Reconsiderations
Просмотров 4,7 тыс.7 месяцев назад
2024 Homelab Build: Pt.1.5-Hardware and Software Reconsiderations
2024 Homelab Build: Pt.1-Hardware Overview & Assembly
Просмотров 26 тыс.9 месяцев назад
Homelab Build for 2024!
32-Core Hackintosh Pt.2
Просмотров 1,6 тыс.10 месяцев назад
Well, well, well, after much let down here is part 2... Part 3 where we test out ACTUAL dual 16 core CPUs coming soon,
Building a 32-Core Hackintosh!
Просмотров 6 тыс.Год назад
Pt.2 of the build! Yes, I did end up using a RX6800XT in the system after testing (you'll see this in Pt. 3/the install) Tags Dual Xeon Hackintosh,Apple Silicon vs Hackintosh,M1 Max compare,M1 vs Intel 2022,64GB MacBook Pro,hackintosh,hp z840 hackintosh,Intel 16 core xeon hackintosh,cheap hackintosh,Lab,Homelab,Xeon,R740XD LFF 12 bay,R740 16 bay,M2 Compare,HP Z840,Network admin,Kali,Server rack...
HP Z840 Unboxing (32 Core Hackintosh Pt.1)
Просмотров 1,7 тыс.Год назад
Unboxing the base of the new Hackintosh project!! TAGS MacBook Pro, i9 MacBook Pro, M1 Max compare, M1 vs Intel 2022, 64GB MacBook Pro,hackintosh,hp z440 hackintosh, Intel 18 core xeon hackintosh,cheap hackintosh,Lab, Homelab,Xeon,R720XD LFF 12 bay,R740 16 bay,CCNA,Switch port access VLAN,Network admin,Kali,Server rack lab,home lab,AD DNS,active 2019 directory windows server,dns,dhcp,bootp,link...
2019 16 Inch MacBook Pro in 2022 - 6 Month Review!
Просмотров 5 тыс.Год назад
2019 16 Inch MacBook Pro in 2022 - 6 Month Review!
2019 16 inch Macbook Pro in 2022? (16 Inch 2019 Macbook Pro Unboxing and Review)
Просмотров 47 тыс.2 года назад
2019 16 inch Macbook Pro in 2022? (16 Inch 2019 Macbook Pro Unboxing and Review)
Building a 18-core Hackintosh! (HP Z440)
Просмотров 17 тыс.2 года назад
Building a 18-core Hackintosh! (HP Z440)
Unboxing My New Backup/File Server! (R720XD 12-Bay)
Просмотров 1,5 тыс.2 года назад
Unboxing My New Backup/File Server! (R720XD 12-Bay)
Ubiquiti Switch Aggregation (USW):Quick Unboxing and Overview
Просмотров 1,6 тыс.3 года назад
Ubiquiti Switch Aggregation (USW):Quick Unboxing and Overview
Dell EMC PowerEdge R740 Unboxing/Overview
Просмотров 1,8 тыс.3 года назад
Dell EMC PowerEdge R740 Unboxing/Overview
Dell EMC PowerEdge R740 RAM Upgrade!
Просмотров 16 тыс.3 года назад
Dell EMC PowerEdge R740 RAM Upgrade!
Homelab VLOG: New Servers, FreeNAS, Hackintosh??
Просмотров 4,1 тыс.4 года назад
Homelab VLOG: New Servers, FreeNAS, Hackintosh??
Major Homelab Updates + 500 Subscriber Thank You !
Просмотров 10 тыс.4 года назад
Major Homelab Updates 500 Subscriber Thank You !
Taking a look at another cheap Mac Pro!
Просмотров 6444 года назад
Taking a look at another cheap Mac Pro!
My 10 Gigabit Fiber Network Upgrade (overview) + Mac Pro 10Gb Upgrade
Просмотров 4,7 тыс.4 года назад
My 10 Gigabit Fiber Network Upgrade (overview) Mac Pro 10Gb Upgrade
Home Lab VLOG: Deploying The new File Server!
Просмотров 10 тыс.4 года назад
Home Lab VLOG: Deploying The new File Server!
Pairing that CPU with 40Gb interface does indeed seem like an overkill. Is there any scenario that doesn't involve RDMA where that CPU can max out the bandwidth?
@@ruojautuma1 The 40GBe aspect of it is mainly for future proof and enhanced routing of data from vlan to vlan as the switches aren’t great at it. And the CPU will likely need to be upgraded
Hey ! Im since couple months now in they server rack & i woud like to put my computer in a 1u Rack and ive got a hard time trying to find 1u power-supply with atx connector & gpu does anyone know any website or brand & stuffs with pretty good deals ?
@@Wolf_Fr you’re better off using a 2u case, 1u stuff is pretty difficult to find, also I would check out SuperMicro
Seems like you might be a little better off stretching that excess power cabling over to the empty space above the PSUs, you have less cable blocking airflow to the gpus. Just my 2 cents.
Was there something that pushed you towards the P100s as opposed to a something like the V100s, besides just price, which is nothing to sneeze at for a home lab?
@@sevilnatas Just price to be honest
.@@averyplays7576 Totally Understandable. I have been looking at the 16gb V100 cards. At the end of the day, it's about finding the best deal you can for the most vram and cuda cores that you can afford. I got an EOL Epyc dual socket system w/ 256gb of RAM. I prefer AMD because the Epyc cards come with so many PCIe lanes. I love that data centers EOL their equipment so early for us home users. I have my setup running in an open frame for now, so I will need to figure out added cooling for the gpus.
@@averyplays7576 I really wanna figure out how to run the SXM2 Tesla cards. The are SO cheap. I can't find a motherboard or daughter board the run them though.
You gotta water-cool your camera lol
@@Mack_Dingo seriously haha
beautiful. Good luck on your projects!
Thank you!
it appears that only one card being used at time.
It uses both, but sparingly, I will have to look into it
Hey man, love so much your videos, great job!!!
Thank you so much!!
Do you have any issues with cooling on the P100's - I've seen various 3d-printed fan add-ons, do you think they're needed (I have an almost identical setup that I am just building out with dual p40s, so I'll be following the series along -- thanks for sharing, and for showing the raw issues like the nvme drive, it's all really instructive)
Temps are towards the end, no issues, however I am using rack mount server. If its going in a desktop than yes you will need supplemental cooling (like the 3d printed fan addons) If its in a rackmount server than you're fine. And good luck, let us know how it goes!!
Welcome back!! Your videos are awesome, keep it up!
Thanks!!, will do!
Awesome, would love to see more of the software side of everything you have going on.
100%, haven't forgot about the main lab (yet) haha. Problem is I keep on adding and changing stuff a lot ( its used a lot off camera). I will finish it up once I'm back home.
Love your setup, server go brrrrrrrr.
Thanks!!! Brrrrrrrr
Hello, Great Video. Do you by chance have a parts list for this server that you are building? I am inspired in seeing if I can duplicate what you are doing to also advance my AI knowledge.
Working on a detailed parts list
Running the 22 core xeon in mine ,
These videos are 10/10. Good focus, not trying to sell anything, using hardware available to the consumer. Inspiriy me to finish building my lab.
Appreciate it!!
nice Casio, dork
Can’t wait to order my MacBook Pro this finna be fun and lit
Iphone 16 new lab
Anybody have any links to the drivers
Anybody have any links to the drivers
Jealousy is an understatement.....
bro what's the music in the intro?
awesome
Just my 2 cents: Seems you have the normal heatsink (up to 120W), this Xeons (150W) need the high perf ones (777291-001) and also the high power fans (I can't see the fans you have in the video). Still working but not the HPE recommended configuration.
M1 air 8gb or i9 16 inches 2019
Hey I know this is a little late but I wanted to ask if you maybe could be doing a Cinebench 2024 run on this machine :D ? I use a 9700k hackintosh for Music Production right now but I wanted to upgrade to a dual CPU Xeon setup.
Still a great design this was the last Macbook I had before I upgraded to the 14" Macbook Pro M3 18GB, huge trackpad amazing speakers and dont jump on me but I loved the touch bar haha, it was ahead of its time, if they kept it with the F" keys it would made the current Silicon Macbooks amazing.
Surprised it worked at all with the main power to the motherboard not seated correctly 15:45
It was re-seated after the clip, it actually popped out
Mmm socks + carpet + hardware build...yummy ESD ;-)
Touching the metal on the leg of my desk with my leg usually dissipates the ESD, which I do out of habit before touching any internals , but yes a ESD strap would be the best
Excellent video! Looking forward to my own Hackintosh build. What size Asus Monitor is that?
32! Its a Asus PB328Q
this guy got his arm in way half video, totally useless video can not see what going on. Redo your video delete this desaster
Thanks for the feedback Roger
whoa that doesn't look like an X thermal paste looks more like he put a hex on that poor cpu, get a spatula and make it smooth like a cake iced fool
Is that a cat?
You heard the fans because you were obstructing the airflow keeping it on the comforter... not very wise
What rails did you end up going with? I've seen a few on Amazon but they pretty much all either get returned or have no reviews. Would be a huge help to know your recommendations and where you got yours. Also to know how have they been working out for you.
I bought the actual rails for each of the servers
@@averyplays7576 As in the OEM rails for each individual device or just rails from Amazon or where ever? I am looking to pick some up for my rack and I am looking for recommendations if you have any! 🤗
@@JeromeLove OEM rails all the way! Made my life so much easier 🤗
Hello I have z440 and i installed hackintosh sonoma successfully, but i wanna ask if i buy bluetooth usb and a wifi usb would i enable airdrop ? Or it’s hard for z440 to have airdrop on hackintosh ??
Just get a shelf rather than paying for apple rails
Refurbished for 480 awesome computer.Reboolo
What MacOS are you running?
toooooooo much talk.....
I plan to sell my gaming laptop to buy a 2019 16 inch macbook pro since I am a student and need something with a bigger battery life. Also I prefer a larger screen
Check out back market I got mine for $399 I've seen one for $397
Dang man, if you don't mind me asking, what do you do for a living?
your going to have all that gear running off 120V?
What switches are you using? Have you benchmark the 40 Gb NIC (eg. iperf). I'm wondering how well it performs with pfSense.
Nexus 9k in the full rack, Nexus 3k in the half. iPerf multi stream on RHEL indicates around 27-32Gbps
Just tried AI on my homelab which is just an old laptop 2 cores 3 ghz. It was writing one word every second...
Check if there is a screw on those rails that act as limiter for rack
What does your business do? Jealous ! And where are you buying the servers?! I’m looking for a barebones G10 to put my Gold 6130 in
We do a lot haha, I can set you up with a good deal on a G10, email me @ averyplayz4343@gmail.com
Just remove the shelf for it and place the freaking thing on the mac until rails hare in place?