AveryPlays757
AveryPlays757
  • Видео 69
  • Просмотров 525 394
AI Server Series: Pt.1 Build a Server for LLMs and Inference Training + Benchmarks
Parts Used:
DL380 Gen 10 SFF (Barebones, will need heatsinks, and PSUs)
2x Xeon Gold 6132 2.6GHz 14-Core CPUs
128GB DDR4-2400 ECC
1TB NVMe
2x Nvidia Tesla 12G HBM2Cards (Supposed to be the 16G HBM2cards)
Просмотров: 5 575

Видео

Building a Apple Xserve Rack for Xsan! Pt.1
Просмотров 892Месяц назад
Cool Xsan project coming up, alongside the other rack builds :)
2024 Homelab Build Part 6: Working On The AI Rack! (Mini Rack)
Просмотров 3,6 тыс.5 месяцев назад
Exciting Times! just re-arranging networking stuff in this vid.
2024 Homelab Build: Part 5: Quick Lab Recap / Progress Report
Просмотров 2,9 тыс.5 месяцев назад
Quick Progress report
2024 Homelab Build Part 4: 40Gb pfSense Router!
Просмотров 3,6 тыс.6 месяцев назад
Heres the new overkill router!!
2024 Homelab Build Part 3: The Great Rack Migration
Просмотров 2,2 тыс.6 месяцев назад
2024 Homelab Build Part 3: The Great Rack Migration
2024 Homelab Build Part 2: DL380 G9 Upgrades
Просмотров 1,4 тыс.6 месяцев назад
!!!
2024 Homelab Build: Pt.1.5-Hardware and Software Reconsiderations
Просмотров 4,7 тыс.7 месяцев назад
2024 Homelab Build: Pt.1.5-Hardware and Software Reconsiderations
2024 Homelab Build: Pt.1-Hardware Overview & Assembly
Просмотров 26 тыс.9 месяцев назад
Homelab Build for 2024!
Mac Pro Rack Unboxing & Overview
Просмотров 3,3 тыс.10 месяцев назад
New main machine!!!!
32-Core Hackintosh Pt.2
Просмотров 1,6 тыс.10 месяцев назад
Well, well, well, after much let down here is part 2... Part 3 where we test out ACTUAL dual 16 core CPUs coming soon,
Quick Channel Updates - Late 2023
Просмотров 71111 месяцев назад
Quick Updates!
Building a 32-Core Hackintosh!
Просмотров 6 тыс.Год назад
Pt.2 of the build! Yes, I did end up using a RX6800XT in the system after testing (you'll see this in Pt. 3/the install) Tags Dual Xeon Hackintosh,Apple Silicon vs Hackintosh,M1 Max compare,M1 vs Intel 2022,64GB MacBook Pro,hackintosh,hp z840 hackintosh,Intel 16 core xeon hackintosh,cheap hackintosh,Lab,Homelab,Xeon,R740XD LFF 12 bay,R740 16 bay,M2 Compare,HP Z840,Network admin,Kali,Server rack...
HP Z840 Unboxing (32 Core Hackintosh Pt.1)
Просмотров 1,7 тыс.Год назад
Unboxing the base of the new Hackintosh project!! TAGS MacBook Pro, i9 MacBook Pro, M1 Max compare, M1 vs Intel 2022, 64GB MacBook Pro,hackintosh,hp z440 hackintosh, Intel 18 core xeon hackintosh,cheap hackintosh,Lab, Homelab,Xeon,R720XD LFF 12 bay,R740 16 bay,CCNA,Switch port access VLAN,Network admin,Kali,Server rack lab,home lab,AD DNS,active 2019 directory windows server,dns,dhcp,bootp,link...
Channel Updates-December 2022
Просмотров 555Год назад
Channel Updates-December 2022
2019 16 Inch MacBook Pro in 2022 - 6 Month Review!
Просмотров 5 тыс.Год назад
2019 16 Inch MacBook Pro in 2022 - 6 Month Review!
2019 16 inch Macbook Pro in 2022? (16 Inch 2019 Macbook Pro Unboxing and Review)
Просмотров 47 тыс.2 года назад
2019 16 inch Macbook Pro in 2022? (16 Inch 2019 Macbook Pro Unboxing and Review)
Building a 18-core Hackintosh! (HP Z440)
Просмотров 17 тыс.2 года назад
Building a 18-core Hackintosh! (HP Z440)
Unboxing My New Backup/File Server! (R720XD 12-Bay)
Просмотров 1,5 тыс.2 года назад
Unboxing My New Backup/File Server! (R720XD 12-Bay)
Ubiquiti Switch Aggregation (USW):Quick Unboxing and Overview
Просмотров 1,6 тыс.3 года назад
Ubiquiti Switch Aggregation (USW):Quick Unboxing and Overview
Dell EMC PowerEdge R740 Unboxing/Overview
Просмотров 1,8 тыс.3 года назад
Dell EMC PowerEdge R740 Unboxing/Overview
Channel Updates June 2021
Просмотров 4473 года назад
Channel Updates June 2021
Dell EMC PowerEdge R740 RAM Upgrade!
Просмотров 16 тыс.3 года назад
Dell EMC PowerEdge R740 RAM Upgrade!
Homelab VLOG: New Servers, FreeNAS, Hackintosh??
Просмотров 4,1 тыс.4 года назад
Homelab VLOG: New Servers, FreeNAS, Hackintosh??
Major Homelab Updates + 500 Subscriber Thank You !
Просмотров 10 тыс.4 года назад
Major Homelab Updates 500 Subscriber Thank You !
Xserve 2009 Unboxing and Overview
Просмотров 1,4 тыс.4 года назад
Xserve 2009 Unboxing and Overview
Taking a look at another cheap Mac Pro!
Просмотров 6444 года назад
Taking a look at another cheap Mac Pro!
My 10 Gigabit Fiber Network Upgrade (overview) + Mac Pro 10Gb Upgrade
Просмотров 4,7 тыс.4 года назад
My 10 Gigabit Fiber Network Upgrade (overview) Mac Pro 10Gb Upgrade
Home Lab VLOG: Deploying The new File Server!
Просмотров 10 тыс.4 года назад
Home Lab VLOG: Deploying The new File Server!
Building a Vitualization Home Lab!
Просмотров 29 тыс.4 года назад
Building a Vitualization Home Lab!

Комментарии

  • @ruojautuma1
    @ruojautuma1 7 дней назад

    Pairing that CPU with 40Gb interface does indeed seem like an overkill. Is there any scenario that doesn't involve RDMA where that CPU can max out the bandwidth?

    • @averyplays7576
      @averyplays7576 6 дней назад

      @@ruojautuma1 The 40GBe aspect of it is mainly for future proof and enhanced routing of data from vlan to vlan as the switches aren’t great at it. And the CPU will likely need to be upgraded

  • @Wolf_Fr
    @Wolf_Fr 8 дней назад

    Hey ! Im since couple months now in they server rack & i woud like to put my computer in a 1u Rack and ive got a hard time trying to find 1u power-supply with atx connector & gpu does anyone know any website or brand & stuffs with pretty good deals ?

    • @averyplays7576
      @averyplays7576 8 дней назад

      @@Wolf_Fr you’re better off using a 2u case, 1u stuff is pretty difficult to find, also I would check out SuperMicro

  • @sevilnatas
    @sevilnatas 8 дней назад

    Seems like you might be a little better off stretching that excess power cabling over to the empty space above the PSUs, you have less cable blocking airflow to the gpus. Just my 2 cents.

  • @sevilnatas
    @sevilnatas 8 дней назад

    Was there something that pushed you towards the P100s as opposed to a something like the V100s, besides just price, which is nothing to sneeze at for a home lab?

    • @averyplays7576
      @averyplays7576 8 дней назад

      @@sevilnatas Just price to be honest

    • @sevilnatas
      @sevilnatas 7 дней назад

      .@@averyplays7576 Totally Understandable. I have been looking at the 16gb V100 cards. At the end of the day, it's about finding the best deal you can for the most vram and cuda cores that you can afford. I got an EOL Epyc dual socket system w/ 256gb of RAM. I prefer AMD because the Epyc cards come with so many PCIe lanes. I love that data centers EOL their equipment so early for us home users. I have my setup running in an open frame for now, so I will need to figure out added cooling for the gpus.

    • @sevilnatas
      @sevilnatas 7 дней назад

      @@averyplays7576 I really wanna figure out how to run the SXM2 Tesla cards. The are SO cheap. I can't find a motherboard or daughter board the run them though.

  • @Mack_Dingo
    @Mack_Dingo 8 дней назад

    You gotta water-cool your camera lol

  • @shanes.6227
    @shanes.6227 8 дней назад

    beautiful. Good luck on your projects!

  • @Minigig
    @Minigig 9 дней назад

    it appears that only one card being used at time.

    • @averyplays7576
      @averyplays7576 9 дней назад

      It uses both, but sparingly, I will have to look into it

  • @jdhshs12
    @jdhshs12 9 дней назад

    Hey man, love so much your videos, great job!!!

  • @Patrick-rd9qo
    @Patrick-rd9qo 9 дней назад

    Do you have any issues with cooling on the P100's - I've seen various 3d-printed fan add-ons, do you think they're needed (I have an almost identical setup that I am just building out with dual p40s, so I'll be following the series along -- thanks for sharing, and for showing the raw issues like the nvme drive, it's all really instructive)

    • @averyplays7576
      @averyplays7576 9 дней назад

      Temps are towards the end, no issues, however I am using rack mount server. If its going in a desktop than yes you will need supplemental cooling (like the 3d printed fan addons) If its in a rackmount server than you're fine. And good luck, let us know how it goes!!

  • @bebop_10
    @bebop_10 12 дней назад

    Welcome back!! Your videos are awesome, keep it up!

  • @cjchico
    @cjchico 12 дней назад

    Awesome, would love to see more of the software side of everything you have going on.

    • @averyplays7576
      @averyplays7576 12 дней назад

      100%, haven't forgot about the main lab (yet) haha. Problem is I keep on adding and changing stuff a lot ( its used a lot off camera). I will finish it up once I'm back home.

  • @tjmbv8680
    @tjmbv8680 12 дней назад

    Love your setup, server go brrrrrrrr.

  • @GreyGuild46
    @GreyGuild46 12 дней назад

    Hello, Great Video. Do you by chance have a parts list for this server that you are building? I am inspired in seeing if I can duplicate what you are doing to also advance my AI knowledge.

  • @metaldragonbraveheart
    @metaldragonbraveheart 19 дней назад

    Running the 22 core xeon in mine ,

  • @ST-fp8jk
    @ST-fp8jk 26 дней назад

    These videos are 10/10. Good focus, not trying to sell anything, using hardware available to the consumer. Inspiriy me to finish building my lab.

  • @beergunsandfunnc
    @beergunsandfunnc 29 дней назад

    nice Casio, dork

  • @quinwithers
    @quinwithers Месяц назад

    Can’t wait to order my MacBook Pro this finna be fun and lit

  • @leo_craft1
    @leo_craft1 Месяц назад

    Iphone 16 new lab

  • @demize6
    @demize6 Месяц назад

    Anybody have any links to the drivers

  • @demize6
    @demize6 Месяц назад

    Anybody have any links to the drivers

  • @KiraKenjiro
    @KiraKenjiro Месяц назад

    Jealousy is an understatement.....

  • @largewilly_420
    @largewilly_420 2 месяца назад

    bro what's the music in the intro?

  • @mohamed_Sultan1504
    @mohamed_Sultan1504 2 месяца назад

    awesome

  • @frederichardy8844
    @frederichardy8844 2 месяца назад

    Just my 2 cents: Seems you have the normal heatsink (up to 120W), this Xeons (150W) need the high perf ones (777291-001) and also the high power fans (I can't see the fans you have in the video). Still working but not the HPE recommended configuration.

  • @anupammahato1
    @anupammahato1 2 месяца назад

    M1 air 8gb or i9 16 inches 2019

  • @lorenzocorsomusic1308
    @lorenzocorsomusic1308 2 месяца назад

    Hey I know this is a little late but I wanted to ask if you maybe could be doing a Cinebench 2024 run on this machine :D ? I use a 9700k hackintosh for Music Production right now but I wanted to upgrade to a dual CPU Xeon setup.

  • @oggiezwork
    @oggiezwork 3 месяца назад

    Still a great design this was the last Macbook I had before I upgraded to the 14" Macbook Pro M3 18GB, huge trackpad amazing speakers and dont jump on me but I loved the touch bar haha, it was ahead of its time, if they kept it with the F" keys it would made the current Silicon Macbooks amazing.

  • @NoodlesTBograt
    @NoodlesTBograt 3 месяца назад

    Surprised it worked at all with the main power to the motherboard not seated correctly 15:45

    • @averystech8218
      @averystech8218 3 месяца назад

      It was re-seated after the clip, it actually popped out

  • @noisufnoc
    @noisufnoc 4 месяца назад

    Mmm socks + carpet + hardware build...yummy ESD ;-)

    • @averyplays7576
      @averyplays7576 4 месяца назад

      Touching the metal on the leg of my desk with my leg usually dissipates the ESD, which I do out of habit before touching any internals , but yes a ESD strap would be the best

  • @applemarkwantsvids
    @applemarkwantsvids 4 месяца назад

    Excellent video! Looking forward to my own Hackintosh build. What size Asus Monitor is that?

  • @rogerdewitt3042
    @rogerdewitt3042 4 месяца назад

    this guy got his arm in way half video, totally useless video can not see what going on. Redo your video delete this desaster

  • @rogerdewitt3042
    @rogerdewitt3042 4 месяца назад

    whoa that doesn't look like an X thermal paste looks more like he put a hex on that poor cpu, get a spatula and make it smooth like a cake iced fool

  • @Warrigt
    @Warrigt 4 месяца назад

    Is that a cat?

  • @photo_n_art
    @photo_n_art 4 месяца назад

    You heard the fans because you were obstructing the airflow keeping it on the comforter... not very wise

  • @JeromeLove
    @JeromeLove 4 месяца назад

    What rails did you end up going with? I've seen a few on Amazon but they pretty much all either get returned or have no reviews. Would be a huge help to know your recommendations and where you got yours. Also to know how have they been working out for you.

    • @averyplays7576
      @averyplays7576 4 месяца назад

      I bought the actual rails for each of the servers

    • @JeromeLove
      @JeromeLove 4 месяца назад

      @@averyplays7576 As in the OEM rails for each individual device or just rails from Amazon or where ever? I am looking to pick some up for my rack and I am looking for recommendations if you have any! 🤗

    • @averyplays7576
      @averyplays7576 4 месяца назад

      @@JeromeLove OEM rails all the way! Made my life so much easier 🤗

  • @Al5olasabyAndrew
    @Al5olasabyAndrew 4 месяца назад

    Hello I have z440 and i installed hackintosh sonoma successfully, but i wanna ask if i buy bluetooth usb and a wifi usb would i enable airdrop ? Or it’s hard for z440 to have airdrop on hackintosh ??

  • @Alan.livingston
    @Alan.livingston 4 месяца назад

    Just get a shelf rather than paying for apple rails

  • @mecdrum7
    @mecdrum7 5 месяцев назад

    Refurbished for 480 awesome computer.Reboolo

  • @Thermool
    @Thermool 5 месяцев назад

    What MacOS are you running?

  • @rickz6403
    @rickz6403 5 месяцев назад

    toooooooo much talk.....

  • @NubAnSkrub
    @NubAnSkrub 5 месяцев назад

    I plan to sell my gaming laptop to buy a 2019 16 inch macbook pro since I am a student and need something with a bigger battery life. Also I prefer a larger screen

    • @theemclane4037
      @theemclane4037 5 месяцев назад

      Check out back market I got mine for $399 I've seen one for $397

  • @freddyarbuckle
    @freddyarbuckle 5 месяцев назад

    Dang man, if you don't mind me asking, what do you do for a living?

  • @mesmashyou30
    @mesmashyou30 5 месяцев назад

    your going to have all that gear running off 120V?

  • @TwoMoSmoka420
    @TwoMoSmoka420 5 месяцев назад

    What switches are you using? Have you benchmark the 40 Gb NIC (eg. iperf). I'm wondering how well it performs with pfSense.

    • @averyplays7576
      @averyplays7576 5 месяцев назад

      Nexus 9k in the full rack, Nexus 3k in the half. iPerf multi stream on RHEL indicates around 27-32Gbps

  • @leo_craft1
    @leo_craft1 5 месяцев назад

    Just tried AI on my homelab which is just an old laptop 2 cores 3 ghz. It was writing one word every second...

  • @sybreeder86
    @sybreeder86 5 месяцев назад

    Check if there is a screw on those rails that act as limiter for rack

  • @minerzcollective6755
    @minerzcollective6755 5 месяцев назад

    What does your business do? Jealous ! And where are you buying the servers?! I’m looking for a barebones G10 to put my Gold 6130 in

    • @averyplays7576
      @averyplays7576 5 месяцев назад

      We do a lot haha, I can set you up with a good deal on a G10, email me @ averyplayz4343@gmail.com

  • @emanuelpersson3168
    @emanuelpersson3168 5 месяцев назад

    Just remove the shelf for it and place the freaking thing on the mac until rails hare in place?