STH Labs
STH Labs
  • Видео 40
  • Просмотров 437 790
So Many AI Servers Here
We saw a ton of AI servers at the ASUS Computex 2024 booth from NVIDIA, AMD, and Intel. At Computex 2024, we saw NVIDIA GH200, GB200 NVL72, B100, and B200 servers, an AMD MI300X option, Intel Xeon 6 servers, and 500W TDP AMD EPYC
Here is the main site article with more detail: www.servethehome.com/asus-ai-servers-at-computex-2024-nvidia-intel-amd-arm/
Check out the main channel: @ServeTheHomeVideo
Просмотров: 23 384

Видео

Комментарии

  • @anobody5708
    @anobody5708 Месяц назад

    Asus = junk

  • @price.gaines
    @price.gaines Месяц назад

    Yeah, but it’s made by one of the slimiest tech companies to ever exist so that’s gonna be an instant nope from me

  • @Sidicas
    @Sidicas Месяц назад

    Texas PoE is just hands down better. Every Texas PoE injector has a power supply that you can upgrade for more wattage if you need it. Also that switch isn't going to work AT ALL if you disconnect the power from it but if you get a quality PoE injector you can disconnect the power to it and it will still work but without injecting the PoE. So if the power supply goes bad you don't have to redo all your network cables and have yet another switch to use. .

    • @STHLabs
      @STHLabs Месяц назад

      True, but the flip side is that you have higher reliability with fewer components. With PoE injectors, you end up with switches anyway. So, with injectors, you can have 2x or more parts, each of which can fail. I agree, though, we have used many PoE Texas injectors when switches do not support PoE.

  • @dr.rubbertoe7318
    @dr.rubbertoe7318 Месяц назад

    144 cores in that small of a footprint (especially compared to Epyc) is really impressive.

  • @Mr89netrom
    @Mr89netrom Месяц назад

    But ASUS in general is ass these days.

    • @Sidicas
      @Sidicas Месяц назад

      Absolutely right. I bought a high end Asus motherboard and it only lasted a few months after the 3 year warranty expired. Seemed kinda sus. The Asus board I had before that lasted 10 years. Bought an MSI to replace it and haven't looked back.

    • @Mr89netrom
      @Mr89netrom Месяц назад

      @Sidicas I got an asus router, but i got it for free and it wil not be relied on, only for tings that are handy, not crutial. ASUS needs to step back in line and up their efforts of they want to keep in buisness. It is not that the producs are all crap, But the prepeated failiures to comply with Intels standards, lack of quality and higher price is what makes them problematic.

    • @a892728
      @a892728 2 дня назад

      @@Sidicas M4A88TD-M EVO still alive.

  • @GokuNoyd
    @GokuNoyd Месяц назад

    🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥🔥

  • @tbqhwyf
    @tbqhwyf 2 месяца назад

    Can't I just install Linux on some old laptop I have around or a Pi instead?

    • @STHLabs
      @STHLabs 2 месяца назад

      Sure. But both are much harder to get 10Gbase-T on especially around 8W.

  • @samus4799
    @samus4799 2 месяца назад

    You can also just hook a USB SSD straight into the USB port that has been on most consumer grade routers for the past 20 years now. Then go into your router settings and configure the drive *with built-in security features.* You may even be able to use a USB hub and configure multiple drives in this way. Or even a USB RAID DAS device as an NAS. Though I’ll warn you against using either your black magic box or the router to store a Git repository, you’ll run into ownership issues.

    • @technodude
      @technodude 2 месяца назад

      I wish ubiquity had a USB port on there gateways so you could do this exact same thing, but something tells me if you have a ubiquity system you’re supposed to just get a NAS. Anyways I just did a network share from my computer that stays at home and I accomplished basically the same thing

    • @samus4799
      @samus4799 2 месяца назад

      @ Some of their Dream Machine models of router have drive bays. UDM-SE, UDM-Pro-Max. Or just use a consumer router in extender mode. lol.

    • @STHLabs
      @STHLabs 2 месяца назад

      Or you can just plug in power, network, and a SSD.

    • @samus4799
      @samus4799 2 месяца назад

      @@STHLabs Don’t forget the part where you buy the thing for $400

    • @STHLabs
      @STHLabs Месяц назад

      @@samus4799 Sure but we have a ~2500sq ft studio so time in it is expensive. For a lot of folks $400 for something that just works in seconds versus $300 that is better but takes an hour to get working is a normal trade-off. If you have a photography business, do content creation, and so forth, this is not bad at all

  • @Lilly24244
    @Lilly24244 2 месяца назад

    Nah that's such a waste. Blackmagic is generally a pretty bougie brand and I won't knock their video equipment but here you're genuinely just better off getting an old server and installing freenas or something. You won't be limited by the amount of usb ports, setting up the web interface is a couple clicks, you get to deploy a redundant raid and you can install multiple super high bandwidth NICs. DIY is just more sensible all around.

    • @STHLabs
      @STHLabs 2 месяца назад

      Totally, but remember, this is about ease. We have over 1PB of flash storage and we still have found a use for this.

    • @Lilly24244
      @Lilly24244 2 месяца назад

      @STHLabs That's fair, I can especially see it being very useful on the go. But other than that I'm struggling to see much use for the Blackmagic unit.

  • @dewebby5989
    @dewebby5989 2 месяца назад

    Wouldn’t the two outlets you plug into have to be on the same electrical circuit? My router is downstairs and my room is upstairs and I’m pretty sure they’re two separate circuits

    • @dredvax
      @dredvax Месяц назад

      That's what I'm trying to figure out

  • @ImNotAFederalAgent
    @ImNotAFederalAgent 2 месяца назад

    Thats shit. You're paying 400 just on the device. You can buy a cheaper solution that doesnt require much setup. Buy drives or SSDs and toss them in caddies. The solutions nowadays arent even noisy anymore. A NAS isnt a new technology and black magic is a good company in some respects of their affordable ATEM ISO equipment. But they do not have thr right to sell a shitty NAS for $400!

    • @STHLabs
      @STHLabs 2 месяца назад

      That is totally what we thought. The difference is NO setup. It seems dumb, then you have the capability and it makes sense

  • @SePiippolanVaari
    @SePiippolanVaari 2 месяца назад

    Omg lord

  • @gamehypothesis3838
    @gamehypothesis3838 2 месяца назад

    😮😮😮😮

  • @krizzyd
    @krizzyd 2 месяца назад

    Nice try bro

  • @JaredT-k8s
    @JaredT-k8s 2 месяца назад

    9800x3d is not officially supported. Don't know if I want to gamble on the order.

    • @cmos64
      @cmos64 2 месяца назад

      it's working on beta 20.01 fw

  • @Pipes1974
    @Pipes1974 2 месяца назад

    It's an early test vehicle for testing all the features

  • @rayannaeem4472
    @rayannaeem4472 2 месяца назад

    Nah it's nothing much they needed a new Time Machine for back to the future

  • @eltreum1
    @eltreum1 3 месяца назад

    These are cool boxes for home grown SDN/SDWAN or a monster edge firewall/router. We were doing white box SDN/SDWAN development with these for site edge all-in-wonder IPSec net boxes.

  • @vivid42
    @vivid42 3 месяца назад

    so i’m not the only one who saw it? anyway, asked a tech did some research, that’s the autopilot engineering/training vehicle

    • @STHLabs
      @STHLabs 3 месяца назад

      Oh cool! Great to know!

  • @notjustanotherdeal4865
    @notjustanotherdeal4865 3 месяца назад

    A cardiogram.

  • @aquatechie
    @aquatechie 3 месяца назад

    Nah, someone is in the process of turning it into a time travel machine. The flux capacitor is on backorder.

  • @AnticipatedHedgehog
    @AnticipatedHedgehog 3 месяца назад

    Cant wait for Digital Twins methodology to become more widespread and lower barriers of entry. It's really fascinating to see these and be able to visualize changes in the built environemt BEFORE spending $$$. Great for professionals and the residents to see and provide feedback.

  • @AnticipatedHedgehog
    @AnticipatedHedgehog 3 месяца назад

    So can I add say 1 or 2 of these to my pc to boot into an OS only running on RAM? Lol

    • @STHLabs
      @STHLabs 3 месяца назад

      It will be possible to add one or two to workstation

  • @DOOM.Fi3nd
    @DOOM.Fi3nd 3 месяца назад

    Damn what kind of program loads require so much RAM and processing power? This is lookin like Super computer territory lol

    • @AnticipatedHedgehog
      @AnticipatedHedgehog 3 месяца назад

      I love watching these and other enterprise hardware videos. I thought about the same question when watching! It's wild thinking about the applications companies are buying these for.

  • @ricardocosta9336
    @ricardocosta9336 3 месяца назад

    Im poor, but one can only dream.

  • @xthrax
    @xthrax 3 месяца назад

    Can it run crysis

  • @Neuer_Alias_erstellen
    @Neuer_Alias_erstellen 3 месяца назад

    Well this is epic

  • @DanimationYT
    @DanimationYT 3 месяца назад

    Finally. Stable Minecraft

  • @Joshfarmpig
    @Joshfarmpig 3 месяца назад

    The latency tho…

    • @STHLabs
      @STHLabs 3 месяца назад

      Similar to socket-to-socket memory access.

  • @mariomarques775
    @mariomarques775 3 месяца назад

    Still not enough to run tarkov

  • @nightxiv9329
    @nightxiv9329 3 месяца назад

    I wanna run Minecraft server on this. The one server where trolling is allowed because we got 45TB of memory. You wanna blow up the entire fucking server? Have fun trying

  • @Benfica_91
    @Benfica_91 3 месяца назад

    Imagine troubleshooting ram issues when all populated.

    • @STHLabs
      @STHLabs 3 месяца назад

      We showed it on the main site, but this is designed to be connected to a server with 128 DIMM slots, for 224 total

  • @KJ-xt3yu
    @KJ-xt3yu 3 месяца назад

    😂😂😂😂....ram...gpu...network...cpu's....hows the fabric looking nowdays, you can connect your cpu to another cpu and another and another...👍

  • @andriesstegeman
    @andriesstegeman 3 месяца назад

    So... Its actually just a ram expansion slot?🤔 Epic but... I want it for my game pc 😂

    • @SylpheedW
      @SylpheedW 3 месяца назад

      But then you would want to store the games in that RAM, for incredible loading times 😂

    • @MrStaplez
      @MrStaplez 3 месяца назад

      It'll run like crap for gaming. Sure it's loads of RAM, but I'm looking at those interconnecting cables and I'm cringing at the latency

    • @mrkrchtr
      @mrkrchtr 3 месяца назад

      Haha, CAS latency would be horrible however you can still use it as RAM disk

    • @SylpheedW
      @SylpheedW 3 месяца назад

      @@mrkrchtr CAS isn't the word you're looking for. Just "Latency" 👍

    • @STHLabs
      @STHLabs 3 месяца назад

      CXL is similar to socket-to-socket latency in a 2P system.

  • @jeremybarber2837
    @jeremybarber2837 3 месяца назад

    Is DDR5 via CXL faster than NVME? Thinking iops & latency for LLMs etc…

    • @STHLabs
      @STHLabs 3 месяца назад

      Yes. And faster latency.

  • @MrTresdfx
    @MrTresdfx 3 месяца назад

    I'd allocate all of it as vram lol

  • @reallycoollondon
    @reallycoollondon 3 месяца назад

    96gb ❌️ 96 Dimms ✅️

    • @Nyctophase
      @Nyctophase 3 месяца назад

      That is how it’s supposed to be correct me if I missed the joke or something

    • @resgame7367
      @resgame7367 3 месяца назад

      @@Nyctophaseyh I don’t understand either

    • @resgame7367
      @resgame7367 3 месяца назад

      Wym? That’s how it’s supposed to be?

  • @JeremyMartens-b7z
    @JeremyMartens-b7z 3 месяца назад

    Is it LEGO, as produced b tge company LEGO, or just lego style building blocks? Cuz LEGO is actively suing youtubers calling noj Lego products Lego

    • @STHLabs
      @STHLabs 3 месяца назад

      Actual LEGO building blocks assembled into a bespoke kit. The blocks say LEGO.

  • @cloroxshots5408
    @cloroxshots5408 4 месяца назад

    its not lego unless its licensed and made by lego

    • @STHLabs
      @STHLabs 4 месяца назад

      LEGO bricks but a bespoke kit

  • @silverslicker
    @silverslicker 4 месяца назад

    WHERE DO I BUY THISSSS

  • @thomaschristensen2941
    @thomaschristensen2941 4 месяца назад

    off course, even the pc gaming lego set needs rgb in it

  • @Uefi-celes
    @Uefi-celes 4 месяца назад

    I’m not a Lego person anymore BUT

  • @cgwworldministries83
    @cgwworldministries83 4 месяца назад

    That is not LEGO brand. Please don't call it LEGO.

    • @randomfoot8313
      @randomfoot8313 4 месяца назад

      It's all real Lego its just a custom kit

    • @STHLabs
      @STHLabs 4 месяца назад

      Real LEGO bricks, just a bespoke kit using the real LEGO bricks

    • @cgwworldministries83
      @cgwworldministries83 4 месяца назад

      @@randomfoot8313 if it's real, where is the lego brand on the box?

    • @randomfoot8313
      @randomfoot8313 4 месяца назад

      @@cgwworldministries83 it doesn't have a Lego Logo because it is a kit assembled by a 3rd party

    • @realestchococatguy
      @realestchococatguy 4 месяца назад

      ​@@cgwworldministries83 bro it's actual lego bricks they're just apart of a kit made by a third party but they ARE real

  • @xeamumceo2681
    @xeamumceo2681 4 месяца назад

    Hell yeah! I run a eypc 7352

  • @VSaranara
    @VSaranara 4 месяца назад

    Epyc with 621 parts We call that lego set The E-621 AMD Lego Processor

    • @jacksonharris9362
      @jacksonharris9362 4 месяца назад

      You aren’t talking about the food additive are you?

    • @dimension4700
      @dimension4700 4 месяца назад

      Wholesome website

    • @BlindingWulf
      @BlindingWulf 4 месяца назад

      Uh…. Wait wait wait…

    • @mathladprotocat
      @mathladprotocat 4 месяца назад

      Unfortunate product name

    • @Mepitycat
      @Mepitycat 4 месяца назад

      cpu prices are crazy search up inflation on e621 for more info

  • @chhayheng8658
    @chhayheng8658 4 месяца назад

    Where can I find one?

    • @TheLynxBK
      @TheLynxBK 4 месяца назад

      Looks like an off brand Lego set but I’m still asking the same question. I want one Nooo… I NEEEEEEEEEEEEED IIIIIIIIIIIIT !!!! 🫠

    • @chhayheng8658
      @chhayheng8658 4 месяца назад

      @@TheLynxBK I want one sooo bad man

    • @STHLabs
      @STHLabs 4 месяца назад

      Real LEGO bricks, just a bespoke set

    • @chhayheng8658
      @chhayheng8658 4 месяца назад

      ​@@STHLabsIs it sold anywhere online?

  • @FebarchApray
    @FebarchApray 4 месяца назад

    Which os is installed in this servers?

  • @visheshgupta9100
    @visheshgupta9100 4 месяца назад

    7C13 on eBay for about $800, coming from China. Was wondering, is there anything as a fake CPU? Say if I buy it from eBay, how can I verify that it is a genuine CPU, and not a knock off, or a firmware tricking me to think it is 64 cores. Do make a video if you ever choose to give it a try.

    • @STHLabs
      @STHLabs 4 месяца назад

      We use this CPU and it is 64C EPYC Milan at least in the Tyan server we got.

    • @BarringtonRobinsonII
      @BarringtonRobinsonII 3 месяца назад

      They are £645 on eBay UK, also from China . But the price gradually goes up , still coming from China from various sellers . Likely that they would take consumer CPU rather they server stuff . But not impossible as they fake everything.

    • @GrowByLEDscom
      @GrowByLEDscom 2 дня назад

      @@BarringtonRobinsonII now on Taobao 7C13 is 600$ (4000uan) but motherboards 4000(1cpu) or 5200uan (2cpu)

  • @ShivMaple
    @ShivMaple 5 месяцев назад

    I seen gay stuff there

  • @donut-r4s6z
    @donut-r4s6z 5 месяцев назад

    so your telling me they made it have a big box to make it seem like it comes with a cooler just to use none of that extra space