Is This Mini PC AI Ready?
HTML-код
- Опубликовано: 21 окт 2024
- Can you really cram an AI machine into a mini pc form factor? Wendell investigates the Beelink SER9 AMD Ryzen AI 9 HX 370 Mini PC!
www.bee-link.c...
You can find us...
Twitter - / level1techs
Twitch - / teampgp
Patreon - / level1
Discord - / discord
For all our links, check out our link tree!
linktr.ee/leve...
Thank you for watching!
-------------------------------------------------------------------------------------------------------------
IMPORTANT Any email lacking “level1techs.com” should be ignored and immediately reported to Queries@level1techs.com.
Music: "Earth Bound" by Slynk
These Ryzen AI HX-series chips don't support SO-DIMM memory, so user-serviceable RAM is a no go on this platform. We might get something with CAMM-modules in the future.
Are you saying it's soldered DDR5, not LPDDR5? That's a thing?
Chinese recycled Intel processors win again!
You mean this series of mini pc? AMD AI 9 HX 370 does not dictate that you cannot use SO-DIMM. It is the decision of the mini pc maker. For this series of mini pc, Beelink uses soldered RAM onto the motherboard. The AMD CPU supports DDR5 memory. The CPU does not care whether you use DIMM or SO-DIMM sockets to house the RAM.
Whew Wendell at $1,000 USD this doesn't feel very disposable to me! Good gravy that's some serious dough for NUC.
£300 extra for those top notch Speakers. PMSL
I decided to go with the ser8, being able to stuff 96GB of memory in it is way more useful for AI for me than having a few more mythical TOPS on the soc
i wonder what models do you run on the cpu ? what workload is usable with that much latency ?
Everything is AI ready. Even my socks are
No. Your socks are alive, you should wash them.
Kind of how a fully threadable ( societially speaking ) technology works.
It's a relarively inexpensive layer that can provide value in a lot of places .. and others not so much.
Get used to it, really no need to comment and point it out every corner we turn. It's already known/expected
Imagine if AMD would support the IGPU and NPU with ROCm for AI generation. Then with 64+ GB of memory this thing would a beast.
That and a USB4 cluster of them running a distributed load.
We need THIS.
Take a shot for every time he says “Zen 5”
ded
Not even a minute in and im already half a bottle gone.
Coma
Speedrun into coma 😂😂😂
Please, I don't wanna die.
LPDDR5 3750 in AIDA is LPDDR5 7500, the fastest strix point supports, soldered
strix Zen5 cores are no the same as Zen5 desktop
strix is AVX512 double pumped (like Zen4) and is not full fat AVX512 load and store.
Turin Zen5(c) and Ryzen 9000 are full AVX512
Somethings I would like to see are USB-C power and some form of study plug for an external GPU (something more rugged than a bare PCIe connector)
Why usb-c is not the standard already? 😢
Hear me out, We've got 8 cores with the same 8MB of cache (1MB/core) as Zen2 4700G(at least this time all 8MB is usable by all 8 cores instead of only 4MB available to any one core), and then 4 cores with the same ammount of cache per core as a 7700x(4MB/core), how about unifying the cache, then dropping those 4 cores and trading them for more cache, say a total of 48MB of cache for those 8 zen4C cores, this frees up memory cycles and bandwith for those 16 RDNA 3.5 CUs
Heck if its more efficient to have 8MB of L3, use that freed up space for 48MB of slightly more dense but slower L4
Sure more cache uses more power, but also, you're giving up 4 cores which uses more power than cache, you're going to a unified cache pool instead of a split pool of 16+8 (sort of like in Zen2 mobile 4+4), getting more cache per core, and while not gaming, hitting memory less, going off package less, using less power.
"Background AI tasks" grumble grumble
3:18 this is what I envisision Wendell listening to on the daily. The quirkiness fits
It should have LPCAMM2 slot.
Doesn't have as good latency as on SoC package memory
Amazing! Beelink never disappoints! Thank you, Wendellman! 🙏🏼👍🏼🙃
$999 and it's 'basically disposable', this statement makes me a little sad with where things are in the PC space 😂
So... buy a computer based on ATX standards and stop crying?
Already hyped for the next Gen Intel MiniPCs.
Also haven't seen SO-DIMMs on Strix Point yet.
same as Lunar Lake you wan't as it will use CAMM or fix for faster speeds, otherwise it gimping it. You may get cheap chinese mini PC's have SO-DIMM but that would be SO DIM to do.
The bios on these is sketchy and getting a newer one requires direct contact from beelink. I suspect these are not a good idea if you have a security worry
Going to wake up in a cold sweat sayin "zen 5"
8:13 Satisfactory mentioned! Great game on Steam! :-D
The only thing AI is ready for is the burst of its bubble
I just hope that at some point any NPU hardware would be usable by endusers.
Bonus points if it's not just LLMs!
Frigate?
It's there to process the data it spies on you before it's sent to the hq.
With soldered memory it won't be LLMs, so bonus points for everyone!
Wendell speed running how many times he can say Zen 5 in one video. Hacking the RUclips algo through the transcript? Good for you!
I'm more excited by the built in speakers than anything AI. I wish my daily driver mini PC had built in speakers so I don't have to have the little speaker taking up one of my USB ports.
Anyone know which version of Zen this PC uses?
I think it's an Intel Ultra
@@Koop1337 Oh you're probably right! 🤣
Crazy prices, useless equipment, tech industry sniffing glue it seems.
god tier unboxing video
as usual
I upgraded the memory in my Ser 6 pro. It wasn't too big of a deal. 20 screws or so.
My grandma doesn't need Zen 5c and a top of the line GPU ;D
Not sure about Wendell's
If I had a dime for each time I see AI on products these days..
Can it handle 70b LLAMA model? What is the speed per token?
NPU chips are great but it's a shame we're moving further away from general processors to everything being healed by discrete processors like NPUs.
All video waiting for LLM launch, till the end
Linux noob here. I got the SER9 and tried to get it running under the latest mint distro(wilma?).
Sadly it only works in "recovery" mode from the first moment when booting from the stick for installation.
Even after installing and updating the kernel and mesa to the latest stable versions, it still will only boot into a black screen.
I tried the "Oibaf" mesa drivers as well, they did not only not solve the issue, but also introduced a color bug (red turns into blue) and required to reinstall the machine (and introduced me to timeshift :D ).
So my current workaround is an updated Grub to stop it from booting normally and maually going into recovery.
I am looking forward how You have solved the issue. Otherwise I am sitting, waiting and hoping for that kernel update down the line that will fix this issue.
Ser9 otherwise runs perfect under Linux Mint in compatibility/recovery mode.
Love the little bugger ;) Just currently only have a limited default display and seemingly no 3d acceleration.
(btw mine also came with 24H2 out of the box preinstalled...)
23h2 has been available as a straight release for a bit.
Waiting for OCulink 8i becoming norm in SSF boxes.
18 sec ago! Though members have been here for days already. But I bet they're LLM's! Wendell has a mini-PC that can run AI!
Disposable ? AT THAT PRICE ??? No. These are DoA. Just too damn expensive. With 64GB RAM we could talk but with 32GB not a chance. I am wondering if we'll ever see a SO-DIMM system with these. Maybe the new CSODIMM some time in the future ?
I have AI in my pants, this little head does a lot of thinking for me.
Personally, I think the MINISFORUM BD790i is a much better deal for the money, but this is interesting.
Any suggestions for vid encoding (Plex/OBS) + PiHole + WireGuard + VPN?
Pi-clones or something similar to this PC running Proxmox?
Why can’t they put power brick inside! Just how pc should have. Mac mini does it right
The Mac Mini is bigger in footprint, possibly not in volume.
A new minier mini is supposedly coming out before the holidays.
That Day of the Tentacle music sounded odd as heck. Can't tell if its the speakers, the remake, or both lol
When/where is my mini pc I can jam 12+ NVMe drives into?
Get 4 x gem10's which have 3 nvme slots and use the oculink as a host:host interconnect for 8GB/sec and set up a cluster fs and you'll have a storage beast :D
The memory is shared with the igpu and you therefore have a "gpu" with 32gb (or more) can it run a 20b model?
Yes but only 32gb of ram. Some of the strix point have 64gb which think is max as a mid to low end cpu
Strix halo with 128gb at 256bit and a good gpu and cpu is hype train for 70b model. Will cost but compared to gpu cluster... with 15 core x3d zen 5 so hyped
A bit odd audio, but fine mini PC
For most tasks you mention this seems overkill, unless you are doing them all at the sane time.
For homelab use, does frigate use the NPU?
not yet
@@Level1Techs I saw the content on proxmox on 3 mini pc. And with 10gb and faster usb4ethernet adapters becoming available... An external storage enclosure on each with usb 3.2... ceph..
That is where I see the real value come in. Especially if they zip power for most uses.
Nice, little box, looking for a small form factor for the wife new desktop but $999.
Buying a Gen5 drive for new X870e Build on MSI Carbon Wifi,
I already have a 2tb Samsung 980 Pro Gen4. Which should I make the
boot and which one for the games to be stored on? Thanks
But does it handle CS2 on a 27" 360 hz monitor?
That is the only question I care about!
does that npu work on linux? frigate?
Ok, now tell us why AI even matters to regular people. It doesn't unless your goal is to catalog and control large populations.
I need one for batocera arcade games
sorry with the recall fiasco going on.. I'm out on the win 11 stuf
anyone programming the npu to go ahead and click away popups, ads, legitimate interest and vendor opt-outs, etc, before loading the page? 😅
That’s like 2 browser extensions
AMD and Intel both have killed support for user replaceable memory on their latest mobile platform. So any mini PCs that use Ryzen AI or latest Intel CPUs wont come with DIMM or even CAMM slot anymore.
Do. WANT!
isnt the memory soldered on?
What the actual flip is the point in a built in speaker? Most monitors have built in speakers anyway, making these pointless
Day Of the best Game Ever!
Whats the dealio with Linux and Lunar Lake?
so a zen5 c core is an "economy core"? will AMD apologize to intel for the shade they threw awhile back?
so it's not like that, it's the same zen 5 core but less cache and less max clock speed so lower power ceiling. as a result it takes up way less silicon real estate. it's the same core with the same features though that's the distinction
Why do you only get 2, 3 years out of this?
I think you're overstating the Linux requirements, for those who care, and I know you do, you'll need
Linux 6.10 or higher.
Mesa 2.4 or higher
And linux-firmware-20240811 ONLY.
lower firmware than 20240811 and the GPU won't initialize, and anything higher, amdpu will hang while loading.
It's too bad that the higher firmwares hang since manjaro, Ubuntu 24.10 and bazzite all use the higher firmware. You could use "nomodeset" for a kernel parameter to prevent amdgpu from loading until the firmware is rolled back to 20240811.
These mini pcs are reported as unreliable with instability and heating issues.
I'd rather a model without the speakers. Great looking machine otherwise.
ZENfandel
Zen 5 is price issue's. I'm looking at putting a 7940HS into a mini tower PC as was going to go 7950 and seriously under clock and power reduce because most of what I do can be done on my intel N100 but I miss having big power for games and work. Those things I still have to do on Windows machine. Idle of the 7950X is way to high for just watching You tube. Also AM5 mobo are over priced for what they are or nasty cheap and wouldn't cope with 16 core chips. So I been looking at the DB790! itx board with the 16 core 7940HX if I going to have to go dGPU route. that said heard Strix Halo has been listed in AMD drivers and kernel drivers, So if that does have 40CU GPU than Ryzen AI mini it might be. if that cheap isn't gimped for gaming handset with only 8 compute cores.
This is way too much for a mini PC that has entry level gaming performance and comes with questionable warranty and BIOS support.
It depends on your use case. If you need to game at 4K/240 at SuperUltraMaxEyeBleed settings, then no, this isn't for you. I'm a truck driver, my monitor is a 24" 1080p TV, my 110V is limited to 1800W, and I would like to be able to run both my computer and my microwave at the same time. Yes, I do have a decent SFF gaming PC on board, but my main computer is a Minisforum 7940HS based system running Linux. The only time I fire up the Windows (gaming) PC is to play one of the (very) few games I have that won't run under Proton. (Think Steam Deck, but a bit more powerful.) The Minisforum rarely pulls over 50W, and the Windows machine pulls nearly that much at idle.
GaMiNg PeRfOrMaNcE.
Derp.
Ai this ai that
How about a piece of software that uses the NPU because that waste of silicone is sitting at 0% usage in task manager all day even if you dare to use ai apps like msty and copilot
Disposable? 2,3 4 years from now you still won’t be able to replace it with anything better.
Tech progress has slowed wayy down
Lmao
First thing is too strip out and block anything related to artifical stupidity system. Ass for short
I've been calling it Augmented Idiocy. 😉
Stop promoting AI nonsense. When people stop giving anything labeled AI attention, we can go back to just having regular products at regular prices. It's bad enough people think that, speech recognition, chat bots and internet scraping programs are AI. lol
I love trhe GTI version of this but those BS speaker in all of them WTF are they thinking. Rather tyhey made it cheaper and ditched them. Without the speakers they could have put easy memory access and more cooling. I was sold on the new GTi15 and then I looked at their home pages and inside and why waste that space with shit speakers. I'll wait on the Trigkey or others. With this platform I would be OK with soldered Ram if it higher rate MHz and less latency. Fix ram is normally better bar no upgrade path, but how does upgrade a OEM point of OEM boxes is you buy want you need and then upgrade whole machine at a time. the Speaker are their version of the SD card Minusforum love so much and I find they are a waste and would rather have more USB-C's.
\o/
ruclips.net/video/EefWJ8Z9tgE/видео.html does your data drink Romulan ale?
I hope Wendell didn't pay for this unit, they're sending them out to countless techtubers. They're going to be great collectors pieces, given how few will be made or sold at that price.
Disposable. Dude.
AI lmao
Overpriced garbage
That hand under the chin thumbnail makes me irrationally irritated no matter where I see it.
JESUS LIVES IN ''AUSTRALIA'' THE ~THE.LUCKY.COUNTRY🇦🇺^*'~ .''IN THE LAND DOWN UNDER''.....UNDER.THE.SOUTHERN.''CROSS'' AND HOME OF THE ''WONDERFUL WIZARD OF OZ'' 🕊🪽🍄💫⭐