Local LLM Challenge | Speed vs Efficiency

Поделиться
HTML-код
  • Опубликовано: 21 дек 2024

Комментарии • 373

  • @AmanPatelPlus
    @AmanPatelPlus 2 месяца назад +120

    If you run ollama command with `--verbose` flag, it will give you the tokens/sec for each prompt. So you don't have to time each machine separately.

  • @chinesesparrows
    @chinesesparrows 2 месяца назад +129

    Man this question was literally on my mind. Not everyone can afford a H100

    • @adamrak7560
      @adamrak7560 Месяц назад +6

      H100 is not inferencing, it is for training (but widely used for inferencing too, super wasteful).
      There is a massive market hole for inference hardware.

    • @malloott
      @malloott 11 дней назад +1

      @@adamrak7560 jup! And somehow the m4 max with 128gb is a cheap option for it now..

    • @enzocaputodevos
      @enzocaputodevos 23 часа назад

      By orin kit 64 G or THOR

    • @enzocaputodevos
      @enzocaputodevos 23 часа назад

      @@malloottwaiting for it but my M1 Max just need to be replace then I will test the M2 MAX 64G/2T

  • @alx8439
    @alx8439 2 месяца назад +45

    For your 4090 machine give it a try with ExLlamaV2 or Tensor-RT as an inference engine. They will give you +50% performance boost compared to ollama / gguf models. Also this initial 2 seconds performance hit is only ollama specific thing with default settings - and it happens because by default ollama unloads model from memory after some idle timeout. You can turn this behavior off

    • @fnorgen
      @fnorgen 5 дней назад

      Running the GPU at a reduced power level can also be quite viable. It's common that you can sacrifice a bit of speed for significantly better efficiency. Especially for tasks that bottleneck on memory bandwidth. I rarely run my 3080ti past 80% power. It varies a lot from card to card and from task to task, so it takes a bit of testing to find the right balance. Though, the 4090 especially is known to be tuned deep into diminishing returns from the factory, so you can cut a lot of power without losing much performance.

  • @stokeseta7107
    @stokeseta7107 2 месяца назад +48

    Energy efficiency and heat are the reason I go for mac at the moment, upgraded a few years ago from a 1080 ti to a 3080 ti. Basically sold my pc a month later and bought a PS5 and MacBook.
    So I really appreciate the inclusion of efficiency in your testing.

    • @fallinginthed33p
      @fallinginthed33p 2 месяца назад +7

      Electricity prices are really expensive in some parts of the world. I'd be happy running a MacBook, Mac Mini or some small NUC for a private LLM.

    • @vadym8713
      @vadym8713 2 месяца назад +1

      @@fallinginthed33p AND it good for environment!

    • @Solarmopp-i7r
      @Solarmopp-i7r Месяц назад

      @@vadym8713 sooolaaaar

  • @ferdinand.keller
    @ferdinand.keller 2 месяца назад +22

    7:42 If you set the temperature of the model to zero, the output should be deterministic, and give the same results across all machines.

  • @HaraldEngels
    @HaraldEngels Месяц назад +3

    I highly appreciate your focus to run LLMs locally, especially on affordable mini PCs. Very helpful. This kind of edge computing will grow massively soon. So please continue to create/run such tests.

  • @davids4227
    @davids4227 5 дней назад +1

    Very instructive, I have never thought about power costs. It makes paying $20 a month for a LLM service seem reasonable.

  • @alexbaumgertner
    @alexbaumgertner 2 месяца назад +4

    Thanks! My small participation in the electricity cost :)

    • @AZisk
      @AZisk  2 месяца назад

      Appreciate you!

  • @rotors_taker_0h
    @rotors_taker_0h 2 месяца назад +8

    You don't have to load the model into the vram every time. It is actually crazy to compare like that. You load once and then send requests, then RTX latency will be the lowest.

  • @danielkemmet2594
    @danielkemmet2594 2 месяца назад +10

    Yeah definitely please keep making this style of video!

  • @robertotomas
    @robertotomas 2 месяца назад +9

    If you wanna make your tests deterministic with ollama, you can use the /set command to set the parameters for top k of 0 and top p, temperature of 0, and set the seed parameter to a same value. Also, if instead of running a chat if you put the prompt in the run command and use -verbose you’ll get the tps

  • @djayjp
    @djayjp 2 месяца назад +42

    Would be interested to test iGPU vs (new) NPU perf.

    • @chinesesparrows
      @chinesesparrows 2 месяца назад +7

      Yeah tops per watt

    • @andikunar7183
      @andikunar7183 2 месяца назад +8

      Currently NPUs can't run the AI models of the tests well. llama.cpp (the inference code behind ollama) does not run on the NPUs (yet). It's all marketing only. Qualcomm/QNN, Intel, AMD, Apple all have different NPU architectures and frameworks, which make it very hard for llama.cpp to support them. Apple does not even support their own NPU (called ANE) with their own MLX-framework.
      llama.cpp does not even support the Qualcomm Snapdragon's GPU (Adreno), but ARM did some very clever CPU-tricks, so that the Napdragon's X Elite's CPU is approx. as fast as a M2 10-GPU for llama.cpp via their Q4_0_4_8 (re-)quantization. You can also use this speed-up with ollama (but need specially re-worked models).

    • @GetJesse
      @GetJesse 2 месяца назад +1

      @@andikunar7183 good info, thanks

    • @flyingcheesecake3725
      @flyingcheesecake3725 2 месяца назад

      @@andikunar7183i heard apple mlx do use npu but we don't have control to manually target it. correct me if i am wrong

    • @andikunar7183
      @andikunar7183 2 месяца назад

      @@flyingcheesecake3725 you mean Apple's CoreML and not MLX. CoreML supports the GPU and NPU (Apple calls it ANE), but with limited control. Apple's great open-source machine-learning framework MLX does NOT support the ANE (at least until now), only the CPU+GPU.

  • @timsubscriptions3806
    @timsubscriptions3806 2 месяца назад +12

    I’m with you! Apple wins by a mile. I have compared my 64G Mac Studio M2 Ultra to my Windows WS that has dual Nvidia A4500 using NVlink (20G for each card) and at half the price the Mac Studio easily competes with the Nvidia cards. I can’t wait to get an M4 Ultra Mac Studio with 192G Ram -maybe more RAM 😂. I use AI for LOCAL RAG and research and local code assistant for Vs code

    • @timsubscriptions3806
      @timsubscriptions3806 2 месяца назад

      BTW, the Mac Studio was half the price of the Windows workstation

  • @showbizjosh40
    @showbizjosh40 2 месяца назад +1

    The timing of this video could not have been more perfect. Literally working on figuring out how to get an LLM running locally because I want the freedom of choosing the LLM I want and for privacy reasons. I only have an RTX 4060 Ti w/ 16GB but it should be more than sufficient for my purposes.
    Love this style of format! It makes sense to consider electric cost when running these sorts of setups. Awesome quality as always!

    • @oppy124
      @oppy124 2 месяца назад

      LM studio should meet your needs if you're looking for a one click install system

  • @fernandonati
    @fernandonati Месяц назад +1

    This video is exactly the answer for me. Thank you!

  • @TheHardcard
    @TheHardcard 2 месяца назад +27

    You can make LLMs nearly deterministic if not entirely with the “Temperature” setting. I haven’t yet had time to experiment with this myself, but I’ve been following this with great interest.
    I’d be joyous to see a similar comparison woth the (hopefully just days away) M4 Pro and M4 Max alongside your other unique, insightful, and well designed testing.

    • @TobyDeshane
      @TobyDeshane 2 месяца назад +12

      Not to mention setting the seed value. I wonder if there would be any per-machine difference among them with the same seed/temp, or if it would generate the same on both.
      But without them pinned to the same output, a 'speed test' that isn't about tokens/sec is pointless.

    • @toadlguy
      @toadlguy 2 месяца назад +1

      @@TheHardcard “Hallucinations” (i.e. incorrect answers) and temperature are two different things. Although increasing the temperature (variability in the probability of the next token) is likely to produce more incorrect responses, it also can create more creative responses (that may be ‘better’) in many situations. Incorrect responses are simply the result of both the training data and the architecture of a next word prediction model.

  • @RichWithTech
    @RichWithTech 2 месяца назад +6

    I'm not sure how I feel about you reading all our minds but I'm glad you made this

  • @Himhalpert8
    @Himhalpert8 2 месяца назад +4

    I'll be totally honest... I don't have the slightest clue what's happening in this video but the little bit that I could understand seems really cool lol.

  • @technovangelist
    @technovangelist 2 месяца назад +3

    This was fantastic, thanks. I have done a video or two about Ollama, but haven't been able to do something like this because I haven't bought any of the nvidia cards. It is crazy to think that we have finally hit a use case where the cheapest way to go is with a brand new Mac.

    • @4.0.4
      @4.0.4 26 дней назад

      As long as you don't upgrade anything that is. 2TB costs $800, while a Gen4 2TB Samsung 990 costs $160

  • @zalllon
    @zalllon Месяц назад +1

    Really interesting to see the Mac mini and how well it performs. As someone who owns a Mac mini M1, it’s simple design, relatively small footprint, exceptionally quiet, operation, and low power consumption are all pluses. I think with my experience on the original Apple Silicon, I would definitely go with the M2, especially since good for chunks of the day, this system would be idle.

  • @ChrisGVE
    @ChrisGVE 2 месяца назад +6

    Very cool content thanks Alex, I've always wanted to try one of these models locally but I couldn't find the time, at least I can follow your steps and do it a bit faster :) See you in your next video!

  • @deucebigs9860
    @deucebigs9860 2 месяца назад +5

    I got the K9 and 96gb after your first video about it, and am happy with the output speed and power consumption for the price. I did get a silent fan for it though cause it is loud. I only really do coding work so I think the Mac would be great, but the RTX is just overkill. I'm very curious the next gen of Intel processors so please do that test. I don't care about the RTX honestly cause I needed something that good I can put that money towards claude or chat gippity online and not have to deal with the heat, power consumption, maintenance, and run a huge model. I personally don't see the benefits of running a 7B parameter model at lightning speed. I'd rather run a bigger model slower at home. Great video! So much to think about.

  • @seeibe
    @seeibe 2 месяца назад +1

    Great test! This is exactly what I'm interested in, especially the idle power test is important, as you won't be running inference 24/7 usually. Amazing to see that "mini PC" with the eGPU takes more power in idle than my full blown desktop PC with a 4090 😅

  • @samsquamsh78
    @samsquamsh78 2 месяца назад +2

    thanks for a great and interesting video! I have a Linux machine with a nvidia card and a macbook pro m3, and personally I really care about the noise and heat from the linux/nvidia machine - after a while it's bothering. the mac makes zero noise, and no heat and is always super responsive. in my opinion, it's incredible what Apple has built. thanks again for your fun and cool technical videos!

  • @AndreAmorim-AA
    @AndreAmorim-AA Месяц назад +3

    It is not only the hardware, but the CUDA (Compute Unified Device Architecture) framework that allows developers to harness the massive parallel processing. The question is whether Apple will develop an MLX framework more suitable for AI development.

  • @DevsonButani
    @DevsonButani 2 месяца назад +7

    I'd love to see the same comparison with the Mac Studio with the Ultra chip since it has similar cost to a high spec PC with a RTX4090. This would be quite useful to know for workstation situations

    • @t33mtech59
      @t33mtech59 Месяц назад

      I was thinking the same think. And more model size headroom due to unified ram up to 128gb whereas 4090 is locked at 24gb

  • @LanceWhite
    @LanceWhite 21 день назад

    Great work Alex! Really timely information about running LLMs locally. If you are wanting to protect your IP and security this is the way to go. It's a pioneering time. I am sure there will be more dedicated setups to do the inferenence efficiently as right now it seems still very clunky at the hardware level. It would also be great to compare a EC2 Instance spun up on demand to do the inference too. This comparison would give an option to protect your IP/Security but get perhaps a cost effective solution that doesn't act as a room heater.

  • @maks-yaremenko
    @maks-yaremenko 23 дня назад

    I was waited for that video, thanks for comparison

  • @MrSniper2k7
    @MrSniper2k7 4 дня назад

    Totally agree M2 Pro would do it for now. I gave thumbs up up up

  • @yoberto88
    @yoberto88 Месяц назад

    Thanks for making this video! I needed to watch something like this!

  • @davidhowell5578
    @davidhowell5578 10 дней назад

    That gigantic rig with the rubber fingers is comedy gold. Like you couldn't trigger them remotely, or just test them not simultaneously. Clearly it's for laughs.
    Testing weirdly tiny computers though, for local LLM performance and using a cable attached GPU. Who would seriously use machines like that for this purpose?

  • @haha666413
    @haha666413 2 месяца назад +2

    love the comparison. can't wait for a next, maybe try the 4090 in a pc so it can actually stretch its legs and copy the data much quicker to vram

  • @leatherwiz
    @leatherwiz Месяц назад

    Thanks for this content and comparison. I think as this becomes more mainstream, there will be less nerdy setup’s and software to use this on a pc, Mac or tablet in the near future. 👍🤖

  • @camerascanfly
    @camerascanfly 2 месяца назад +6

    0.53 EUR/kWh in Germany? Where did you get these numbers from? About 0.28 EUR/kWh would be an average price. In fact prices dropped considerably during the last year or so.

  • @christhomas7774
    @christhomas7774 2 месяца назад +1

    Great video! Thanks for doing not only the comparison, but also the analysis for the second half of the video.
    I can’t wait when you test the new Intel Core CPU that just came out. Since you use the iGPU on the NUC, please mention the speed of the DRAM in your next comparison video, as it can have an impact on results (just like DRAM can have an impact on the performance of a video game). I hope a desktop machine with a 4090 makes it in your next comparison video. Even if it is a machine with a mini-ITX MB with a 16x pie slot would be much better

  • @davidtindell950
    @davidtindell950 2 месяца назад +3

    thanks yet again !

  • @comrade_rahul_1
    @comrade_rahul_1 2 месяца назад +3

    This is what I want to watch about tech. Amazing man! ❤

    • @AZisk
      @AZisk  2 месяца назад +1

      Glad you enjoyed it.

    • @comrade_rahul_1
      @comrade_rahul_1 2 месяца назад +1

      @@AZisk Great work sir. No one else does these things except you. 👌🏻

  • @EladBarness
    @EladBarness 2 месяца назад +1

    Great video! Thanks
    In the verdict you forgot to mention
    that the only way to run bigger LLMs is with Mac’s if you have enough unified memory.
    yes it’s gonna be slow but still possible and faster than cpu
    You mentioned it in the beginning though :)

  • @nasko235679
    @nasko235679 2 месяца назад +2

    I was actually interested in building a dedicated LLM server, but after a lot of looking around for language models, I realized most open source "coding" focused LLMs are either extremely outdated or planely not good. LLama is working with data from 2021, DeepSeek Coder 2022 etc. Unfortunately the best models for coding purposes are still Claude and ChatGPT and those are closed.

  • @aaayakou
    @aaayakou Месяц назад +1

    I think the 4060 ti 16GB should have been included in the comparison.
    It seems like a most valuable solution.
    It combines a small price, good performance, low consumption and fairly compact size. I think for local llm it should be the best solution from nvidia for the average user.

  • @nomiscph
    @nomiscph Месяц назад +2

    I love the test; I would love to see the speed of a beefed up M4 laptop and then maybe using 1.58bit interference

  • @hajjdawood
    @hajjdawood Месяц назад +2

    People always saying Apple is overpriced but if you actually use them as a work tool they are by far the best bang for the buck.

    • @SlavaBagmut
      @SlavaBagmut Месяц назад

      Storage pricing is not best bang for the buck for sure

  • @AlexADumbDumb
    @AlexADumbDumb Месяц назад +1

    You can actually measure the heat VERY EASILY because every watt consumed is converted to heat with EFFECTIVELY 100% efficiency! It's just resistive heating with a few extra steps, but all those extra steps only produce heat as a loss anyway. Technically a very small amount is lost to things like vibrations and maybe UV radiation leaving through an open window or whatever, but you can basically ignore that for all practical purposes.
    1W/h of power consumption is around 3.5 BTU/h and 1000J is around 1 BTU. So in your case, a single run consumes (rounding for easiness) let's say 5 BTU for the intel, 2.5 for the M2 and 4 for the RTX.

  • @siddu494
    @siddu494 2 месяца назад +2

    Great comparison Alex just shows if a model is tuned to run on a specific hardware it will outperform in terms of effficiency. However I saw an article today that shows Microsoft open-sourced bitnet.cpp a blazing-fast 1-bit LLM inference that runs directly on CPUs. It says that now you can run 100B parameter models on local devices.
    Will be waiting for your video on who this changes everything.

    • @andikunar7183
      @andikunar7183 2 месяца назад

      LLM inference is largely determined by RAM bandwidth. The newest SoCs (Qualcomm/AMD/Intel/Apple) almost all have 100-130 GB/s. While the M2/M3 Max has 400GB/s, the Ultra 800 GB/s, the 4090 has >1TB/s. And all the new CPUs have very fast matrix-instructions, rivalling the GPUs for performance. 1.5-Bit quantization might be some future thing (but not in any useable model), but currently 4-Bit is the sweet-spot. Snapdragon X Elite CPU Q4_0_4_8 quantized inference is already similar in speed to M2 10-GPU Q4_0 inference with the same accuracy.

  • @ALYTV13
    @ALYTV13 2 месяца назад

    Just what I needed, have been carrying the idea of a multi mac mini setup for a while now, especially with the use of exo labs.

  • @rayongracer
    @rayongracer Месяц назад

    Living in a cold climate the 4090 is perfect, in a machine with fast pcie it is super fast when coding, it sits on my home server and it really rocks. I did test the llama 3.1 8b and codegemma on a 4060 Ti 16 gig card which worked really nice, not blistering fast as the 4090 but fast enough. a 4060 Ti 16 gig is not expensive, so if cost is important that is a great option. It also is way less power hungry than a 4090. The test rig i made was running as a server with several services running and i let others play with the llm as well, nobody ever complained about speed. But the issue was if more than one was using the llm at the same time it started to slow down, or when you had a long sessions with it. That is when i upgraded the server to a 4090 card and all those issues went away.
    It would be cool if you tested multiple users on tests as well. From what I understand many people who run local llm share it with the family and even friends.

  • @luisrortega
    @luisrortega 2 месяца назад +3

    I wonder if the benchmark uses the latest MLX apple library, when I switch to it (on LM Studio), it was an incredible difference. I can't wait until Ollama add it!

    • @andikunar7183
      @andikunar7183 2 месяца назад

      Ollama uses the llama.cpp code-base for inference. And llama.cpp doesn't use MLX.
      I admit, that I did not benchmark MLX via llama.cpp recently, I have to look into it. MLX in my understanding can use GGUF-files, but only limited quantization variants. Q4_0 seems a good compromise, but llama.cpp can do better.

  • @theunknown21329
    @theunknown21329 2 месяца назад +1

    This is such cool content!

  • @TheRealTommyR
    @TheRealTommyR Месяц назад

    I like this style of video and 100% want to see more, especially with continuously updated test as hardware is updated like an m4 device or if you get a mac studio or ultra, intel, etc.

  • @abysmal5422
    @abysmal5422 Месяц назад

    Interesting analysis! Two things:
    1) I believe heat is pretty much just the energy consumed. There's no chemistry involved, just physics, so aside from negligible light and sound and a small amount of work from spinning fans, a computer using 100 watts is essentially a 100W heater.
    2) The Intel mini pc loses in speed and efficiency, but its real strength is the amount of RAM. You could run a 70b model with minimal quantization and get better output than either of the other machines is capable of (though quantifying that and putting it on a chart would be difficult).

  • @danieljueleiby914
    @danieljueleiby914 2 месяца назад

    Hey Alex. Thank your for this kind of comparison. Often I only see speed matrixes, this with average energy consumption, speed, initial cost and heat generated was exactly what I wanted to see. A full array with multiple tests. Thank you, I will definitely see more if you make more power/speeds/cost/Wcost/.... Comparison. ! Thank you.

  • @Solstice42
    @Solstice42 2 месяца назад

    Great assessment- so glad you're including power usage. Power and CO2 cost of AI is critical for people to consider going forward. (for the Earth and our grandchildren)

  • @parshwa_1
    @parshwa_1 Месяц назад

    I like it , interesting to watch mate✌

  • @mshark2205
    @mshark2205 2 месяца назад

    This is top quality video I was looking for. Surprised that Apple silicon runs LLMs quite well…

  • @clajmate69
    @clajmate69 25 дней назад

    this really helps me alot thaks you

  • @mynameisZhenyaArt_
    @mynameisZhenyaArt_ 2 месяца назад

    Yep, we are waiting for 20A process node CPUs to be released! Please share the performance review as soon as you get your hands on it! Thank you Alex!

  • @Moyano__
    @Moyano__ Месяц назад

    I love this channel.

  • @arkangel7330
    @arkangel7330 2 месяца назад +4

    I'm curious how the Mac Studio with M2 Ultra would compare with the RT 4090

    • @AZisk
      @AZisk  2 месяца назад +6

      Depending on the task, I think it would do pretty well. It won't be as fast on smaller models, but it will destroy the RTX on larger models.

    • @brulsmurf
      @brulsmurf 2 месяца назад +1

      @@AZisk It can run pretty large models, but the low speed makes it close to unusable for real time interaction.

    • @mk500
      @mk500 2 месяца назад +1

      @@brulsmurfI use 123B models on my M1 ultra 128GB. It can be as slow as 7 tokens per second, but I find that still usable for interactive chat. I’m more into quality than speed.

    • @MarcusHast
      @MarcusHast 2 месяца назад

      There is quite a lot of talk about this in r/localllama. For LLM work 4090 is faster than an M2 Ultra. You can get more memory on a M2 Ultra, but you can also get multiple 4090 (or perhaps even better, 3090) and put in a computer for typically less money (and better performance).
      If you get over 90 GB requirements (4 xx90 cards) then neither model is really fast enough to be useful. (When you get to about 1 token per second then you're probably better off just renting a machine online or buying tokens from eg OpenAI.)

  • @tomat4135
    @tomat4135 2 месяца назад +1

    Would be really interesting to see a more comprehensive benchmark in price-tiers. Like @500-750 USD (NUC, maybe a M1 MBAir 8GB (often on sale) or Mac Mini M2 8GB) § @1000-1500 USD (Mac Mini M2Max, ARM-box, ???) § @2000-3000 USD (NUC+RTX4090, Mac Mini M2Max, Base Mac Studio) § @>3000 USD (Built PC with dual 3090 24GB, H100, Mac Studio Ultra)

  • @lordkacke6220
    @lordkacke6220 2 месяца назад

    I really enjoyed this kind of video. More stats and statistics would also be nice but I also know that it's time consuming

  • @newman429
    @newman429 2 месяца назад +14

    I am pretty sure you heard about asahi linux so will you make a video on it ?

    • @ALCE-h7b
      @ALCE-h7b 2 месяца назад +4

      it seems like he already did 2 years ago.. Did something changed?

    • @newman429
      @newman429 2 месяца назад +2

      ​@@ALCE-h7b
      No they are still doing the what they were doing before but I suppose they took a big leap now with the release of their 'Asahi game playing toolkit' which in short makes playing AAA games on Mac very probable
      Maybe if you wanna lean more, why not read their blog.

    • @AZisk
      @AZisk  2 месяца назад +7

      Maybe I need to revisit it. Cheers

  • @wnicora
    @wnicora 2 месяца назад +1

    Really nice video tx
    What about performing the test on the Qualcomm dev kit machine? Interesting to see how the snapdragon performs

  • @kdl0
    @kdl0 Месяц назад +1

    Well, yes, of course we want to know how the 200H core ultra series will perform. Have you heard any news about when Asus is releasing the Nuc 14 AI? I haven't seen any public information yet.

  • @Ruby_Witch
    @Ruby_Witch 2 месяца назад +3

    How about on the Snapdragon CPUs? Do they have Ollama running natively on those yet? I'm guessing not, but it would be interesting to see how they match up against the Mac hardware.

    • @Barandur
      @Barandur 2 месяца назад

      Asking the real question!

    • @sambojinbojin-sam6550
      @sambojinbojin-sam6550 Месяц назад

      There's plenty of frontends on Android(Layla, Pocket Pal, chatterAI, MLCChat, etc) or you can run ollama through Termux if you want. Snapdragons do pretty well on phones, considering they're also a phone.
      About 2.5-3 tokens/sec on Snapdragon 695 on Llama 3.2 8B parameter model (~$200USD phone, ala Motorola g84. Slow memory, slow CPU, 12GB RAM. About 5 watts usage).
      About 12-22 tokens/sec+ on Snapdragon 8 gen 3 (~$600-700USD phone, ala OnePlus Ace 3 Pro. Good memory, good CPU, 24GB RAM, so can do bigger models. About 17.5 Watts usage).
      So, they're not bad, but they're nowhere near a decent desktop CPU/ GPU/ or Mac integrated RAM thingy. But they can run them, to vaguely "usable" speeds (smaller models go quite a bit quicker, and are getting pretty good too. There's Llama 4B Magnum and Qwen 2.5 3B that will double and a bit those speeds, especially using ARM optimized versions. They're not "super smart/ knowledgeable", but they're good enough for entertainment purposes).

  • @dave_kimura
    @dave_kimura 2 месяца назад +3

    I'm surprised the the Oculink doesn't create more of a performance hit than it did. My 4090 plugged directly into the Mobo gets about 145 tokens/sec on llama3.1:8b verses the ~130 tokens/sec that you got. Kind of make sense since the model is first loaded into memory on the GPU.

    • @andikunar7183
      @andikunar7183 2 месяца назад

      Token-generation during inference is largely memory-bandwidth bound (OK, with some minimal impact for quantization-calculations) - Intel 1TB/s. And the LLM runs entirely on the 4090. The 4090 really shines during (batched) prompt-processing, blowing the Intel/Apple machine away - probably >20x faster than the M2 Pro, and way, way more so than the Intel CPU/GPU.

  • @slaynnyt8130
    @slaynnyt8130 16 дней назад

    I've got an 4090 for my gaming PC, and a good old trusty lenovo thinkpad for work stuff. Just recently jumping on this LLM bandwagon, installed the LMStudio on my Windows desktop and exposed the LLM as Rest API, I think I have been badly spoiled by this having been my first experience running LLMs. Also now I can say: "It's for scientific purposes" when purchasing expensive GPUs lol

  • @pe6649
    @pe6649 2 месяца назад +1

    @Alex for me it is even more interesting how much longer the Mac Mini will take on a finetuning session than a 4090 - only inference is a bit boring

  • @PaulPetterson
    @PaulPetterson 2 месяца назад +1

    at 15:10 you show a document that says both that M2 16GB costs $0.11 per day and $.03 per day, and yearly costs are $40 and $12 per day. I looked closer because 3 cents per day seems suspisouly low.

  • @AmosKito
    @AmosKito Месяц назад +1

    You assumed that the wattage was constant, which it likely isn't. Your outlet meter can measure the total energy usage.

  • @dudaoutloud
    @dudaoutloud 2 месяца назад

    Excellent comparison! For me, an interesting future comparison would be between the RTX setup and an equally priced Mac Studio. And then re-compare after the new M4 Pro/Max is available (hopefully next week?).

  • @Johnassu
    @Johnassu 2 месяца назад

    Great test!

  • @PseudoProphet
    @PseudoProphet Месяц назад +2

    I don't think speed is all that important when you're running it locally. The most important thing is the memory and the bandwidth between the memory and the processing.

  • @atom6_
    @atom6_ 2 месяца назад +4

    a Mac with MLX backend can go even faster.

  • @donjaime_ett
    @donjaime_ett 2 месяца назад

    For an AI server, once the model is loaded into vram, you probably want it to remain there for repeated inferences. So it depends on how you set things up.
    Also if you want apples to apples determinism, reduce the temperature at inference time.

  • @daillengineer
    @daillengineer Месяц назад

    cant wait to see how the new M4 variety fares in a few weeks!

  • @corvinyt
    @corvinyt Месяц назад

    Cool video!

    • @AZisk
      @AZisk  Месяц назад +1

      Thanks!

  • @didierpuzenat7280
    @didierpuzenat7280 2 месяца назад

    5:38 If you want to compare energy consumption, watt is not a good measure, watt hour is.

  • @Sumbuddysumwhere
    @Sumbuddysumwhere Месяц назад

    Speed and accuracy is what matters. Screw the extra power usage because you aren't running an LLM 24/7 you are querying it for a combined 5 minutes per day at most even if you are using it for hours during your work day. Your power usage is only spiking during actual generations which is seconds long on the 4090. The only real exception is running super big slow models for long periods of time or using AI agents which currently give crap results.

  • @yerydwi
    @yerydwi Месяц назад

    Thanks for the riview 🥰🥰🥰

  • @johannesmariomeissner7262
    @johannesmariomeissner7262 2 месяца назад +1

    The test is also flawed by the fact that an LLM can't really "count" its own tokens, so when you ask for a 1000 essay, it's just going to to a best effort, but results might be wildly different. Setting a token cutoff and having all machines reach the cutoff would be much more accurate.

  • @robertoguerra5375
    @robertoguerra5375 Месяц назад +1

    Cool video :)
    What about the results? Did you like those ai generated stories?

  • @loicdupond7550
    @loicdupond7550 Месяц назад

    Now getting the m4 mini and m4 mini pros in this review is what I need 😂
    Waiting impatiently to see if a mini pro with 64gb is worth it for llms !

  • @franckleveneur676
    @franckleveneur676 Месяц назад

    I’m curious to see how it would run on Mac Studio. At $2000, it’s closer to the higher end one you shared.

  • @mk500
    @mk500 2 месяца назад +1

    I ended up with a used studio M1 Ultra with 128GB RAM. I can run any model up to 96GB RAM, and often do. It could be faster, but the important thing is I have few limitations for large-ish models and context. What really competes with this?

  • @julesnopomar
    @julesnopomar Месяц назад

    what u think about the new mini pro could be pretty good no?

  • @seeibe
    @seeibe 2 месяца назад +1

    12:00 Are you sure? Normally ollama will keep the model in memory for a few minutes. So if you do something like coding, the model should already be in VRAM for most queries.

    • @toadlguy
      @toadlguy 2 месяца назад +1

      The default is just 5 seconds, but if you increase that it might affect your cost substantially. Trade off.

  • @pascalmariany
    @pascalmariany Месяц назад

    Great! I myself test a lot. Could you make a comparison of cloud based energy consumption and the effect on our planet and local LLM?

  • @yudtpb
    @yudtpb 2 месяца назад +2

    Would like to see how lunar lake performs

  • @Mylordkaz
    @Mylordkaz 18 дней назад

    nice video thank you, now that you have some M4 mini did you run the benchmark on it to compared with the M2 from that video ?

  • @massimodileo7169
    @massimodileo7169 2 месяца назад +3

    -verbose
    please use this option, it’s easier than Schwarzenegger 2.0

    • @AZisk
      @AZisk  2 месяца назад +5

      but way less fun

  • @sarmadmohsin8444
    @sarmadmohsin8444 2 месяца назад

    Man things look good for future

  • @Nik.leonard
    @Nik.leonard 2 месяца назад

    If the model can fit in 16gb, the nVidia 4060ti/16gb is a solid performer, you should give it a try. That card can even run Codestral/Mistral Small at 4bit quantization at decent speeds (My old 3060 12gb was just a couple gigs short on vram)

  • @Artificial.Unintelligence
    @Artificial.Unintelligence Месяц назад

    Can you compare some AMD GPUs in these tests? They're significantly cheaper especially for the extra RAM. So I'm curious if the 'less performant' AMD GPUs can do the same as a 4090 or a lesser Nvidia GPU or a linear result of RAM= performance.. like a 20-24g AMD vs 16g Nvidia?
    What about using a real motherboard with full PCI-E GEN 5 and DDR5 RAM? Where is the bottleneck?
    Is there a limit or benefit to doing tons of RAM to either not bother with a GPU or to supplement a GPU? How can you use both the RAM & GPU?
    Lastly, VERY curious about the latest AMD and Intel CPUs coming that are supposed to be more power efficient and 'built for AI' 🍻

    • @AZisk
      @AZisk  27 дней назад

      thank you. i do have some amds i was planning to check out for this. not sure it will do much better than intel igpus

  • @ALCE-h7b
    @ALCE-h7b 2 месяца назад +1

    Have you thought about running such tests on the new AMD 8700 on tiny PCs? Heard that they have pretty good iGPU

  • @Techonsapevole
    @Techonsapevole 2 месяца назад +1

    cool, but where is AMD Ryzen 7 ?

  • @jumbleblue
    @jumbleblue Месяц назад

    now that would be interesting with the entry level m4 mac mini

  • @pixelbat
    @pixelbat Месяц назад

    Have you looked into Bitnet at all? It's Microsoft's new inference framework for 1 bit LLMs. People running like 70 billion parameters at home. Fun stuff.

  • @mrmerm
    @mrmerm 2 месяца назад +1

    Would be great to see AMD in the benchmarks both with CPU and external GPU.

  • @waynelau3256
    @waynelau3256 Месяц назад

    With the 3.2 models, it should be quite fun

  • @toadlguy
    @toadlguy 2 месяца назад +1

    Didn’t you add a lot of memory to the Intel Box? Was that in your cost of ownership?

    • @AZisk
      @AZisk  2 месяца назад +2

      I did, but in this case, the model I was showing wasn't using all that memory and could easily run on the 32GB that the machine came with.

    • @toadlguy
      @toadlguy 2 месяца назад +1

      @@AZisk But if you had that box, you probably wouldn't be able to resist adding 64GBs of memory 🤣