I think. I did in the last video and also in this one but it got cut out. It is the Apple M4 Pro chip with 14‑core CPU, 20‑core GPU, 16-core Neural Engine 64GB unified memory 512GB SSD storage Gigabit Ethernet Three Thunderbolt 5 ports, HDMI port, two USB‑C ports, headphone jack
What model were you using? also how big that model was in GB would play a role as well. I used two different sized 70b models in this test. One works great the other requires more ram and runs slower.
@@RyanPeterson-5053 It was about 42gb. Sure Mac was a bit faster, but I mean its regular DDR-4 and midrange laptop processor from 2021, and laptop was under $1000. I thought that apple silicon from 2024 with it's fast memory would be miles ahead. I was thinking about buying mac for this reason and now I'm confused.
What was the spec? Can't believe you didn't mention it
I think. I did in the last video and also in this one but it got cut out. It is the
Apple M4 Pro chip with 14‑core CPU, 20‑core GPU, 16-core Neural Engine
64GB unified memory
512GB SSD storage
Gigabit Ethernet
Three Thunderbolt 5 ports, HDMI port, two USB‑C ports, headphone jack
@@RyanPeterson-5053 Thank you. It's not even 12c cpu 16c gpu. Sad it was so slow :(
Why 70b run so slow? On my old Ryzen 5800 laptop with 64gb ddr-4 I had 1 token per second. M4 pro that bad or you messed something up?
What model were you using? also how big that model was in GB would play a role as well. I used two different sized 70b models in this test. One works great the other requires more ram and runs slower.
@@RyanPeterson-5053 It was about 42gb. Sure Mac was a bit faster, but I mean its regular DDR-4 and midrange laptop processor from 2021, and laptop was under $1000. I thought that apple silicon from 2024 with it's fast memory would be miles ahead. I was thinking about buying mac for this reason and now I'm confused.