The fact you open-source everything you do says a lot about your love for computer science and the community community. Much love Jeff Alex from the UK
"The fact you open-source everything you do says a lot about your love for computer science and the community community." Is there a non-community community? o.o
In my experience, open-sourcing random things is sometimes useful for other people to figure out how you did it, but it's not actually as awesome as people make it out to be. It's like, imagine if everyone put everything they did on RUclips. Sure, all the good stuff would be there, but also mountains of useless junk to filter out.
I still remember the times when there was no such concept as a "hobby grade cluster" ... before people figured out that clustering PCs could get you respectable supercomputing scores for much less $$$ than traditional supercomputers!
@@KaiHenningsen Must be along time ago we even had a guy living next to us in the late 1990s that showed me how a cluster of 4 Amigas could draw a 3d model quicker
Different people invest differently into their hobbies. But I think most hobbyists, overclockers, enthusiasts, powerusers, gamers, miners aren't going to put over $25K into a their computing box.
Ahh yes. Noctua fan and the SF600 inside an ITX build are exactly what I think of when the Raspberry Pi comes to mind. Actually no, my gaming rig comes to mind inside a Node202 but you make me want this board too despite having no use case for it.
The message in 21:22 is very important, not only in terms of physical hardware, but also in terms of buying servers in the cloud. People with money tend to get the beefiest ones they could find, but they probably could have made the servers scale up/down depending on the usage. :D This generally applies to individual website owners, e.g. IMers though.
As a HAM, it might be something to look at for Disaster Comms (the LTE setup) for a heavy duty HAM Radio command center, something like Jason KM4ACK's Build A Pi setup. If you aren't a HAM, a lot of features can still be used...
there is a nice bunch of remote listening designs with PIs around. Lets say, have 8 software decoding channels of RX in a single compact box as an Ethernet attached web GUI control. Use each of the channels for decoding e.g. AM, FM, side-band modes, CW or the modern merely automatic digital modes. Ah, and dont forget about a useable antenna, preferably at a location with low levels of any sort of noise - indeed most of it is man made. regards, Alex, DG3MMF
You built a super computer training rig, where people can learn to run super computers without the huge cost of a super computer. Colleges and Uni's will be queuing up for them.
“M1 laptop can’t run Linux yet” nice put down line for Apple’s fast laptop! I am used to hearing Chris from Explaining Computers gentle wit and so I appreciated this line from you. Thanks for making me smile :-)
Wish we'd've seen the watts the other machine used during a benchmark. And would've liked to have the performance comparison too. Even though it wasn't the point. I'm still curious! Great video!
Been looking fwd to this video literally for years, and it absolutely lived up to expectations. Great work Jeff! Can't wait to see what else you get up to with this rig
This is really cool. I'd love to own and play around with both of these builds, but honestly I'd probably pick the Turing Pi 2 to keep long term (especially considering the direction electricity prices are heading here in Europe). Would be great for a little home cluster! I think six nodes would be ideal for me though, but that might be a bit tight on a mini ITX board.
Energy efficient is future. Here electric company started 200MW wind farm last week and all of it goes to Google. And we import 10% of our electricity from Russia, scary enough, but add to that EUs highest price. oh no.
I think this is the future of computers; the computer modules and the mainboard, smaller daughter boards. In a way, this seems to make things return to the beginning of computing, like when we were all playing with Z80's and adding smaller boards, mixing boards, hybrid Frankenstein monster computers.
can we use AI to have a nas that monitors internet usage & pulls stuff so that can be used later can network be smart enough to see anyone uploading to public near your area doesn't go to main server & later distributed? sorry english is not my native language
@@thewhitefalcon8539 I mean, running 4 or 10 Raspberry Pi 1s, just cause they're laying around... technically, even the big manufacturers, like AMD, are considering using Chiplet designs to help ease current design problems. edit: come to think of it, we still do this with GPUs, Ethernet cards, and other PCIe based cards.
This was like comparing a schooner with a sloop, we can go sailing in either one of these. As a developer, your build is the better choice because anyone can test their project at home with a modest budget. Well done!
Man that is some algorithm they got there, it's almost as if Jeff and RUclips planned this and knew about this collaboration as I just stumbled upon Patrick's channel about 1.5-2 week(s) ago.
@@JeffGeerling Yeah for me though it's kind of like a dating an intimidatingly smart supermodel or owning a multi million dollar formula one racecar, I just wouldn't know what to do with them.
Really interesting for home use, just wish there would be CM4s with more memory, I don’t need alot of compute power, but need more memory, this would be really sweet if the PIs had 4x16GB or even 4x32GB memory, for running k8s nodes. Here in EU, power usage quickly get stupid expensive, this would fit well for that.
What workloads are you running that you need 64/128 gigs of RAM on a Pi? I suspect, even if those existed, you'd find the CPU and memory bandwidth on the Pi can't keep up at that point. You're probably better off looking outside the Pi family or even expanding cluster size (or multi-clustering) if your workloads can be broken down.
Pretty cool, but it's driving me a little crazy that you positioned the board with the i/o to the side. Doubt it's getting too warm, but the fan can't efficiently cool all boards facing that direction. Probably won't be an issue once you put it in a case.
Love this channel. It always has something interesting and Jeff's approach to the technology is reminiscent of my early days at Rockwell International. Keep up the good work Jeff!
Jeff has a very good point here: m1 macbooks are more power efficient comparing to pi. I've seen people justifying pi's horrible desktop experience with saving power. lol that's not true at all. It would be something if apple would one day release something like a M1-compute module, but alas that day will never come.
There is no need to think about the hearsay from others, like the irrational justifications you pointed out (which made me laugh, BTW. Thanks:) ) Let's just stick to the truth and the facts: Raspberry Pi < $100 vs. MacBook M1 > $1000. There is no need to compare Apples and Pears ... (pun intended:P hehehe). I second your thought about "Maker-Stuff" from Apple. The company would have to publish circuit diagrams and treat its customers like people and not incompetent idiots from whom they have to protect their "important secrets" (as usual nowadays, "The right to repair", LoL). That only happens when hell freezes over:) Thanks for your comment, Zhen:)
First time viewer & now subscriber. Really enjoyed the pace, production, and process. I would have loved a quick epilogue, cliff hanger, or blooper reel. XD Thanks for the great content!
Pity that even Jef likes to pretend that four RPI4 becomes a "superomputer". This channel is more about all the improbable things one CAN use a Pi for, not what makes much sense. If you want hardware with usable performance, buy used professional hardware from ebay. I got me a couple of 12 core HP DL-380 servers for about half the cost of four RPi 4. Oh, so they consume a couple of hundred watts each, but you can run real loads on them. Those 12-core servers, actually are "super computers", in that their CPU's DO share ram and resources. Then you section them up with ProxMox and play with Kub all you want. :-) The "limited budget" argument isn't particularly valid I think, given the prices of used professional hardware.
which is why clusters only make sense when you need more power than you can get from one server. Which is why small clusters are just pointless. The exception is "to learn how to program clusters" but if you are making videos about clusters and going to cluster conferences, that is not your use case.
So... lets math this out. Turing Pi 2 Mobo, $200, $10x4 Pi CM4 Adapter boards, power supply $30-$50, Case $0-$200 CM4 boards x4 $35-$85 depending on where you get them and what version you get, we'll say another $100 - $150 on the low end for SD cards / or SSDs etc. Looking at a little cluster in a box for $500 to $700. Fairly expensive but considering the learning potential and the small size and flexibility, actually rather cheap. Totally worth it for all that you can learn on it, basically a homelab in a box.
@@xaty1808 Sure, but that's not the aim here. This is more bare metal cluster, not a machine that can virtualize a cluster. It's not about the performance per $ spent. It's about the environment that you can build to learn and test clustered sytems. You could also easily buy 4 older small form factor business desktops for about $50 each and cluster those, and have the same rough environment. But it will take up far more space and draw more power than the pi cluster ever would. So it's really about where you want to spend your money.
On the PCIe, would be nice to have some kind of pcie switch onboard that lets you map peripherals to slots using the firmware, but this is a clever solution nonetheless
I read the intro on STH first, then before I got into it, I came over here to watch the two vids. How did I know Patrick would go completely nutso on his build?
Man. I’m just getting started here and both of these solutions sound like incredible solutions for clustering. I’ve got a few Jetson Nanos that I would love to put into a cluster board from Turing Pi. Cannot wait to see the final version and possibly pick one up. How did you get started in the IT industry with cluster computing? I’m getting started in the industry trying to learn different methods of balancing loads between different systems and running through GPU computation using python and C++ but I’m looking for things like your current project which seems like you will need to balance the nodes and hardware. How/what video of yours or someone else’s would recommend for learning this material from scratch?
Very nice concept and really cool product (Turing Pi). What really sucks is the fact that they release only a limited amount of them for pre-orders. I just discovered this today by watching your video and would love to buy one, but you can't order the 1st revision anymore and this one is not released yet. It's a shame.
Parallel computing with overset grids for computational fluid dynamics is a great reason for clusters. By dividing huge grids that won't fit on one node (memory wise) into much smaller subgrids each fitting on one of many nodes, very large CFD problems can be run. NASA has been doing this for decades but with much larger and much more expensive computers. This was how the flow field around the space shuttle was computed back in the '80s.
I think this 2U box can hold far more than a pair of 1U boxes which are full of risers and extenders. I f it's already greater compute density, higher power efficiency, and lower cost ... what would you gain by flattening it into a single blade?
What i'd do with the turingpi V2 is load it up with the 6 core Jetson boards, have one running plex TV recordings, and a few other things. Then on all that i can, throw a sata controller on, and use glusterFS for sudo-raid, but more like unraid with 2 large parity disks over USB. Then on all nodes(maybe not the plex node run TDARR to transcode those massive MPEG2 files, over to H265
Lucky SOB! I've been drooling over that V2 board for the last couple months as I want to use it for a Robot Operating System cluster for a robot. But between the V2 board not being out yet, and ANY RasPi right now being basically unobtanium, it'll be a while before any of us can build a setup like what you showed... #jealous #f-covid
Very nice content, thanks for taking the time to inform us! However, looking at the technology; I really wonder what the benefits would be. No doubt that board + 4 pi's and so fort, costs about the same as a ryzen 7 mainboard and a cpu with 8 cores. I don't see the advantage. At all. The pi is limited in bus width (pci express lanes), not really expandable easily, and is non-standaard ARM hardware. Also, that ryzen setup woud totally trash the pi performance wise. So I don't see any advantage or reason to want to do this. If you want to run a cluster so bad, you could also run VM's on a normal PC setup. And they would still easily outperform the pi.
21:11 it can be used as a cheaper diy network server that runs on pie instead of a more expensive pc. pushing low end hardware is fun for hobbyists and is why the pie exists in the first place. this could also be for those who don't want to have a cloud based solution. a cheap chinese mobile phone has more power, but you don't see that being used anywhere for these things.
I dunno if I should be triggered by the fact you could get your hands on 4 CM. But looking forward to videos on what the cluster can be used for. Was surprised there was no HDMI switch or KVM onboard, but I suppose SSH will do the job easily enough
Yeah; it could've been possible but to keep the board cost down, they had to jam almost everything up top, and there just isn't space for the extra bits to make built-in KVM work. But it does have remote management, I just haven't gotten all the firmware yet for that. Will touch on it in a future video!
i love to watch video like this. seeing people commenting also make me feels like "wow you guys are awesome too" And at the end of the video i realize that i understand nothing. lol
The SF600 Platinum was the first thing I spotted on your desk. Rule 1 of fight club is to NEVER skimp and save on the PSU and these PSUs are quality. Recently purchased the SF750 and am very pleased
Did I miss the rundown of the cost of each setup in the video / article, somehow? In fact, a complete summary table with side by side costs and specs (nb cores, frequency, bandwidth, consumption..) would be pretty useful to get a more precise idea of how these 2 setups match and to figure out on which end of the spectrum my needs would rather land.
Thanks for the video @JeffGeerling It inspired me to order my own Turing Pi II - I am now waiting for shipping. Have you tried the ClockworkPi Core A-06 module in the Turing Pi? I've been waiting on backorder of CM4 for over a year now and looks like they won't be coming anytime soon so I may have to opt for the Jetson nodes instead unless I can find an alternative.
lol. The efficiency is why I have a rpi4 as the controller for my server network. It handles a DNS server, web management interface for all the "real" servers, and a reverse NGINX proxy that handles of couple of dozen backends, and actually sees a fair amount of traffic. I love having it also for stability, as I don't just host for myself. I used to have all of this stuff on one of the "real" servers, but anytime I had to deal with issues of any nature, the stuff went offline. The rpi... just sits there and works, as it's servs a niche amount of functions.
Just got mine: - usb pinouts are fixed - no need to cut a pin to connect a front panel usb - both RJ45 have LEDs I didn't notice any other changes so far. I was extremely lucky to get 5 cm4 lite with 8 gb of RAM a few weeks ago :)
That was in St. Louis? I wished I had known. I would have went. Also, "The Arch" is part of the Jefferson National Expansion Memorial. Which includes part of the down town. It actually extends pretty far into the downtown area including several new monuments and buildings. Several Old structures too. The old courthouse across the street from the arch is where the Dred Scott case was tried. Another cool spot to check out is the Cathedral of St. Louis which has a lot of mosaic art.
Once again hometown boy knocks it out of the park! Just pulled up your Ansible book as well Jeff. It's getting ordered. I have to ask though if you can share, I looked on the site and saw nothing. Do they have a ball park fig on what the price of the Turing pi may be?
The Lichee Cluster 4A is supposedly on sale next week ("Powerful Cluster for Native RISC-V Compilation" in a 17 x 17 cm Mini ITX form factor). Do you have one to review or will you get one to show us?
Super cool! Very jealous you have the Turing Pi 2! Super fun meeting up and doing this.
There’s something that makes me so happy when I find out RUclipsrs I like also like each other (my wording is bad, but you get what i mean :) )
I'd like to know the comparison of performance per $ between those systems.
VIEW * NICE AWES0ME C00L KEEP_IT_UP ! INDEED ....📳💻💻💻💻🖥🖥🖥🖥🖥⌨⌨⌨⌨⌨🖱🖱🖱🖱💽🏆🥓🥓🥓🥓🥓🏎🏎🏎🏎🏎💨💨💨💨💨💨💨
Love the collaboration. Thanks for bringing this all together gents.
But is a test bed really a case? 😉
The fact you open-source everything you do says a lot about your love for computer science and the community community. Much love Jeff Alex from the UK
On god….
"The fact you open-source everything you do says a lot about your love for computer science and the community community." Is there a non-community community? o.o
@@chrisakaschulbus4903 yes... Join the Gun community lol its nothing but calling other people poor.
In my experience, open-sourcing random things is sometimes useful for other people to figure out how you did it, but it's not actually as awesome as people make it out to be. It's like, imagine if everyone put everything they did on RUclips. Sure, all the good stuff would be there, but also mountains of useless junk to filter out.
Wow. Patric knocking it out of the park with compute power. It’s really cool to see server vs hobby grade cluster.
sadly Patric did not run any benchmark
eeeh, thats more like baby server vs hobby grade haha.
I still remember the times when there was no such concept as a "hobby grade cluster" ... before people figured out that clustering PCs could get you respectable supercomputing scores for much less $$$ than traditional supercomputers!
@@KaiHenningsen Must be along time ago we even had a guy living next to us in the late 1990s that showed me how a cluster of 4 Amigas could draw a 3d model quicker
Different people invest differently into their hobbies. But I think most hobbyists, overclockers, enthusiasts, powerusers, gamers, miners aren't going to put over $25K into a their computing box.
Ahh yes.
Noctua fan and the SF600 inside an ITX build are exactly what I think of when the Raspberry Pi comes to mind.
Actually no, my gaming rig comes to mind inside a Node202 but you make me want this board too despite having no use case for it.
The message in 21:22 is very important, not only in terms of physical hardware, but also in terms of buying servers in the cloud. People with money tend to get the beefiest ones they could find, but they probably could have made the servers scale up/down depending on the usage. :D This generally applies to individual website owners, e.g. IMers though.
As a HAM, it might be something to look at for Disaster Comms (the LTE setup) for a heavy duty HAM Radio command center, something like Jason KM4ACK's Build A Pi setup. If you aren't a HAM, a lot of features can still be used...
there is a nice bunch of remote listening designs with PIs around.
Lets say, have 8 software decoding channels of RX in a single compact box as an Ethernet attached web GUI control.
Use each of the channels for decoding e.g. AM, FM, side-band modes, CW or the modern merely automatic digital modes.
Ah, and dont forget about a useable antenna, preferably at a location with low levels of any sort of noise - indeed most of it is man made.
regards, Alex, DG3MMF
Me: eats HAM
Disaster comms: *confused screaming*
LTE for disaster comms? What? If the cellphone network is still up, it's not exactly a disaster where you'd need to use ham radio, is it?
You built a super computer training rig, where people can learn to run super computers without the huge cost of a super computer. Colleges and Uni's will be queuing up for them.
“M1 laptop can’t run Linux yet” nice put down line for Apple’s fast laptop! I am used to hearing Chris from Explaining Computers gentle wit and so I appreciated this line from you. Thanks for making me smile :-)
Love Chris' videos, he's a bit of a source of inspiration too ;)
It walks, for running it will be more dificult
This weeks update of M1 can easily do it.
@@szymex8341 yes it do. I am Manager of Software grp in Apple
@@szymex8341 do you know hindi as i am Indian and i know it well.
Wish we'd've seen the watts the other machine used during a benchmark. And would've liked to have the performance comparison too. Even though it wasn't the point. I'm still curious! Great video!
Also a gigaflops rating means nothing without how large of numbers its working with. FP16, FP32, and FP64 will be very different speeds.
Been looking fwd to this video literally for years, and it absolutely lived up to expectations. Great work Jeff!
Can't wait to see what else you get up to with this rig
Your build I could mostly get my head around, but Patrick just blows my mind. Nice one Jeff!
OOOH! It comes with the ATX power connector! Yay!
Yes but everyone noticed in post already. Anyway yay now we can use a pc psu
This is really cool. I'd love to own and play around with both of these builds, but honestly I'd probably pick the Turing Pi 2 to keep long term (especially considering the direction electricity prices are heading here in Europe). Would be great for a little home cluster!
I think six nodes would be ideal for me though, but that might be a bit tight on a mini ITX board.
You can put seven on a mini-ITX Pine64 Clusterboard.
Energy efficient is future. Here electric company started 200MW wind farm last week and all of it goes to Google. And we import 10% of our electricity from Russia, scary enough, but add to that EUs highest price. oh no.
Low end GPUs are much more efficient, like on the order of 10-30x more gflops per watt.
I think this is the future of computers; the computer modules and the mainboard, smaller daughter boards. In a way, this seems to make things return to the beginning of computing, like when we were all playing with Z80's and adding smaller boards, mixing boards, hybrid Frankenstein monster computers.
c128 lol
a z80 and a 6502 on the same computer, madness!
No way. Economy of scale is economy of scale. Swappable parts yes - multiple nodes no.
can we use AI to have a nas that monitors internet usage & pulls stuff so that can be used later
can network be smart enough to see anyone uploading to public near your area doesn't go to main server & later distributed?
sorry english is not my native language
@@thewhitefalcon8539 I mean, running 4 or 10 Raspberry Pi 1s, just cause they're laying around... technically, even the big manufacturers, like AMD, are considering using Chiplet designs to help ease current design problems.
edit: come to think of it, we still do this with GPUs, Ethernet cards, and other PCIe based cards.
I'd love to see how these could be used, and ways of managing them in a friendlier way.
I'll be exploring that in future videos!
Ansible and related toolings will do you a great favor.
You might rather lack of an application case for them. ;-)
You node it's serious when it has an ATX power connector...
But seriously, this board ticks many boxes people have been asking for
This was like comparing a schooner with a sloop, we can go sailing in either one of these. As a developer, your build is the better choice because anyone can test their project at home with a modest budget. Well done!
Idk man I can basically do exactly the same thing with far fewer parts in docker containers.
Man that is some algorithm they got there, it's almost as if Jeff and RUclips planned this and knew about this collaboration as I just stumbled upon Patrick's channel about 1.5-2 week(s) ago.
I love dreaming of the things I could do with STH's gear 😄
@@JeffGeerling Yeah for me though it's kind of like a dating an intimidatingly smart supermodel or owning a multi million dollar formula one racecar, I just wouldn't know what to do with them.
Jeff, I love it where you're super honest at 11.48 where you admit booting it already 😂
Great video (I'm 2/3 of the way through)
This is the first video of yours I've seen, but I adore your style and presentation. Subscribed!
It's a comparison like a dart to a space ship, yet both can fly. Thanks for the great video.
I've been waiting for this build for years, I am super happy and proud to finally see it complete!! Thank you!
Really interesting for home use, just wish there would be CM4s with more memory, I don’t need alot of compute power, but need more memory, this would be really sweet if the PIs had 4x16GB or even 4x32GB memory, for running k8s nodes.
Here in EU, power usage quickly get stupid expensive, this would fit well for that.
What workloads are you running that you need 64/128 gigs of RAM on a Pi? I suspect, even if those existed, you'd find the CPU and memory bandwidth on the Pi can't keep up at that point. You're probably better off looking outside the Pi family or even expanding cluster size (or multi-clustering) if your workloads can be broken down.
Here is a tip: used resedental solar panels are kinda cheap
Loved the geeky conversation between Patrick and you. Priceless.
Pretty cool, but it's driving me a little crazy that you positioned the board with the i/o to the side. Doubt it's getting too warm, but the fan can't efficiently cool all boards facing that direction. Probably won't be an issue once you put it in a case.
Love this channel. It always has something interesting and Jeff's approach to the technology is reminiscent of my early days at Rockwell International. Keep up the good work Jeff!
Jeff has a very good point here: m1 macbooks are more power efficient comparing to pi. I've seen people justifying pi's horrible desktop experience with saving power. lol that's not true at all. It would be something if apple would one day release something like a M1-compute module, but alas that day will never come.
There is no need to think about the hearsay from others, like the irrational justifications you pointed out (which made me laugh, BTW. Thanks:) )
Let's just stick to the truth and the facts: Raspberry Pi < $100 vs. MacBook M1 > $1000. There is no need to compare Apples and Pears ... (pun intended:P hehehe). I second your thought about "Maker-Stuff" from Apple. The company would have to publish circuit diagrams and treat its customers like people and not incompetent idiots from whom they have to protect their "important secrets" (as usual nowadays, "The right to repair", LoL). That only happens when hell freezes over:) Thanks for your comment, Zhen:)
First time viewer & now subscriber. Really enjoyed the pace, production, and process. I would have loved a quick epilogue, cliff hanger, or blooper reel. XD Thanks for the great content!
Both clusters can run the exact same containers. Keep that in mind when comparing them.
So nice of you to be sharing this content thank you!
"SATA, not SATA" is something that belongs on a T-shirt
Jeff: mini itx board
Patrick: so anyway here’s my threadripper
Pity that even Jef likes to pretend that four RPI4 becomes a "superomputer".
This channel is more about all the improbable things one CAN use a Pi for, not what makes much sense.
If you want hardware with usable performance, buy used professional hardware from ebay. I got me a couple of 12 core HP DL-380 servers for about half the cost of four RPi 4. Oh, so they consume a couple of hundred watts each, but you can run real loads on them. Those 12-core servers, actually are "super computers", in that their CPU's DO share ram and resources. Then you section them up with ProxMox and play with Kub all you want. :-)
The "limited budget" argument isn't particularly valid I think, given the prices of used professional hardware.
Don't just build overpowered temporary setups. Show use cases. Show permanent builds that you (or someone else) will use for something real.
anything that runs on kubernetes can run here
@@tianlechen but it could also run on one normal server with 4 times the power
which is why clusters only make sense when you need more power than you can get from one server. Which is why small clusters are just pointless. The exception is "to learn how to program clusters" but if you are making videos about clusters and going to cluster conferences, that is not your use case.
@@thewhitefalcon8539 Power consumption?
@@sceerane8662 no, compute power
I like these outtakes way more than your other videos :)
This is awesome seeing two of the homeserver kings.
Jeff watching you GRIN like a super excited made me smile and made me wanna buy one of these even MORE lol
So... lets math this out. Turing Pi 2 Mobo, $200, $10x4 Pi CM4 Adapter boards, power supply $30-$50, Case $0-$200 CM4 boards x4 $35-$85 depending on where you get them and what version you get, we'll say another $100 - $150 on the low end for SD cards / or SSDs etc. Looking at a little cluster in a box for $500 to $700. Fairly expensive but considering the learning potential and the small size and flexibility, actually rather cheap. Totally worth it for all that you can learn on it, basically a homelab in a box.
you're spot on with the estimate!
For less than € 200 you can buy a chinese motherboard with 2 intel Xeon E5 processors = 24 core each and 16 Gb memory…
@@xaty1808 Sure, but that's not the aim here. This is more bare metal cluster, not a machine that can virtualize a cluster. It's not about the performance per $ spent. It's about the environment that you can build to learn and test clustered sytems. You could also easily buy 4 older small form factor business desktops for about $50 each and cluster those, and have the same rough environment. But it will take up far more space and draw more power than the pi cluster ever would. So it's really about where you want to spend your money.
Hey, nice project. I like this stuff
Could you give us also a link for the Adapter-Board for connect CM4 with the Mainboard?
Chris
On the PCIe, would be nice to have some kind of pcie switch onboard that lets you map peripherals to slots using the firmware, but this is a clever solution nonetheless
I read the intro on STH first, then before I got into it, I came over here to watch the two vids. How did I know Patrick would go completely nutso on his build?
Man. I’m just getting started here and both of these solutions sound like incredible solutions for clustering. I’ve got a few Jetson Nanos that I would love to put into a cluster board from Turing Pi. Cannot wait to see the final version and possibly pick one up. How did you get started in the IT industry with cluster computing? I’m getting started in the industry trying to learn different methods of balancing loads between different systems and running through GPU computation using python and C++ but I’m looking for things like your current project which seems like you will need to balance the nodes and hardware. How/what video of yours or someone else’s would recommend for learning this material from scratch?
You guys are one of the reasons why I can’t get any Pi component 😢. Good video thanks for sharing.
Real German: "Relaxen und sich die Blinklichter anschauen" :D
Very nice concept and really cool product (Turing Pi). What really sucks is the fact that they release only a limited amount of them for pre-orders.
I just discovered this today by watching your video and would love to buy one, but you can't order the 1st revision anymore and this one is not released yet. It's a shame.
I didn't know you could configure wifi and ssh from pi imager, that's really nice to know
Yeah, saves a lot of time :)
@@JeffGeerling and what is the 'Open Sesame' to access that option in app??
@@VaibhavKurde ctrl-shift-x or cmd-shift-x depending on your os/keyboard
Fascinating. But what do you _use_ something like this for?
To be fair, the Bluefield2 cards also have a 1GBE interface each that's internally directly connected to the Arm side.
Great refresher Jeff!
So Jeff , what is this thing good for though? Does it make a really awesome nas?? I'm just confused on why would you want clustering??
That's a good question! Check out my video on the topic here: ruclips.net/video/8zXG4ySy1m8/видео.html
Parallel computing with overset grids for computational fluid dynamics is a great reason for clusters. By dividing huge grids that won't fit on one node (memory wise) into much smaller subgrids each fitting on one of many nodes, very large CFD problems can be run. NASA has been doing this for decades but with much larger and much more expensive computers. This was how the flow field around the space shuttle was computed back in the '80s.
I've been waiting for this thing since last year, jealous af, thanks for the demo/review!
4:56 I'd love to see a video testing various SODIMM riser boards/cables with the goal of seeing if we could get this thing down to a 1U form factor.
I think this 2U box can hold far more than a pair of 1U boxes which are full of risers and extenders.
I
f it's already greater compute density, higher power efficiency, and lower cost ... what would you gain by flattening it into a single blade?
@@pwnmeisterage I was mostly thinking about the remaining space in my rack than I was computer density.
YES JEFF YESS!! I haven't watched yet but I've been waiting for this one for a while!
So what would be real world use case for any of those systems?
What would one compute and store on any of those?
What i'd do with the turingpi V2 is load it up with the 6 core Jetson boards, have one running plex TV recordings, and a few other things.
Then on all that i can, throw a sata controller on, and use glusterFS for sudo-raid, but more like unraid with 2 large parity disks over USB. Then on all nodes(maybe not the plex node run TDARR to transcode those massive MPEG2 files, over to H265
Lucky SOB! I've been drooling over that V2 board for the last couple months as I want to use it for a Robot Operating System cluster for a robot. But between the V2 board not being out yet, and ANY RasPi right now being basically unobtanium, it'll be a while before any of us can build a setup like what you showed... #jealous #f-covid
Great video Jeff!
Very nice content, thanks for taking the time to inform us!
However, looking at the technology; I really wonder what the benefits would be. No doubt that board + 4 pi's and so fort, costs about the same as a ryzen 7 mainboard and a cpu with 8 cores.
I don't see the advantage. At all. The pi is limited in bus width (pci express lanes), not really expandable easily, and is non-standaard ARM hardware.
Also, that ryzen setup woud totally trash the pi performance wise. So I don't see any advantage or reason to want to do this. If you want to run a cluster so bad, you could also run VM's on a normal PC setup. And they would still easily outperform the pi.
21:11 it can be used as a cheaper diy network server that runs on pie instead of a more expensive pc. pushing low end hardware is fun for hobbyists and is why the pie exists in the first place. this could also be for those who don't want to have a cloud based solution. a cheap chinese mobile phone has more power, but you don't see that being used anywhere for these things.
@@VD-cc4hx thats exactly my point. Setup like this, it's NOT cheaper.
I dunno if I should be triggered by the fact you could get your hands on 4 CM. But looking forward to videos on what the cluster can be used for. Was surprised there was no HDMI switch or KVM onboard, but I suppose SSH will do the job easily enough
Yeah; it could've been possible but to keep the board cost down, they had to jam almost everything up top, and there just isn't space for the extra bits to make built-in KVM work. But it does have remote management, I just haven't gotten all the firmware yet for that. Will touch on it in a future video!
Jeff, you've got that smirk on again that means you're up to no good .... ! ;) Hehe. EDIT: It's not a smirk, it's a "cunning smile".
I've been so excited to see the new board! The first turing pi board is what lead me to Jeff Geerling!
I am confused though on fan placement considering it can be screwed on any side in 2 positions each side
Nice I'm so glad you are doing this with the pi
I am amused that the ARM-powered Pi needs an ARM CPU as a controller. ARM really is flexible.
It's ARMs all the way down!
@@JeffGeerling Waiting for someone to call the 8 slot cluster board the Octopus.
@@JeffGeerling Yeah, since I'm pretty sure there are also ARM controller chips inside the microSD cards!
My dream have be updated, I love ITX boards. Thanks for the video
Now i want to see you build a cluster with Jetson Nano and run some tensorflow training.
Love this build platform, makes perfect for build a case around it... or adding some 19" rack mounts and rack mounting it...
I accidentally read it as turning pi. Was gonna say mmmmm....turned pi...
yes! ive been excited for this all week!
can it run crysis?
i love to watch video like this.
seeing people commenting also make me feels like "wow you guys are awesome too"
And at the end of the video i realize that i understand nothing. lol
It's SATA and not SATA.
Is it sayta or sah tah
The SF600 Platinum was the first thing I spotted on your desk. Rule 1 of fight club is to NEVER skimp and save on the PSU and these PSUs are quality. Recently purchased the SF750 and am very pleased
Jeff, great build. Sorry to have missed you at SC21!
Idk what the gel is happening in this video but it looks cool enough for me to try and learn about cluster computing!
12:47 I think what you mean was "Blinklichter: relaxe und schau den Blinklichter zu"
Great video! I love both channels!
"Relaxen und watchen das Blinkenlichten" 😂 Actually not bad, greetings from Germany! 😊👍
12:49 "Entspannen und dem Blinklicht zuschauen" haha
I would really love a link to the sodimm board you used. Seems the only thing missing in the description.
This reminds me of the days that I was building a Beowulf cluster with 386 computers, had to boot them with a floppy one by one :)
Jeff: smol cluster
Patrick: **RIP AND TEAR (the threads) UNTIL ITS DONE**
Love the fact that you know your stuff.
Nice ❤ this is definitely a step in the right direction
LOL 17:18 you've just been BASIC'd by Patrick; this is pretty much that chad meme right here.
Did I miss the rundown of the cost of each setup in the video / article, somehow? In fact, a complete summary table with side by side costs and specs (nb cores, frequency, bandwidth, consumption..) would be pretty useful to get a more precise idea of how these 2 setups match and to figure out on which end of the spectrum my needs would rather land.
Best collab in the history of servers
PIs in SO-DIMM slots? I'm SO-DIMM excited!!!
ha! I can't imagine Patrick building anything 'tiny' ;) great video!!!
Ok, So, Patrick's build made my jaw hang for the entire time he was talking about it and minutes after as well....Omg....
this is sooo cool, thank you for makeing this video :)
Thanks for the video @JeffGeerling
It inspired me to order my own Turing Pi II - I am now waiting for shipping.
Have you tried the ClockworkPi Core A-06 module in the Turing Pi? I've been waiting on backorder of CM4 for over a year now and looks like they won't be coming anytime soon so I may have to opt for the Jetson nodes instead unless I can find an alternative.
lol. The efficiency is why I have a rpi4 as the controller for my server network. It handles a DNS server, web management interface for all the "real" servers, and a reverse NGINX proxy that handles of couple of dozen backends, and actually sees a fair amount of traffic. I love having it also for stability, as I don't just host for myself. I used to have all of this stuff on one of the "real" servers, but anytime I had to deal with issues of any nature, the stuff went offline. The rpi... just sits there and works, as it's servs a niche amount of functions.
"Blinkenlights" lol. I too love blinkenlights.
You say "sayta", I say "sarta". You say "potayta", I say "potarta". Thanks for the video!
Just got mine:
- usb pinouts are fixed - no need to cut a pin to connect a front panel usb
- both RJ45 have LEDs
I didn't notice any other changes so far.
I was extremely lucky to get 5 cm4 lite with 8 gb of RAM a few weeks ago :)
That was in St. Louis? I wished I had known. I would have went. Also, "The Arch" is part of the Jefferson National Expansion Memorial. Which includes part of the down town. It actually extends pretty far into the downtown area including several new monuments and buildings. Several Old structures too. The old courthouse across the street from the arch is where the Dred Scott case was tried. Another cool spot to check out is the Cathedral of St. Louis which has a lot of mosaic art.
Nice little project Jeff. So the long and sort of this project, you got yourself a hi tech Xmas tree
Once again hometown boy knocks it out of the park! Just pulled up your Ansible book as well Jeff. It's getting ordered. I have to ask though if you can share, I looked on the site and saw nothing. Do they have a ball park fig on what the price of the Turing pi may be?
About 200 for the board, and 10 each for CM4 adapters.
POV: U just stumbled upon this, its 1 AM u don't even know what a Turing Pi is but your hooked for no reason
The Lichee Cluster 4A is supposedly on sale next week ("Powerful Cluster for Native RISC-V Compilation" in a 17 x 17 cm Mini ITX form factor). Do you have one to review or will you get one to show us?
Go crazy with every cluster!