World's Largest Raspberry Pi Cluster

Поделиться
HTML-код
  • Опубликовано: 13 мар 2020
  • Building the World’s Largest Raspberry Pi Cluster #java #linux #RaspberryPi
    Full Article: bit.ly/33g8BVE
  • НаукаНаука

Комментарии • 1,4 тыс.

  • @undead890
    @undead890 4 года назад +5705

    I'm sorry but if you are gonna make a Pi Supercomputer and you are using over 1,000 Raspberry Pis, the only acceptable configuration is 3,141 Raspberry Pis.

    • @jaye1967
      @jaye1967 4 года назад +98

      Does that mean that the next iteration should have 31,416 Raspberry Pis.

    • @Gamleprofil
      @Gamleprofil 4 года назад +91

      3,142 would be more reasonable as a 5 comes after 1

    • @puellanivis
      @puellanivis 4 года назад +9

      @@Gamleprofil Not just a 5, but a 9. If it were only a 5 after the 1, the better way to round is round-towards-even or round-towards-odd.

    • @sergemoskalyuk5368
      @sergemoskalyuk5368 4 года назад +8

      noooooooo. according to last research it can be 31415926

    • @USebaB
      @USebaB 4 года назад +3

      Raspberry Square-pi?

  • @bluegizmo1983
    @bluegizmo1983 4 года назад +3747

    Now I know why the Pi was sold out when I wanted one!

    • @kconkin4900
      @kconkin4900 4 года назад +52

      This is why,... I couldn't even find one

    • @brandonz404
      @brandonz404 4 года назад +30

      Came here to say this. I just wanted a pi of my own:(

    • @plansandbag3015
      @plansandbag3015 4 года назад +43

      I don't understand why they don't use the pi module they were made to do stuff like this

    • @bobbytmp1322
      @bobbytmp1322 4 года назад +20

      More demand for this stuff. I understand that they bought a significant amount. But It is only a positive for the pi market. Supply will catch up with demand

    • @monke3043
      @monke3043 4 года назад +2

      😂

  • @StaszekAlcatraz
    @StaszekAlcatraz 4 года назад +309

    Two words: sound normalization

    • @heyhoe168
      @heyhoe168 3 года назад

      this cluster is too loud anyway.

    • @aerosoapbreeze264
      @aerosoapbreeze264 3 года назад +4

      Pretty amazing this isn't the top comment, the video department must be deaf!

    • @bpawnz69
      @bpawnz69 3 года назад +7

      No music at all would be even better!

    • @Dgeigerd
      @Dgeigerd 3 года назад +3

      thanks! when he is speaking the music is too loud and when he is not speaking the music is way too loud.

    • @BesmirZanaj
      @BesmirZanaj 5 месяцев назад

      Sorry what?

  • @TheCodeTherapy
    @TheCodeTherapy 4 года назад +1306

    I see A LOT of comments like "but you could achieve way better performance using a single PC or server, or this, or that". If you have students graduating from any university, and those students will follow a career path on distributed computing, they need a safe and sane environment do run experiments regarding their software development. You can't graduate and have access to a bare-metal super-computer that costs 12 million US dollars to start doing research or tinkering with your first development experiences. So yes, you can achieve better performance with less investment, but no, you can't use those same suggestions for this purpose (to enable recently graduated researchers that must gain experience working with clusters).

    • @dooterino
      @dooterino 3 года назад +123

      A locally run bare-metal server could easily spin up a toy cluster in containers or VMs for this very purpose, and wouldn't even come close to approaching $12mil. Hell, a refurbed $500-$1000 blade would be sufficient.

    • @joschahenningsen5204
      @joschahenningsen5204 3 года назад +54

      virtualisation.

    • @ricardoricardo3232
      @ricardoricardo3232 3 года назад +13

      Well the only reason I see this as being useful is if you have a need for a lot and I mean a lot of virtual machines. Or want to maybe rent out virtual machines to people for a monthly price.
      Plus they don't pull a lot of power so way better for that too.
      Also a core is still a core. And I know that one core doesn't equal a core from better cpus but a core is still a core!!!
      I would love to have a big as server rack full of these pi's for my virtual machine needs. 😂🤣
      Sever galore! 😂🤣

    • @dooterino
      @dooterino 3 года назад +6

      @Knobcore Good compute blades will still leave these Pis in the dust even on highly distributed tasks, the real issue you might run into is memory and IO bandwidth limitations if you spin up a massive number of VMs, but Pis aren't great on either of those fronts either.

    • @mikej9062
      @mikej9062 3 года назад +10

      You actually only need 2-4 nodes in order to learn about distributed computing. What benefit do you seek from using several thousand nodes over just, say, 4 or 8?

  • @WedgeStratos
    @WedgeStratos 4 года назад +756

    No wonder the Raspberry Pi has been sold out.

    • @CrArC
      @CrArC 4 года назад +11

      Yep. A Pi is dramatically cheaper than many solutions that came before it; they're very popular in lots of industries. My company uses them in some of our own products; they were 10x cheaper than the alternatives and they work great.

    • @joefederico1501
      @joefederico1501 4 года назад +5

      these are raspberry pi 3b+ not the 4 which is out of stock

    • @elofos0815
      @elofos0815 3 года назад

      @@joefederico1501 maybee the next Super PI 4 Cluster?

  • @Knee-Lew
    @Knee-Lew 4 года назад +352

    2:50 Note says: "Do not touch these experiments in process, or you will die."
    * he touches anyway *

    • @SirLithen
      @SirLithen 4 года назад +11

      Guess he wanted to die

    • @TheYouTubeCuber888
      @TheYouTubeCuber888 4 года назад +10

      I'm pretty sure he will die eventually (hopefully after a long life). It did not say he will die the moment he touches it

    • @HowardStory
      @HowardStory 4 года назад +17

      Funny I thought to myself he works for Oracle He's already dead inside

    • @johngeverett
      @johngeverett 3 года назад

      I noticed that! Glad I'm not the only one!

    • @Toxinomist
      @Toxinomist 3 года назад

      This is why its a short video, with no explanation on WHY?

  • @BlackbeardedPirate
    @BlackbeardedPirate 4 года назад +781

    Oracle running on pi Cluster. No wonder it’s slow and expensive 😆

    • @moritzbecker131
      @moritzbecker131 4 года назад +6

      Oracle Linux is just a variant of Red HAt Linux

    • @elijahking7309
      @elijahking7309 4 года назад +28

      Anton Luka Šijanec r/wosh!!11 epic like for free ipad

    • @sparcx86channel42
      @sparcx86channel42 4 года назад +9

      very slow expensive, vendor locking and with shady schemes
      pass

    • @sparcx86channel42
      @sparcx86channel42 4 года назад +5

      @@moritzbecker131 with tricky contract stuff inside of it...

    • @quisqueyanguy120
      @quisqueyanguy120 4 года назад +1

      Is not really expensive

  • @lossylossnitzer2047
    @lossylossnitzer2047 3 года назад +57

    I wonder how Oracle priced this RAC cluster - Per core or Processor - Here comes the Oracle licence audit Police - You owe us 1 Biilllllllllion dollars

    • @pspicer777
      @pspicer777 3 года назад

      Been there. Done that. Never again!

    • @paulmichaelfreedman8334
      @paulmichaelfreedman8334 3 года назад

      @@AnIdiotAboard_ Nearly all software companies are eventually bought up by larger companies just to hammer down on software licensing and leech the customers.
      Anyone remember the SCO soap from 15 years ago?
      The only thing I ever use from Oracle is their free Virtualbox.

  • @bcn23
    @bcn23 4 года назад +254

    " Nooo, we forgot to add a heatsink to each
    Pi .. we have to disassemble them all to place it ..
    "

    • @archivushka
      @archivushka 4 года назад +3

      But the construction is modular

    • @PhilBusby
      @PhilBusby 4 года назад +14

      I saw that as you were building. Perhaps it would be better to plan, design, test theory, prototype and build rather than racing off like a sixth-form project.

    • @bvashisht9283
      @bvashisht9283 3 года назад

      Heat sinks are not very effective

    • @hansolo631
      @hansolo631 2 года назад

      @@bvashisht9283 What? They are incredibly effective. Literally a mandatory piece of equipment on all vaguely powerful processors.

  • @Pertev777
    @Pertev777 4 года назад +30

    Love how the music is loud and his voice very quite.

  • @thefatmoop
    @thefatmoop 4 года назад +152

    Ah... oracle Brings me back to the days when a few of our engineers chose oracle for a 500+million$ critical system. Those were dark days. We now use free open source sw and never looked back

    • @sefirotsama
      @sefirotsama 3 года назад +2

      how is it going on the support with OSS?

    • @thorleifthunaraz9802
      @thorleifthunaraz9802 3 года назад +15

      @@sefirotsama The source code is the best documentation you can have!

    • @Fiyawerx
      @Fiyawerx 2 года назад +3

      @@sefirotsama plenty of ways to get support for enterprise grade oss

  • @ThePapanoob
    @ThePapanoob 4 года назад +68

    WOOOOW imagine how many instances of Attlassian software they could run :O
    that must be atleast half of an JIRA instance

  • @dimitris470
    @dimitris470 3 года назад +31

    Missed opportunity to make them 1024 and name it Kilo Pi. With the size measured in KPs :)

  • @madyogi6164
    @madyogi6164 4 года назад +21

    With all that wiring involved, there's more data in the cables than on the devices themselves.... ;)
    Cool to watch for sure!

  • @questwalkerko
    @questwalkerko 4 года назад +66

    Ah, they're oracle.
    Thats how that got all that money.

    • @vaishnav3735
      @vaishnav3735 3 года назад +1

      Hello, iam new to pi and linux etc... I see a lot of people commenting this.... Can you explain pls

    • @ScienceAlliance
      @ScienceAlliance 3 года назад +1

      Oracle make software like browser, Java stuff Idk just everything they can tbh

  • @Gamleprofil
    @Gamleprofil 4 года назад +553

    Raspberry pi foundation: lets make an affordabke sbc for people to learn and sell without profit!
    These guys: lets buy them out of stock so none else gets!

    • @friedrich1277
      @friedrich1277 4 года назад +81

      Next step: Oracle buys the Raspbian Foundation and sues everyone who uses a Pi

    • @zvpunry1971
      @zvpunry1971 4 года назад +13

      Or the number π because the thought they had patented it too...

    • @dmytroi5456
      @dmytroi5456 4 года назад +3

      Without profit? That's why it costs more then more powerful SBCs?

    • @universaleliteinc.6554
      @universaleliteinc.6554 4 года назад +2

      what a shitty thing to do

    • @sparcx86channel42
      @sparcx86channel42 4 года назад +3

      @@universaleliteinc.6554 they are doing this since long Time and are used to do that

  • @infinitelink
    @infinitelink 4 года назад +41

    Left Hemisphere: But... WHY!?
    Right hemisphere: SHUT IT, LEFT! AWESOME!

    • @DemonMage
      @DemonMage 4 года назад +2

      No no, left brain is right: why?
      Also: angry because I want about 5-10 of those. Gimme.

  • @LimbaZero
    @LimbaZero 4 года назад +8

    how was rpi cooling working? didn't see that you put walls to cabinet to get airflow through rpis

  • @FreedomAirguns
    @FreedomAirguns 4 года назад +17

    "Let's jut pretend it worked, eventually they'll forget about it"
    XD

  • @Alan.livingston
    @Alan.livingston 4 года назад +38

    Something like this is a great way to test code intended to be used on full scale super computers at a tiny fraction the cost of tying compute time on the real system.

    • @akkudakkupl
      @akkudakkupl 3 года назад +2

      No, then you use a single $1000 blade with VM's on it.

    • @Alan.livingston
      @Alan.livingston 3 года назад +1

      @@akkudakkupl VM's are nice and all but I can't imagine it fully replicates the exact experience of running a real bare metal cluster on real switching with real cables, real nic's, etc. Surely there has to be some nuance in that. Besides, this just plain out looks more fun.

    • @jczeigler
      @jczeigler 3 года назад +1

      The most expensive part of testing on modern supercomputers is staff time.

    • @ChristopherGray00
      @ChristopherGray00 Год назад

      @@Alan.livingston VMs run software practically identically to real bare metal

    • @Alan.livingston
      @Alan.livingston Год назад

      @@ChristopherGray00 they do for sure, but I think the point I was going for is the physical dimension of it. You have to plug a cables in and some fail, some identical machines return slower for no apparent reason, whole nodes will just crap themselves in unexpected ways. Really though, picking up a real server and plugging it in is fun and spinning up vm’s and virtual switching is boring.

  • @JasonStevens
    @JasonStevens 4 года назад +347

    So how many CPU socket licenses does this count for? Or is it CPU cores now? Is this 4096 cores? Now way anyone outside of Oracle could afford such a thing. Oh.

    • @dtesta
      @dtesta 4 года назад +31

      Yes, because Oracle Linux is the only distribution that exists...

    • @Upgradeo8
      @Upgradeo8 4 года назад +8

      All hail our Oracle Overlords

    • @KCFindsDesign
      @KCFindsDesign 4 года назад +1

      Ikr

    • @kconkin4900
      @kconkin4900 4 года назад +3

      Imagine the oracle socket cost ...

    • @mitchh6471
      @mitchh6471 3 года назад +6

      PLEASE RUN CINEABENCH LOL if it is possible??? would be sweet to see all those cores as blocks doing the thing it does in cinebanch

  • @MarkusBurrer
    @MarkusBurrer 4 года назад +143

    This would be more efficient with a compute module

    • @gregk5505
      @gregk5505 4 года назад +12

      But then you need custom PCBs... Although it would be cool if the network switch and power supply were all on one board

    • @AndruRomin
      @AndruRomin 4 года назад +9

      They have a POE header, would have been more streamlined to just use POE switches

    • @tamaspacso9899
      @tamaspacso9899 4 года назад +7

      @@AndruRomin : For that you would have to do actual thinking.

    • @another3997
      @another3997 4 года назад

      @@AndruRomin You still have to mount the CM to a motherboard of some sort. Designing and producing boards isn't cheap.

    • @another3997
      @another3997 4 года назад +4

      @@tamaspacso9899 Have you done much thinking recently? Do you seriously think they haven't looked in to the costs of various solutions for the project? Do you even know WHY they're doing this?

  • @yeahuh4128
    @yeahuh4128 3 года назад +5

    how much Pi boards did you buy?
    Oracle Developers: *YES*

  • @RichSobocinski
    @RichSobocinski 3 года назад +10

    Editing tip: take down the gain on your 'music' track (or just delete it) and bring up the gain on the voice track.

  • @whenthethebeansstrikeback6728
    @whenthethebeansstrikeback6728 4 года назад +16

    So that's where all the RPI's were going!! Was wondering why there was a shortage all of a sudden.

  • @ProjectPhysX
    @ProjectPhysX 4 года назад +256

    This cluster has about the same floating-point performance as 3 AMD Radeon VII GPUs.

    • @lazar2175
      @lazar2175 4 года назад +56

      And the Vega 64 has similar FP performance to Radeon VII for way less.
      They could have had this much performance for less than $1000, instead they paid like $20k+ for it.

    • @thedog2962
      @thedog2962 4 года назад +78

      @@lazar2175 I think they built it just bc they could

    • @satibel
      @satibel 4 года назад +40

      I think it's more for development on scalability and as a model than raw power, though VMs would work too, dealing with real world switches and hardware is probably a good idea.

    • @WarrenGarabrandt
      @WarrenGarabrandt 4 года назад +21

      Also, I did the math, and it works out to about the same total processing power as 2 Ryzen Threadripper 3990X.

    • @leexgx
      @leexgx 4 года назад +23

      them network switches probably cost more then all the Pis they have there

  • @Jdbye
    @Jdbye 3 года назад +2

    What kind of performance do you get of this, compared to the same footprint and/or cost of conventional servers? Does it actually make sense to use a Pi cluster over conventional servers?

  • @antonnym214
    @antonnym214 3 года назад +2

    This is massively parallel excitement, and a perfect date to start! I subscribed immediately.

  • @statebased
    @statebased 4 года назад +13

    Looking at the fans, I thought: ouch! Lots of computation == lots of cooling! I hope it worked out in the end 👍

  • @SlimeDiamond
    @SlimeDiamond 3 года назад +10

    *casually spends $35,000 on Raspberry Pis*

    • @leyasep5919
      @leyasep5919 3 года назад

      .... and expects a volume rebate ...

  • @blockslayer1014
    @blockslayer1014 3 года назад +31

    That’s impressive, it might be able to run Rust at 13 fps!

    • @-CarPBon-
      @-CarPBon- 3 года назад +1

      Nah, stable 60 fps- (don't woooosh me) wait... A 9 MONTH COMMENT?!?!

  • @theburntcrumpet8371
    @theburntcrumpet8371 4 года назад +1

    What kind of monitoring and alerts do you have running for a cluster of this size?

  • @Quarky_
    @Quarky_ 4 года назад +9

    Could have used the quad racks made by Bitscope to make wiring and networking easier. Or even better, a bunch of Turing Pis with the RPi compute module.

    • @chiragsukhala
      @chiragsukhala 4 года назад

      Socked in mineral oil for improved cooling

  • @kvf271
    @kvf271 4 года назад +15

    what are those multi-usb charger you used? i need to know more

    • @JRLarsen
      @JRLarsen 4 года назад +5

      I too have a need for one

    • @TheKrister2
      @TheKrister2 3 года назад

      I'd really like to know as well. Annoyed me that the article only mentions the amount of usb power supplies, but not what type.

  • @dylanm742
    @dylanm742 3 года назад +7

    the poor guy who prob had to call to confirm they weren't ordering so much pie on a typeo

  • @Ares-5933
    @Ares-5933 3 года назад +121

    I feel like they could have contacted a manufacturer to avoid needlessly recycling 1000 retail boxes

    • @jackburton37211
      @jackburton37211 3 года назад +13

      stop the virtue signaling...

    • @eugeniovincenzo1621
      @eugeniovincenzo1621 3 года назад +4

      Thats probably only one branch of tree...if your gonna get mad get mad at my backyard where these stupid trees pop up...I have to cut back 100lbs of trees every year...

    • @heyhoe168
      @heyhoe168 3 года назад +4

      @@eugeniovincenzo1621 Tree cutting is only a half of the problem. Cellulose factories produce a lot of waste.

    • @DarxusC
      @DarxusC 3 года назад +3

      Honestly, how would you package 1000 of them safely with less waste?

    • @lordofthecats6397
      @lordofthecats6397 3 года назад +8

      @@DarxusC If you knew you needed over 1000 Pis, then the manufacturer could ship you all of them in a tray. (Just like how they go from the factory to the packaging plant)

  • @Geodesix
    @Geodesix 4 года назад +3

    Can you provide some details on the USB power supplies you were using...? Thanks.

  • @quade-mc
    @quade-mc 3 года назад +10

    Oracle Developers: over 200 PI!
    Me: *gets higher speeds on an intel vpro*

    • @powerupminion
      @powerupminion 2 года назад +1

      In this case it is not about speed. It's about making a testbed for learning about a large cluster without using a million $ server system that takes huge kilo watts to run.

  • @relaxationmusiccertified3684
    @relaxationmusiccertified3684 3 года назад

    I hope everyone was this privileged to enjoy building stuff like this.

  • @belspace
    @belspace 2 года назад

    Thx guys for sharing. I was looking for this type of projects since a couple of months. Beyond expectation!

  • @thebritishengineer8027
    @thebritishengineer8027 4 года назад +23

    A British Company Offers roughly the same ARM Processor on Multiple Plug in Processor Boards. 4 years ago the entry system was 3x standard server cabinets...able to run off mains power supply. They offered 29,000 Processor Cores and the storage/RAM to back it up.

    • @longnamedude3947
      @longnamedude3947 4 года назад +2

      "A British Company".... So that leaves a few thousand potential businesses to work out from then.
      Which company in particular was it out of interest, curiosity strikes!

    • @draco5991rep
      @draco5991rep 4 года назад +1

      @@longnamedude3947 A british one

    • @monad_tcp
      @monad_tcp 4 года назад +3

      @@longnamedude3947 lol its it ARM itself

    • @longnamedude3947
      @longnamedude3947 4 года назад

      @@monad_tcp Thank you for confirming what I thought.

  • @TheHarryMaddison
    @TheHarryMaddison 4 года назад +160

    I'm as nerdy as the next person; but from the outside I just see rich people gobbling up commodity computing for some cheap thrills.

    • @CrArC
      @CrArC 4 года назад +57

      Try to see it instead as a nice chunk of income for the Pi foundation instead. More Pi's sold = good, not bad. Suppliers can always manufacture more.

    • @WarrenGarabrandt
      @WarrenGarabrandt 4 года назад +25

      And at a stupid price. That whole rack had to have cost around $40,000 to build, and will consume $20,000 a year in electricity (I did the math...I'm bored).

    • @dafphtthedislikeupdater7836
      @dafphtthedislikeupdater7836 4 года назад +8

      @@CrArC Here's to hoping to an unbelievable Pi 5

    • @mxcollin95
      @mxcollin95 4 года назад +1

      r00x I hope you’re right! 👍

    • @thespooner3906
      @thespooner3906 4 года назад +8

      @@CrArC well in fairness the original idea for the pie as someone said before was to make an affordable sbc for people to learn and sell without profit. so that kinda goes against what they wanted

  • @timjameson1095
    @timjameson1095 3 года назад

    I enjoyed the video. Nice use of 3d printed parts for mounting pi's. I am curious how well the cluster stayed cool, with the full depth rack components blocking airflow.

  • @Cleasonsook
    @Cleasonsook 4 года назад

    Hi
    would like to know
    how dose the computer power on this comparied to a cray 2 computer of the old days ?
    and using the latest how computers i9 and nvidia gpu cards
    which would be faster at doing the math using the same amount of units ?

  • @hayrullahyasar
    @hayrullahyasar 4 года назад +3

    Exciting.. How about the running all of those Rpis efficiently

  • @absolutelyproprietary6896
    @absolutelyproprietary6896 3 года назад +3

    Me watching this during silicon chip shortage: -_-

  • @chrismoore1981
    @chrismoore1981 4 года назад

    Any reason for not using PoE switches with PoE to USB adapters or native PoE hat?

  • @travisgillespie2819
    @travisgillespie2819 4 года назад

    Cool project. I’m having trouble locating the aluminum extrusions you cut in the video with a bandsaw at 24seconds. Curious, where did you buy them, what is the model number or product name?

  • @JessterKing
    @JessterKing 4 года назад +5

    Good video but the music was a little loud, keep up the good work

  • @mumbles1justin
    @mumbles1justin 4 года назад +8

    Thats awesome!
    What USB power supplies are you using? I didn’t see any mention of the model in your article.

    • @OrdoCorvi
      @OrdoCorvi 3 года назад +1

      I found them but I can't actually find a place to buy them. They are Armor-x CHR-MT60 power supplies.

  • @1pcfred
    @1pcfred 3 года назад

    Remember that time when we built that ridiculous Pi cluster? That was awesome.

  • @davidprock904
    @davidprock904 3 года назад +1

    Just for extra potential future proofing, the plastic holding the cards.. it should have been made so you have to attach the power cable then place it in the fixtures so it makes it so the power cable can't accidentally fall out, like what if you need to wheel it to another room/building.

  • @vuk1419
    @vuk1419 4 года назад +11

    thanks for amazing work but most stupid presentation and loud music..

  • @weaselsworld
    @weaselsworld 4 года назад +7

    What was the point? To run Oracle Linux and Java? Why? I mean, if that's what's needed to run Java most effectively, a lot of questions are suddenly answered... :D

  • @SeanGarratt
    @SeanGarratt 3 года назад

    apart from coolness is this at all practical ? Are there advantages to this over a pure CPU/GPU cluster with bus interconnects and shared ram optimized for this purpose ?

  • @TheKrister2
    @TheKrister2 3 года назад

    Anyone know what that usb power supply is? They don't mention which one it is in the article and I can't find it when searching.

  • @TheFatTonny
    @TheFatTonny 4 года назад +132

    Nice! Also... why?

    • @scaramonga
      @scaramonga 4 года назад +9

      Yes indeed, why?

    • @ErtugrulOzdemir-mf1gl
      @ErtugrulOzdemir-mf1gl 4 года назад +13

      because

    • @olafurara
      @olafurara 4 года назад +21

      Testing clustering setups in the cloud gets expensive really quick. Also there are some interesting benefits from physically separated work loads. But I can't speak to the creators intent.

    • @kedarprabhudessai
      @kedarprabhudessai 4 года назад

      Ya hood question why....

    • @SpaghettiEnterprises
      @SpaghettiEnterprises 4 года назад +4

      Because kiloPi

  • @ratmdex
    @ratmdex 4 года назад +6

    Ah, you can now open 1 Chrome tab!

    • @Zed-Corps
      @Zed-Corps 4 года назад +1

      Your joke doesn't make sense, I have a single raspberry pi 4 and it can have 100s of tabs open with no reduction of performance.

    • @WinginitIguess
      @WinginitIguess 3 года назад +1

      @@Zed-Corps lol came to say the same. “Thaaaats not how it works bud”

  • @tombranson9341
    @tombranson9341 3 года назад +2

    This was unexpected, I guess this is what an unlimited budget can build.

  • @thadoviatt8087
    @thadoviatt8087 3 года назад

    Did you get a discount for buying so many Pis? Plus how did you mirror/copy the OS for the Pis from MicroSD chip to MicroSD chip?

  • @ScottSanders
    @ScottSanders 4 года назад +5

    I revel in the fact that there is an Amazon box smiling and lurking over the entire build. It's like there is an inferred symbolic meaning to be had.

  • @darkemperor2286
    @darkemperor2286 4 года назад +7

    first one: why build it?
    second one: it was cool and too expensive

  • @jaqian
    @jaqian 4 года назад

    Pretty cool looking but what will it be used for what's the specs of the final setup?

  • @Kevin-mb4xf
    @Kevin-mb4xf 3 года назад

    Does anyone know which usb power supplies were used? I can't seem to find it in the documenation.

  • @devdylan6152
    @devdylan6152 4 года назад +45

    "do not touch you will DIE" XD this is nice

  • @memadmax69
    @memadmax69 4 года назад +5

    Thats cool and all but....
    Why?
    My threadripper prolly has as much computing power, and uses less power to boot...

    • @ben1627
      @ben1627 3 года назад +2

      Fairly certian the point was to give students an enviroment to practice and learn with using computer clusters, which is something you cant get from a regular cpu

  • @mtothem1337
    @mtothem1337 3 года назад

    Looks great. but how come you used whole racks for this? instead of just large server chassis and filling them up?

  • @royhsieh4307
    @royhsieh4307 4 года назад +1

    next episode: tapping raspberry pis crosstalk in cheap lan cables

  • @koton_bads
    @koton_bads 4 года назад +3

    I thought of buying 4 to 10 so I can have a pretty powerful array of them, but it's sold out. No wonder.

  • @evilsdexter5261
    @evilsdexter5261 3 года назад +3

    and then you realize you need 2x nodes to run oracle on it :))) (and 10x the cash)

  • @williamduvall22
    @williamduvall22 3 года назад +2

    i wonder what hash rate you could get with that doing crypto?

  • @Sir.moriarty
    @Sir.moriarty 3 года назад

    Hey Oracle, I am currently an IT student and I have a few questions, let me start with how cool this project is. My first question is why not use Ansible to automate the deployment of the raspberries, second what kind of software do you guys use for monitoring is it something like Zabbix or Prometheus?

  • @noobinator9854
    @noobinator9854 4 года назад +9

    Nice to see what can be accomplished when positive like minded people get together. What is the intended application of this cluster? Or was it a proof of concept kind of thing?

    • @tad2021
      @tad2021 4 года назад +3

      Cooperate puplicity stunt I'm guessing

  • @David_Quinn_Photography
    @David_Quinn_Photography 4 года назад +4

    that's one hell of a supercomputer, what is its intent?

    • @alexrawson8492
      @alexrawson8492 4 года назад +1

      @Deon Denis It would probably suck as a desktop, the power doesn't add like that.

    • @mactalk2871
      @mactalk2871 4 года назад

      Alex Rawson exactly, the code that will run on it needs to be specifically made to scale well on thousands of cores, and has to be flexible with latency. So no usual desktop OS will run anything on something like this.

    • @wmonk5642
      @wmonk5642 4 года назад

      Mining?

  • @LuckieLordie
    @LuckieLordie 3 года назад

    What are you doing about storage? Or is this just compute pushing out into some S3 backed storage somewhere else?

  • @blairlane7425
    @blairlane7425 3 года назад

    What did the server benchmark at compared to other computers?

  • @KingJellyfishII
    @KingJellyfishII 4 года назад +5

    Would have been cooler if the pi4 was used, it's so much faster for the same money!

  • @syn7319
    @syn7319 4 года назад +4

    Awesome project.
    Now please watch video tutorial about adding music and leveling it.
    It was like soft whispers of discussion then blaring music prolly triple the dBs.
    Otherwise, great vid

  • @MsRope93
    @MsRope93 3 года назад

    Nice, but how do you replace failed RPI in the middle of row ?

  • @lightningflash3668
    @lightningflash3668 3 года назад +1

    Its beautiful....
    Also, love the note on the one test: "do not touch excitement in progress. You will die".

  • @markecklund3125
    @markecklund3125 4 года назад +30

    pardon the NOOB question, and it's not WHY, because you obviously did..... So, WHAT functionality do you hope to achieve???

    • @FinlayDaG33k
      @FinlayDaG33k 4 года назад +7

      Probably to test the scalability of their applications "on a budget" (a proper server can get expensive real quick)
      EDIT: see the full article in the description for more info

    • @SankoshSaha_01
      @SankoshSaha_01 4 года назад +1

      Is this sarcasm, cuz the installer in Raspberry Pi is called NOOB

    • @christiaansteenkamp5617
      @christiaansteenkamp5617 4 года назад +1

      As they are from Oracle and mentioned using a oracle flavor of Linux I asume they are testing how well / efficiently resources are delivered from many nodes.

    • @anthonylosego
      @anthonylosego 4 года назад

      Perhaps they are trying to find out how many Oracle license servers they can run at one time?

    • @thefatmoop
      @thefatmoop 4 года назад +2

      @@SankoshSaha_01 i guess this is a good route if oracle doesn't know what docker is

  • @DavidSanchez-vx4bv
    @DavidSanchez-vx4bv 4 года назад +5

    Ok fine... And what are the number:s costs, performance, latency, etc? it was worth it?

    • @another3997
      @another3997 4 года назад +3

      You, like so many commenters here, have missed the point. This is a learning process, building a cheap cluster to learn how things work, where bottlenecks are, what problems they might encounter and ultimately whether a full size, high performance cluster is practical. This isn't about ultimate performance, it's about the concept.

    • @linuxgaming69
      @linuxgaming69 4 года назад +4

      @@another3997 No he definitely hasn't missed the point.

  • @DiyintheGhetto
    @DiyintheGhetto 4 года назад

    Hello not sure if anyone ask this but what kind of power supply are you using for the raspberry pi’s?

  • @DiyintheGhetto
    @DiyintheGhetto 4 года назад

    This is a awesome build and i love the setup. I just have one problem with this is that is one of the Pi die not the Sd card but the pi it's self fails you have to shutdown a row of other pi's just to get to one of them. But other then that it is a great build.

  • @ArdjanVideo
    @ArdjanVideo 4 года назад +4

    Why not using PoE-HATs on those PIs? You would save a lot of cabling and these USB power supplies. I didn't do the math of the cost for PoE switches and the HATs against the USB cabling, but the easier hardware setup would count as well?

  • @vigneshvembar936
    @vigneshvembar936 4 года назад +26

    So you spent around 35000 dollars for something that is less powerful than a 10000 dollar PC
    STONKS

    • @the_retag
      @the_retag 4 года назад +7

      Pi clusters can because of the many cores be used to test real super computer software without load so you dont use up valuable time on the real thing without needing the power

    • @dutchdykefinger
      @dutchdykefinger 4 года назад +5

      a 10000 dollar PC isn't a cluster though
      like mentioned before, it is a good testing platform to test highly parallelized workloads in the field :D

    • @another3997
      @another3997 4 года назад

      If only you had done a little bit of research in to high performance/distributed/cluster computing, you might actually have learned something useful... instead of making silly comments. 🙄

    • @AlexanderHL1919
      @AlexanderHL1919 4 года назад +1

      @@another3997 Because as we all know, you're not allowed to be silly on the internet 🙄 🙄

    • @linuxgaming69
      @linuxgaming69 4 года назад

      @@dutchdykefinger You know a $10,000 PC can easily mimic a cluster, right? You do know that? Do you?

  • @mhan6601
    @mhan6601 3 года назад +2

    So, what did you do with it? i wanna see some benchmarks :

  • @willjoyce5013
    @willjoyce5013 3 года назад

    My work is looking into potentially making a 200-1,000+ cluster of CM4 as an idea for processing a ton of data locally. Any thoughts in the new Compute Module for clustering and how to go about such an endeavor?

  • @ronniesthedon5034
    @ronniesthedon5034 4 года назад +5

    why? whats the purpose? this seems very inflationary to me.

  • @mr.august1
    @mr.august1 4 года назад +8

    What is the point?!

    • @grey1185
      @grey1185 4 года назад +1

      эхх Почему нет иметь компьютер Быстрее тогда бабушка

    • @MrHasie
      @MrHasie 4 года назад

      Description, fascinating really.

  • @ivanromero7274
    @ivanromero7274 3 года назад

    People: Why you do this?
    SuperPiBuilder: Yes

  • @dionbridger5944
    @dionbridger5944 3 года назад

    What exactly does this cluster do for you that a server-type mobo with multiple CPU sockets and 128 gigs or ram won't?

  • @AlexaMorales
    @AlexaMorales 4 года назад +4

    Woo hoo, so cool! At 1:57 my son is in the ball cap on the table on the right and I am in the purple shirt at the end of the table!

  • @MrMrRubic
    @MrMrRubic 4 года назад +10

    Why not use PoE hats?

    • @xFUNKYFACE
      @xFUNKYFACE 4 года назад

      had the question. Would remove a lot of the clutter and ubiquitti poe switches and not that much more expensive then the regular ones.

    • @Alan.livingston
      @Alan.livingston 4 года назад

      The hats are near half the cost of the pi again.

    • @user-fw5uh5ne3o
      @user-fw5uh5ne3o 4 года назад

      More costs, you couldn't fit as many per row and the switches couldn't handle the power draw anyway.

  • @messengerofiexist2139
    @messengerofiexist2139 3 года назад

    Will you be using Haskell for parallel programming?

  • @Samstag494
    @Samstag494 3 года назад

    Which Power supplies did you use?

  • @rambazamba7738
    @rambazamba7738 4 года назад +3

    All that effort just to run JAVA smoothly... Poor environment🙁🌲🌳

  • @stinkyskate
    @stinkyskate 4 года назад +3

    why was this done? what a stupid waste of time, resources

  • @HomoSapiensMember
    @HomoSapiensMember 4 года назад +1

    The thermoplastic you are using will deform and damage the pi cluster arrays over time.

  • @TheBitcoinMiner
    @TheBitcoinMiner 11 месяцев назад

    Nice set up what USB Power banks are you using?