The Real Reason Elon Musk is Building The DOJO Supercomputer
HTML-код
- Опубликовано: 23 ноя 2024
- Why Tesla needs their own Dojo AI training computer to rival Nvidia
Last video: Neuralink Reveals Major NEW Human Trials Update!
• Neuralink Reveals Majo...
► Support the channel by becoming a member: / @theteslaspace
►The Tesla Space Merch Store Is Live! Shop our first release while quantities last: shop.theteslas...
► Patreon: / theteslaspace
► Join Our Discord Server: / discord
► Subscribe to our other channel, The Space Race: / @thespaceraceyt
► Subscribe to The Tesla Space newsletter: www.theteslasp...
► Use my referral link to purchase a Tesla product and get up to $1,300 off and other exclusive benefits. ts.la/trevor61038
Subscribe: / @theteslaspace
Welcome to the Tesla Space, where we share the latest news, rumors, and insights into all things Tesla, Space X, Elon Musk, and the future! We'll be showing you all of the new details around the Tesla Model 3 2023, Tesla Model Y 2023, along with the Tesla Cybertruck when it finally arrives, it's already ordered!
Instagram: / theteslaspace
Twitter: / theteslaspace
Business Email: sean@creatormill.com
#Tesla #TheTeslaSpace #Elon
NVidia is reporting about 74% gross margin on H100s. If Dojo offers similar performance / manufacturing cost, that's an incredible savings for Tesla and could give them a serious competitive advantage in offering AI services compared to companies relying on NVidia.
Well the H200 is currently king in performance which is quite a step up from the H100. The B200 is quite a step up from the H200 and that chip is coming out this year. After that Nvidia has already announced the Rubin chip coming out in 2026. On top of all of that the biggest issue with offering AI services will be the software but I'm not sure what kind of AI services you are speaking to.
@@chrisrogers1092 Tesla has serious competition in NVidea, BYD and indirectly, CATL. (Though I don't see a day where they do more than design the majority of their chips/batteries in house in the latter two cases. They are no direct competitor for NVidea.
The next couple of years will tell whether DOJO supplants a large portion of the chps Tesla buys. I would say not more than 35% in the best of cases. They have a serious tech gap to close and NVidea has the high ground on volume which they helped them with, then, now and in the next few years.
But then Musk is Musk... 3 years is all I would gamble on. Took forever for 4680, but we will see the fruit of that in 2026... May be a force to be reconned with (or CATL may yet bury their tech).
The important thing is that this is a race among Highly competently run companies that deserve to be on the bleeding edge of a fast moving market with massive growth potential.
@@chrisrogers1092in think Tesla is also going have to do a lot marketing to make it well known enough that they are offering a competitor to NVIDiA.
You're looking at it backwards.
There's a reason Nvidia has those margins, is because they are so far ahead no one else can compete with the H200. The fact that they have a 74% gross margin and they are STILL selling like hotcakes means Tesla and others are miles behind.
I doubt very much that Tesla can pull that off: Nvidia basically invented GPUs for number crunching with CUDA. Tesla will not only have to create amazing hardware (AMD did), that only is useless without the software (AMD failed with that) to use it. We write the year 2024 and hardware is pretty crap without good software running on it, very much like a human without education can't do anything. No important to remember: AMD is the biggest competitor of Nvidia, they build the world second best GPUs and they can't keep up with Nvidia, so how should Tesla? Remember, EVERYBODY is building their own AI Chips, Google does, Facebook does and they all don't really do well, because it is the cutting edge of computing, it really is rocket science.
All the biggest billionaires and trillion dollar companies racing toward ultrapowerful supercomputers and ASI, and everyone else is just watching like, "I guess we're headed for the season finale now, huh?"
Might find we can all dodge bullets soon!
@stuartpatterson1617 or realize the bullets are not really there. (Neo and the spoon first matrix)
Who else is going to build supercomputers? Your neighbor?
With all the computing power Elon is getting behind into, he might be venturing into the cryptocurrency field. Ey?
Or learn and get high paying jobs while everybody be distracted, fired, replaced
The NVIDA H100s are not generic multi purpose chips. They are not even general purpose GPU chips. They are more specialized than that. DoJo is said to be a better fit for what Tesla is doing. I have no reason to doubt that.
NVidia chips are 128 bit words. AI training only needs 8 bits, which is what DOJO is, making DOJO more efficient (lower cost).
@@billweberx Yes That is one of several things. DoJo has no conventional memory support. The Caches are gone. Can't interrupt or toss an exception on a specific location. IO hardware is associated with processor arrays. etc etc.
This all has implications for the development tools. Lots of work there too. I expect Tesla was developing the tool chain in parallel with the Dojo hardware testing it using a Dojo simulator. That is generally how it is done.
@@billweberx wait so ur saying AI training only needs 8 bit floating points? is that true? with Intel AI accelerators for HPCs we used fp32 and bf16 when had vram constraints, but this was for a BERT language model doing domain specific relation-extraction. or Is it different for computer vision domain since there's weight-sharing and less parameters in CNNs?
@@Johnsmith-p1v Why? I regularly sleep while driving now, so...?
@@billweberx Does Tesla simply "throw away" the other 100-bits of precision or do they run parallel 8-bit operations within the word?
My basic contention for past 3 months… DOJO is going to be mass produced for colocation of a data center where FSD is accepted. Keeps sensitive driving data within a country/region. All while creating useful self driving program for the inference computers in the car reflecting local rules, signs, customs and habits of drivers.
xAI's supercomputer in Memphis consists of 100,000 H100s only. It's not a mix of H100 and H200 GPUs. If it were, Elon would have emphasized this in his tweet on July 22, when the training of Grok 3 began.
2:35 bro said "threatening to buy" like it's a terrorist action 😂
😂
Hostile takeovers are funny af
This channel doesn't have any content=bot.
Hit 200k today. Thank you for all the knowledge and nuggets you had thrown my way over the last months. Started with 14k in last month 2024
Wow that's huge, how do you make that much monthly?
I'm 24 and I have been looking for ways to be successful, please how?
Mark Hutchinson's expertise is truly commendable. He has this skill of making complex crypto concepts easy to understand
Woah for real? I'm so excited. Mark Hutchinson strategy has normalised winning trades for me also. and it's a huge milestone for me looking back to how it all started
Please how can I reach this Mr Mark everyone's talking about ?
There won’t be a single Dojo chip sold to a 3rd party unless Elon has a supercluster twice as big as any other hyperscaler
Not sure why you think Tesla isn’t collecting data in other territories? Vehicles collect data regardless of FSD subscription.
Maybe there is a kW per Gigaflop issue - Elon did mention how much power a DOJO stack took, and he didn't say how it compared with NVidia.
Teslas biggest competitor is BYD and NVIDIA has already partnered with them to install AI driving systems in their cars.
Great informative video as always 🚀 keep it up 🔥
What exactly did you learn?
A generic multi purpose chip like those from Nvidia? Nvidia’s chip can be adapted to work efficiently with any training regime
If you can make a computer understand why someone likes blue more than red or why some prever a common girl with no makeup etc then you will be a pioneer
All the richest companies ( and folks) investing money in Ai and robotics to ..replace us basically.
And we watch this from sidelines in an awe unaware how bad of the impact this would be for everyone who will be found replaced by said tech.
People need to understand, its not like these companies gonna make your life easier, they will just make their revenue stream more steady and bigger.
You will need to adapt (again) and compete with this tech for your place under the Sun or you will end up homeless.
Typical unfounded paranoia caused by watching Terminator, the Matrix, Dune and 20 other movies that made up the total BS myth of AI automatically turning evil. So far we have 0% proof, not even hints that this will happen. Quite the contrary: technology has never ever turned evil by itself, no toaster has ever tried to electrocute their owner, no smartphone has plotted to get its owner murdered. But yes, if you don't know anything the technology, you will believe any false claim by "experts" which are very eager to sell millions of copies of their fear mongering books.
For this exact reason, Elon was talking about how a Universal Basic Income scheme is inevitable. He believes that once we reach a certain technological threshold, there won't be enough jobs in the world that only humans can do. Humans often find meaning and purpose in the value they can create for others. If robots make most of that value redundant, humans must be paid for living and thriving without being employed. I like that plan quite a lot. It would allow us, as a species, to focus on creating and building more intangible and interpersonal value rather than the far-removed-from-community value most of us are producing today.
didnt mean to leave a comment.
@@Sparks95 You didn't give much to go off of. Could you elaborate why you find UBI awful? The people who would still work to maintain the supply chains need to be paid - so those who can contribute to society, yet are being made redundant by robots should be given enough money to live comfortably.
@@Pranav_Bhamidipati no real reason.....
Back in 2019 crypto mining created a large portion of the demand for GPUs.
like 90% x'D
Elon might be venturing into the cryptocurrency field. Ey?
Elon said very clearly that Dojo is a hedge against not getting the chips they need.
Elon said: buy buy buy the stock.
That’s his modified position. Until two years ago it was the most powerful chip and super computer ever.
Elon me procura , sinto saudades
DOJO will be needed on Mars. I'm serious. Will need AI robots on Mars to build infrastructure.
Maybe, and that's why I sold out of TSLA. Buffett said "the market can remain irrational longer than you can remain solvent," and that also applies to Elon's scattershot all-or-nothing (Go F Yourself) way of doing business. There are better ways to make a buck.
😂😂😂
I got so many ideas too, brilliant ideas. Wish I could back them up like Elon can
My understading, Qualcom is making devices that are hitting personal devices that seem to be doing just as good as actual GPUs with higher efficiency pound for pound. someday they may catch up in this space. I could be wrong though.
How’d they come up with the name ‘Dojo?’ Just sounds cool? Regarding all the video Tesla has collected for training purposes, does anyone know - or can anyone think of - if there are other uses or applications of all that data?
I wonder what physical sensors Tesla cars have, where physical environment is expressed with visual perception. Memory of pot holes etc. shock sensors etc.
Also would be great if the conjunction of physical and visual could alert municipalities in real time of road repairs needed. I guess in a perfect world.
Very good video. You are a great site to learn how to present information. Many site waste a lot of time. Keep it up!
Wait a minute, the Memphis data center is for grok and ex. Ai, not for Tesla's dojo.
Pretty soon we will be staying, "It's Elon's World; we just live in it."
Why not attach newer more accurate and advanced gps sensors or satellite cameras to work with the new Dojo network?
Should have partnered with palmer luckey and anduril with their lattice system.
A fraction of this is for FSD/robotaxi.
Most of this is for Tesla's Optimus bot. That business will be at least 10x that of Tesla's EV, FSD, and robotaxi ... combined.
I have no clue what you said, but it sounded good and I gave you a thumbs up.
Be aware that Tesla has serious employee headcount requirements in Buffalo, so they are business there wherever practical.
I don't think the FSD model will need to be trained on the same amount of data from every country. The model will at some point probably recognize and know how roads in general work and will be able to apply that to most of all roads. As a human you also don't have to re-learn how to drive when you're driving in another country.
reading road signs & knowing the rules that apply to them? Humans don't do that so well. And taking cars across borders does pose a conundrum in Europe for FSD. For car travel Europe Is one region. Maybe except UK - driving on the left.
@@RedRouge-j4j sure you need some extra training, but not nearly as much data as tesla is using now. The basis is already there.
Investing in quantum computers make more sense.
I know basic computing is available. But. Seems like alotta money.
... because he can.
Aslo, a tailored / specific solution will always be more efficient and powerful than a general use solution.
Anyone waiting on those sex bots?!?! Cmon dont be shy. ;)
Heck yeah as long as she can wear a French maid uniform as says “ I love anal best” HA. MUST HAVE B CUPS 👍❤️🔥
Make sure you always capitalize the X in CorteX. 😅
Elon Musk's DOJO supercomputer is more than just a tool for optimizing Tesla's AI models-it's paving the way for a new era of chip design. We're getting closer to AI supercomputers being capable of designing chips far superior to what humans can create today. The real bottleneck will soon be the performance of the materials themselves, not the architecture. Imagine a future where AI-driven design, combined with breakthroughs in materials like graphene or photonics, revolutionizes chip efficiency and power. It's only a matter of time before Tesla surpasses Nvidia, pushing boundaries even further
If Tesla built personal computers with their own designed CPU, I would buy it.
I saw a Terminator movie about this lol .And this is the start of the Ai Foundation to start it all .lol
DOJO is the future of AI FSD!
Another application of GPU's in 2019 was crypto mining
Elon Musk, nao se trata de computador nem de Robô ,SIMPLESMENTE sinto Saudades de vc ❤😢
Is it Dojo 1.0 or Dojo 1.5? I read somewhere they were doing 1.5 right now.
why then he buys 100k H100 GPUs for xAI?
Elon! I wanted to play video games!
This is incredible
Diversifying out of electric cars. Smart man.
With all the computing power Elon is getting behind into, he might be venturing into the cryptocurrency field. Ey?
As opposed to the bushlit reason?
and mined crypto, which FAR FAR outstripped the other 2 areas , but is strangely missing.
so glad i now know the real reason
Seems that focusing on, camera only, input is an unnecessary limitation that will hinder the Dojo 2 progress. Sound is a pretty well developed input, as in, voice command computer control. Developing sonic input for FSD and Robot control seems to be nearly accomplished by Waymo. Either buy Waymo, license the tech or work around the patents; no? I want my robot to smell a fire and hear a siren or crying child.
The disturbing fact is the worlds most valuable company is Taiwan held which is like right next door to China it's not a USA firm
And? You’re probably typing on something mostly manufactured in China lol
as a normal civilian.. what are these companies doing with AI?
Who else has created their own Ethernet protocol? They tear apart everything to improve it.
With nvidia chips, tesla can redesign the dojo ai chip
It's the Mojo Dojo Casa House Super Computer!
Bots are scary if you see them in real life, my brain keep thinking the bot could become like the terminator! Software tool is why Nvidia is dominating, all the researchers are used to using cuda and it only runs on Nvidia hardware! If the researcher said I need Nvidia hardware to make it work the vp will go get it! Does the tesla fsd broken up into many nets and can be train in parallel? Dojo might train a percentage of all the nets for fsd, any one know that?
Does anyone believe what is said about the delay in the robotaxi - that its AI is getting online and posting random stuff on X for no reason??!! I guess we may never know as the truth is often wilder than the actual fact....
Связка работает отлично, лаб молодец!
"Tesla might not live without DOJO?" Dang that is a really crappy situation for one of the highest valuation companies in the world. Tesla might want to pull back and focus on their mission of to accelerate the world's transition to sustainable energy. They have squandered a massive lead in the EV sector. Heck, I have family who have bought Bolt, Lucid, and Nissan Ariya. . . 3 years ago, none of the companies had anything competitive against Tesla and they each would have bought Tesla. Now days, when they told me what they would buy, each option fit their needs and I didn't even try to persuade them to get a Tesla.
hilarious "remain at the front of"
damn, the world is gonna be a real life terminator fr
3-09-2024.
Hi yesterday I saw a 3 wheel car, at Nassenhausen , Germany, today l saw your picture of the robot taxi, it's here. 😮
lets be blunt and honest. Writing the software stack to optimize AI training is very hard. Anyone silly enough to think "I just need my own hardware" clearly doesn't understand how the entire stack works. The hard part about building a software stack for training machine learning model isn't the hardware. It's optimizing and dividing up the work to make sure the hardware is running efficiently. The parallel processing problem is a long standing problem in computer science. Go watch talks by Jim Keller on parallel processing. To anyone that believes Elon's BS lies, try to implement a compiler to optimize math heavy computation.
Tesla ai has a lot of competitors but let's give the guy a credit for keeping up with the likes of Google and Apple in robotics and ai like xai
I kinda think Elon himself and those he has surrounded himself with probably have a better handle on this issue than you.
Nvidia chips are not multi purpose. They are designed for neural networks training. Exactly the same purpose Dojo is designed for.
LOL
NVDA will double by next year from this point.
I won't own Nvidia. ONLY TESLA
Elon needs to start a company that builds it’s own gpus. And chips for everyone else. Gigafactories worth of chips. That would solve the chip problem.
Not even Nvidia is doing this, And there are good reasons for that.
Too bad that the robot has to use its arms as a counterbalance while bending its "knees" simply becauise its "feet" do not have a bending joint like a human's where it flexes between the toes and arch..
Elon might be venturing into the cryptocurrency field. Ey?
Sem palavras esse documentário
AI day was 2021, not 2019
The first time Dojo was mentioned was on Autonomy Day in April 2019. You're right. AI Day was in August 2021. The Optimus project was announced at this event.
AI has cost companies around $5 trillion so far, but only made a return of around $50 billion. A bubble?
Everything has a startup cost. And the startup cost for this is larger than anything in history because 1. It's use is assumed to apply to every data driven company, which is like every major company these days. And this tech came about so fast, almost out of nowhere, that the supply absolutely could not meet the demand. Meaning the price to startup is through the roof.
2. The price was already high to begin with despite my first point because high end semiconductors are already a feat of human engineering requiring things like a lithography machine that's only made in 2 places and cost an arm and a leg(which is just 1 tool of many very very expensive tools).
3.The nature of this tech just flatout requires a large number of these semiconductors, which need a large place to reside as they operate, which consume outrageous amounts of power, which need advanced cooling systems that often times include lots of water. They also need time to work, and more than that time to become fleshed out into something truly productive.
This isn't just a startup for some already proven tech ready to be put to work productively right when it's set up, it's almost certainly useful, it just needs some extra R&D on the side of the consumer, so this is more like the early days of computers than other things investors are familiar with. They aren't immediately profitable, but once they find their place in a company, it's going to cause big changes, and once those changes start to happen even then it's going to take a while for those changes to complete, and then for the business to scale based on those changes.
5 trillion dollars is an insanely huge amount of capital. It's more than the GDP of Germany, the 4th largest economy in the world. As of today, the total investment in AI is way less than 1 trillion.
@@MrSchweppes I heard that figure mentioned by Sergey Brin in a podcast with some other huge investors. It was fascinating. He has some great inside knowledge about how much has been invested in and how much companies have spent. It's insane.
@@KangoV Interesting. Do you remember this podcast title? So I can find it? Thanks!
Since when has Elon "undersold" something he is working on?
Still, junk in, equals junk out..., unless these supercomputers are 'allowed' to learn on their own, and so far, that has not really been permitted.
well we know when the demand is high and the supply is low you have now 2 reactions very high prices or people boycotting it. I have to say i love the second one, i already boycotted nvidia with my new and AMAZING Radeon GPU . you guys have to try it. Nvidia dont deserve my money anymore
AI DATA CENTER & CLOUD DATA CENTER ARE GROWING RAPIDLY AND NEED A HUGE ENERGY. 😂
A custom chip does not mean it can perform better. In the video, it is misleading to say DOJO is better without benchmark.
AI service is already offered by nVidia called via microservice. Microservice is not a concept created by Elon.
Elon Musk - World's greatest conman.
cry about it some more
Why!!!
All I want for Christmas is another EVGA GeForce GTX 980 Ti GPU to bridge with the existing one...can anyone hook me up for less than a C note?
Dojo real purpose is pumping Tesla stock. They don't even release benchmark on its performance, so forget about industries building software to run on it.
Here's the thing, nvidia h100 costs around 35k$ for a card which is a chip comparable in size to a 4090 and 80GB very fast ram. That chip might cost 200$ from TSMC and 80GB of GDDR6 ram costs 170$, maybe you can spot a price disparity. Meaning the potential for cheaper compute than nvidia's is extreme. Compared to current prices it will soon be comparably cost free. Like you get a data warehouse for free compared to what they pay now. And since AI is not about a lot of compute but the right algorithm, all these FOMO billions will soon be entirely wasted.
Anybody know if DOJO is a 64 bit system?
Wunderbar
Abshire Hollow
LFG🔥
Mm nvm B m mmm mmm mm mmm mmm m m B
Sadly, none of the existing vehicles will be able to run the new models, whomp whomp.
Elon following the Truth Social way 😂
Elon Musk isn't doing ANYthing. Except for what he always does: taking credit for the work and creativity of other people. The simpering hero worship of The Tesla Space is getting harder to hide and ignore. Your audience deserves better.
Cry about it some more
another lefty who once worshiped Elon's genius until he redpilled.
Now Elon is an idiot!
lol so obvious
All these billionaires are going to wake up in a nightmare when they realise that the biggest AI gains will be theory driven. The current scalability paradigm is a bump in the road.
OpenAI exists thanks to Mr Musk and now it looks like AMD/Intel are joining forces.😃
How do we mere mortals make serious coin from all of this? I'm stagnating here.
Time Magaizine just listed the top 100 AI influencors. Elon didnt even make the list. Goes to show you, its not what you know, its who you pay off.
Stocks, investing, is a high risk possible high reward later. Invest in companies with a man that has his heart in the right place. He is a true humanitarian. He even stated it will take 25 years before most have EV’s. We still need nuclear and Fossil fuels. We can not bankrupt companies by forcing change tomorrow. Hawaii over 30% renewable NOT due to government but private residential rooftop solar. USA has cleaner grid. Other countries just starting their Industrial Revolution they need help
They need to use AMD
in his spare time!
Good luck, Nvidia is so far ahead of the game that catching up to them could take a decade if they all of a sudden stopped releasing products and just did development.
Tesla isn't the new kid on the block.
I wouldn't bet against Tesla... but what does anyone really know?
Right now really is a stock market bubble.
Tesla, has stayed the same for 3 ~4 years... average $200 per share for a long time.
Same comment NASA made in 2010 about Space X ability to rival legacy rivals😊
@@maxSebben NASA was stagnant for over a decade, plus it's not a private company that needs to make money so they had no urgency to innovate, your not getting fsd, robo taxi anytime soon.. those Optimus human dancing robot suits still can't compete with Boston dynamics, don't get me wrong Elon musk has achieved alot of great things in a short time but let's not act like he can turn water into wine
Once Tesla gets its Dojo controlled self-driving robo taxis, its share will soar.
@@alaomachukunyere8328 ... FSD... might be very different from "driving in the city"... which might not be considered FSD, but it would work to get people from here to there more efficiently than Uber.
Elon goes from being scoffed at to the OMG moment when he succeeds.
He is always working on innovations, and then suddenly they happen.
Robo taxi, within the city, ushering people in 15 minutes from home to work... or where ever makes sense to me
"Threatening to buy" bro really?
From $37K to $45K that's the minimum range of profit return every week I thinks it's not a bad one for me, now I have enough to pay bills and take care of my family.
Please where and how did you earn that much
Please how do I go about it
I'm still a newbie on investment trading and how can I make profits.
All thanks to FLORA WOOD
She is the lady that changed my life for good
Yes!!! That's exactly her name (Flora Wood) I've seen so many people talking about her....and am just starting with her from Ontario Canada 🇨🇦
3:03 "remain at the front of the A.I race"? Tesla was never ilat the "front" of the A.I race 😒🤦