JAX in 100 Seconds
HTML-код
- Опубликовано: 25 авг 2024
- Try Brilliant free for 30 days brilliant.org/... You’ll also get 20% off an annual premium subscription
JAX is a Python library similar to NumPy for scientific computing and linear algebra, but designed to run on accelerators like Cuda-based GPUs and Google's TPUs.
#programming #math #100SecondsOfCode
💬 Chat with Me on Discord
/ discord
🔗 Resources
Google JAX on GitHub github.com/goo...
Tensorflow in 100 Seconds • TensorFlow in 100 Seconds
Cuda in 100 Seconds • Nvidia CUDA in 100 Sec...
GPU vs TPU • CPU vs GPU vs TPU vs D...
🔥 Get More Content - Upgrade to PRO
Upgrade at fireship.io/pro
Use code YT25 for 25% off PRO access
🎨 My Editor Settings
- Atom One Dark
- vscode-icons
- Fira Code Font
🔖 Topics Covered
- JAX basics tutorial
- How does JAX work?
- JAXPpython explained quickly
- Pytorch alternative
- Tensorflow vs JAX
- How is calculus used on Machine Learning
"Why did you start using JAX?"
Me: "I like the logo"
"Imagine you're writing a nuclear warhead in your mom's basement" Oh I don't have to imagine fireship
Lol worst day to possibly make that joke.
Relatable
FBI would like to know your location
@@gezenews?
@@GLUBSCHI he must know something we don't 😳
Now I have 10 years of experience in JAX. NICE!
Well done! Congratulations!
parallelized
Enough years for Jax
Good because that's the min req for the newest jobs using it
*writes in resume
Active: Jax enters Evasion, a defensive stance, for up to 2 seconds, causing all basic attacks against him to miss. Jax also takes 25% reduced damage from all champion area of effect abilities. After 1 second, Jax can reactivate to end it immediately.
Active: Jax enters Evasion, a defensive stance, for up to 2 seconds, causing all basic attacks against him to miss. Jax also takes 25% reduced damage from all champion area of effect abilities. After 1 second, Jax can reactivate to end it immediately.
Imagine if Jax had a real weapon?
ACTIVE: Jax Dash dashes to the target unit's location.
If the target is an enemy and they are in range upon arrival, Jax deals them physical damage.
Jax can cast any of his abilities during the dash
Gotta try AP Jax someday, one time I had this one rando Jax who went AP in my team. He was melting everyone!
Was just scrolling waiting to find a comment like this.
As a software engineer with 10 years of experience, I understood some of those words.
I felt so stupid watching this
@@MaxMalm You're not the only one. 😉
Yeah, I guess that goes to show that those years of experience were wasted
This is what happens when people become software engineers from the internet lol
As a ML student I understood everything. That just means you're not into this stuff.
Time to add JAX in my resume
10 years experience
😂😂
Good idea. Thank you for the career advice
Gg no top
I watched this vid too, I'm going to do the same
Jax sounds like less abstract version of pytorch and more complicated version of numpy
Pretty much yeah
huh
However performance is above torch somehow
@@Michallote because JAX basically compiles down to machine code when run, and while a lot of Pytorch iis done at a low level, there's still some overhead that's python running things. But conversely torch allows you to do dynamic ML (edit: actually pytorch also let's you compile but I haven't played with it personally), whereas JAX has to all be perfectly laid out from the start so it depends what you're trying to do. Torch is also just more useful to more people so it's more well supported so even if Jax would be better for your project, there's incentive to follow the herd and use the thing everyone else is using.
jax borrows a lot of ideas from haskell and functional programming
it just has a more familiar syntax (python-style) and calls things differently (scan is a bifunctor for instance)
i'm interested in computer science, calculus and statistics, but i only have 300 seconds in total
Then you're in the right place.
Then you need Matlab - short, fast, mathematical!
give 100 seconds to each and you're done.
"Imagine if i had a real weapon!"
I WAS LOOKING FOR IT xd
now we need another library call annie
My thoughts exactly, especially the color scheme looking like his default costume
League x Programming = Legendary
@@potatosheep found the scripter
The sample code u shared at the end, so simple & elegant shows what training is all about. Approximation of a function F defined as multiplication of multiple matrixes (its layers), then calculating its error over known data E(F(x), y), computing gradients of that error E', & then updating F's parameters, such E' approach to zero. I will share this code to my students. Thanks again.
Oh boy another Fireship video!
truely the first
At least that one haven't made me anxious about AI taking over the world
that's a very clever logo
Then you should also love Tensorflow.
2:43 that sure looks cool and inspiring. but whats clever about it?
I have never heard the best explanation of derivative from calculus like 'if you want to know how big is the mushroom cloud is growing ' .
- “Mum, could I practice my predictions from automatic differentiation in our garden?”
1:47
"Let's start with X: Accelerated (...)"
"???"
That's because X is pronounced "eks", and accelerated is pronounced like "eks-elerated"
Clearly you haven't watched BEN10
ai fireship strong with this one
@@bruwyvn For non native speakers XLR8 is just XLR8 in the translated language, usually who watches/ed ben10 at 10yo would not speak english, outside of native speaking countries. It took me years to realise that xlr8 is spelled accelerate
@@joaofrancisco5781 Nah it really depends.
For example, in the Hungarian dub its name would literally translate back to English as "Lightning Gremlin". They just took the message of it, and gave XLR8 a name a 10 year old could have come up with. Instead of a letter sequence that is otherwise nonsensical.
Or, in the Japanese dub, they just called it "Accelerate", as they kept the pronunciation of all the aliens, not the spelling.
Do Elm in 100 seconds! You'll love it! It's an older JavaScript framework that had a lot of thought behind it. It's funny to see more popular ones catch up, but Elm did a lot of the things very well and it deserves some love!
great video but still very sad we did not work in a mortal kombat jax reference
Was looking for this comment.
I always wanted to see a library or tech called Jax, because all I got was AJAX concept from Javascript, which would not entirely fit it, but somehow always reminded me of the MK fighter.
Dang missed opportunity using the Jax from league of legends on the video
missed opportunity to take a shower
Who?
Thank you, Fireship. Up until I watched this video, I thought I was smart.
This video really clarified how this isn't just another accelerated linear algebra library, but a tool developed by Google for futuristic new hardware. The constraints on immutability and the way it compiles to low-level code for accelerated Hardware seems ideal for machine learning. And the automatic differentiation feature is truly next level.
Thanx totally not chat gpt or equivalent
Thanks, I can now add 10 years experience of JAX to my résumé!
For those who don't know:
Fireship lives on a planet whose gravity is stronger than our Earth, that's why his 100 seconds are our 226..
Holy shit automatic differentiation is so freaking cool. Imma need to remember this when I jump back into calculus
ah yes that one character from The Amazing Mortal Kombat Circus
0:55 the points of inflection are marked wrong on the graph. The yellow points are local extremums, not inflection points.
Could you do a ROCm video (AMD's CUDA couterpart) ? Love you and your vids !
I'm an artist who worries constantly about saying the wrong thing on occasion. Meanwhile, I'm watching some guy talk about nuclear warheads.
What a fascinating channel. 👏
Actually understood a lot more than I thought I would randomly clicking on this video.
100 seconds is a bit of a stretch, but well what can you do. Keep up the great work.
I said "Im not going to use JAX probably not going to watch". I'm glad I did, it actually looks useful lol.
All those new languages and libraries are converging closer to functional programming
Man that logo design for Jax is amazing
I just opened RUclips and thought it must be about time for a new fireship video. And bang! There it is
Then at your interview they're gonna require you to have 5 years of experience in JAX
"Imagine if I had a real weapon"
I would love to see Smalltalk in 100 seconds
Love the visuals in this one
Oh, that is actually useful. The abstraction is very much welcomed here. Can't wait to see RandBLAS and RandLAPACK too!
Brilliant back at it again, everywhere I go I see brilliant.
nice I just literally started learning JAX after using TF and torch for a long time
Mr fireship, please don't scam us, this ain't no 100 seconds anymore, Thank you ❤
*jax from the amazing digital circus* ⁉️
What i thought
Nah, from Mortal Kombat
please end it all my bro
I was sure there would be at least 1 comment like this...
No it's the classic creator from Geometry Dash, the one behind the legendaray The Nightmare
Recruiters are gonna ask for ppl with 15 years of experience with JAX
My experience: ~1200 to 1500x accelaration of a function with numpy operations on a conventional 3070 GPU, by just adjusting the numpy code to JAX syntax. Just remember that array dimensions must be constant.
Please do scala next!
Can I suggest R? It seems to be gaining traction in Google Courses, EdX, Uni, Etc. It'd be good to get a high level overview of the langugage that can be used to summarize it for business, friends, family, etc
You know you're balling if you have your own TPU
Imagine I tell the interviewer I have 100 seconds of experience in JAX
Good to see its not just JS languages in the merry-go-round
My brain too smooth, what are you talking about?
"i invented a new hyper parallel execution language!"
new or shading language?
"shading language"
Automatic differentiation is fascinating
Hoped to get some tips on top lane
1) Always keep track of jungler pathing.
2) Freeze lane when ahead, even if the opponent does not contest and thus does not die, the gold and xp lead from the minion is enough to snowball.
3) Death timers are very low until level 7, don't greed a plate if a takedown is taken, you will lose in tempo and therefore reduce the advantage from the kill.
4) If opponent roams, hard shove then follow up if action not ended. Best case scenario the roams does not connect and opponent will lose wave. Worst case scenario, the roam is successful but as the lane is under the opponent tower, they can neither base nor push for plates, therefor the play is even in tempo even if it is losing in gold/xp.
That's exactly the thing I needed lol, thanks a lot.
I saw the title and thought it was going to be on Jax-RS. I'm glad it wasn't!
The most understandable 100 seconds ever
tfw you realize 100 seconds videos aren't actually 100 seconds long
How can we differentiate between Jax and Numpy when it comes to mutating arrays? Could you make a video explaining this further and diving deeper into the differences? Can you dive deeper into RWA altcoins in future videos?
JAX actually stands for "Just After eXecution" according to the original white paper
You know it's a sponsored video, when there is no flat earth.
This sounds extremely similar to pytorch, tensorflow, keras and the likes. I'm surprised I haven't heard of it by now. Anyone here on the internet have any ideas why is it less known? Maybe it's a latecomer?
its pretty well used for machine learning in the scientific community. Jax probabiliy has the best api in terms of writing pure functions and transforming them into functions that returns gradient's or hessian. For that reason, one can write code just like writing an equation, which is well appreciated by the scientific community..
Just about time I add it in my CV
My math and CS degrees allow me to understand everything you just said without really knowing how to put it to good use.
Thanks Fireship, this library will definitely accelerate the development of my nuclear warhead!
normally, i feel a tad bit smarter after watching every one of these videos. this is one of the few ones that makes me realize how little i know and how much of a dumb-ass i really am.
A must like video, due to your effort to research this type of content, keep that good work
The only in 100 seconds without "Hi mom"
This is te best youtube channel on the internet. I just wish youtube wasnt censored so i could expresshow much I enjoy the content
Who else is proud of our little Jeff for graduating to a brilliant sponsorship?
Thought this was a TADC compilation video, but I'll take this instead
Finally something I’ve used in this channel :)
Two autos on minions, q, aa, w reset, e , aa till death. There jax in two sentences.
Ends @ 2:50
My head is exploding like a nuclear mushroom cloud after this one
I have 20 years experience in JAX and I must say I love it
Wasn't Jax a character in mortal kombat?
I have a 30 day streak in brilliant, and I can confirm is really useful
Jax seems really cool.
There is an error for mushroom example with array, it's a 3 elements array but you try to get arr[3], je gradient is [60., 4., 3.]
The linear algebra field going to the moon with this one
I don't understand anything you say, but I love watching these videos anyway.
its about time for another 100 seceonds
You videos with Brilliant sponsorship are max quality ser.
common W fireship vid
i love the 100 seconds series lol
I've been programming for 15 years and I understood some of these words...
How you edit your videos? . It was an amazing edit And which platform do you use for such arrows and animantions .
I played this out loud to impress my family
That logo is sickly designed
Thanks for the video mate now I can add JAX to my resume
oooh how much I have to learn.
Is this just giga chad MATLAB? Was my first year compute physics course useful after all?
Really want to see how impoved versions of KANs wil perform using JAX
I understood nothing mathematically. But this video was great.
So, essentially newer and better tensorflow
i thought this will be combos for jax
as a math student learning java I can confirm I have ten year experience in JAX
damn everything was so good until the end advertisement lol
Thanks to Fireship, my GPU keep me warm at night.
"Imagine"... stop it right there. I'm lost.
Those who didn't come from Tiktok, are allowed to like this comment.
Who df would come from TikTok?
The video dropped 2 fucking minutes ago
Skibidi toilet?
what is Tiktok :)
Lets get out of this schrisophobia of social media and embrace❤