Tensors for Neural Networks, Clearly Explained!!!

Поделиться
HTML-код
  • Опубликовано: 29 окт 2024

Комментарии • 275

  • @statquest
    @statquest  2 года назад +13

    To learn more about Lightning: github.com/PyTorchLightning/pytorch-lightning
    To learn more about Grid: www.grid.ai/
    Support StatQuest by buying my book The StatQuest Illustrated Guide to Machine Learning or a Study Guide or Merch!!! statquest.org/statquest-store/

    • @THEMATT222
      @THEMATT222 2 года назад +1

      Oh ok 👍

    • @rskandari
      @rskandari Год назад +1

      Can you please do a video on transformers?

    • @statquest
      @statquest  Год назад +1

      @@rskandari I'm working on one.

  • @kousthabkundu1996
    @kousthabkundu1996 2 года назад +116

    I almost quit understanding cnn with the fancy jargons all over the internet. After watching your playlist, you gave me ray of hope. You are freaking genius of explaining things in simplicity. hope to see your playlist with advance cnn topics (object detection, semantic segmentation and siamese network). Thank You 3000

    • @statquest
      @statquest  2 года назад +8

      Glad I could help!

    • @albertd7658
      @albertd7658 4 месяца назад +2

      Oh yea it would be very helpful to have videos with the advance topics!

  • @jinyunghong
    @jinyunghong 2 года назад +109

    Me reading ML papers and finding tensors: Ugh
    Me watching StatQuest and finding tensors: Triple BAM!!!

  • @raven-888
    @raven-888 Год назад +43

    "Mathematicians and machine learning people define tensors in different ways".
    This one sentence made a world of difference for my learning.
    May be it's just me; but I can't thank you enough.

    • @statquest
      @statquest  Год назад +1

      Thank you! :)

    • @maryama7430
      @maryama7430 Год назад +2

      ​@@statquest Thanks man. Most statements you made really were eye openers in this field. Thank you again.

  • @RezaSalatin
    @RezaSalatin 2 года назад +30

    You rock! I learned much more from your series in NN in 3 days than sitting in a machine learning class for one semester!

  • @alexandruianosi8469
    @alexandruianosi8469 Год назад +8

    I thought that I understood ANN, but now I feel that everything is so much more intuitive. Thank you!

  • @reinasama904
    @reinasama904 2 года назад +17

    I can't thank you enough sir, this is so well explained i'm almost crying. Thank you so much for your efforts I'll definitely buy some of the study material you offer when I will be able to.

  • @jamm9848
    @jamm9848 2 года назад +26

    So excited I’ve been trying to understand tensors can’t wait 🥳

  • @عبدالباسطعبدالصمد-ن6ش

    The best channel I've ever seen for data science ❤️

  • @doctor_no_
    @doctor_no_ Месяц назад +1

    Thank you! As a physicist I was originally confused by tensors in neural networks. Great video. It'll be cool to include some tensor manipulations in this video or a future one :)

    • @statquest
      @statquest  Месяц назад

      Thanks! My videos on coding in PyTorch show tensors in action: statquest.org/video-index/

  • @atlantaguitar9689
    @atlantaguitar9689 2 года назад +9

    Cool. I just gave a lecture today on how to do linear regression with Pytorch using basic tensor operations. I'm sure your presentation will be great!

  • @annapeng88
    @annapeng88 2 года назад +2

    Finally I am not confused as I did not know ML tensor is different from the tensor in maths (even though I still don't know how GPU works)! Thank you!!!

  • @endunry
    @endunry 2 года назад +1

    I have a cs study project aboug GNNs and was looking up Tensors. And i was hit by the agony of Tensors in the Context of deep mathematics and physics. The moment i open a CS Video about Tensors im met with music and good vibes

  • @hrithiklanghi6418
    @hrithiklanghi6418 2 года назад +1

    Just got video at the right time and I already kniw after seeing this video i will have my concepts cleared

  • @innovativehacker3769
    @innovativehacker3769 Год назад +2

    You are the best teacher on my list !!

  • @nagham96
    @nagham96 11 месяцев назад +2

    Thank you very much for all the effort you put into your presentations! and thank you for making it as fun, simple and useful as possible! You're the best dude out there! 💘💘

    • @statquest
      @statquest  11 месяцев назад +1

      Thank you very much!

  • @thuanlyhoang9872
    @thuanlyhoang9872 2 года назад +2

    This is what I am waiting for BAM!!!

  • @subodhacharya3955
    @subodhacharya3955 2 года назад +1

    Very well explained with those interesting pictorial representations of inputs, activation functions, and all.

  • @tagoreji2143
    @tagoreji2143 2 года назад

    Simple and nice Tutorial Professor. But,
    Expected an In-depth and more ComprehensiveTutorial about Tensor.
    Thank you Professor.

  • @mattkriese7170
    @mattkriese7170 Год назад +1

    Subbed. I need more StatQuest in my life.

  • @abhinavsingh4052
    @abhinavsingh4052 2 года назад +2

    Whoaaa!
    That is a very clear and fun explanation, never learned like this.
    Feeling Blessed
    [Edit: This Guy is seriously Under Rated]

  • @exxzxxe
    @exxzxxe Год назад +1

    I am in a bit of a quandary- trying to decide, of your skills, which is superior: you skill as a singer or your skill as a teacher of Machine Learning!

    • @statquest
      @statquest  Год назад

      bam! :)

    • @exxzxxe
      @exxzxxe Год назад +1

      @@statquest I should add; both skills are extraordinary!

    • @statquest
      @statquest  Год назад

      @@exxzxxe You're too kind!

  • @majormickey9806
    @majormickey9806 2 года назад

    Loved it. Great vid. An ML explainer I can actually understand. Exciting, such BAM! Gonna watch everything else next. I should take your ML course, I assume you have one -- with exercises and such?

    • @statquest
      @statquest  2 года назад

      I don't have a course yet. I hope that one day I will. :)

  • @ChocolateMilkCultLeader
    @ChocolateMilkCultLeader 2 года назад +1

    Me everytime Josh uploads: YIPPEEEEE

  • @mahesh1234m
    @mahesh1234m 2 года назад +10

    Very well explained as usual. Can we have one video for Automatic Differentiation also please?

    • @statquest
      @statquest  2 года назад +4

      I'll keep that in mind.

  • @hamman_samuel
    @hamman_samuel 2 года назад +1

    Everyone: Darth Vader is the greatest villain to Luke Skywalker's hero
    StatQuest: Bam, meet Ugh

    • @statquest
      @statquest  2 года назад

      Exactly! BAM vs ugh....

  • @ayeshavlogsfun
    @ayeshavlogsfun 2 года назад +1

    Thanks for sharing after a Long time

  • @positivefreedom
    @positivefreedom 2 года назад +1

    I am in love with tensors after seeing your video🤣

  • @BillHaug
    @BillHaug Год назад +1

    perhaps a top 3 jingle, I really enjoyed it. Even with time to reflect, I am going with: 1) Statquest, its bad to the bone; and 2) were going to do a lot of maths step by step by step... statquest ...the bangers

    • @statquest
      @statquest  Год назад

      This is definitely one of my favorites. I also really like this one: ruclips.net/video/azXCzI57Yfc/видео.html

  • @karddoespiano2300
    @karddoespiano2300 2 года назад +1

    I literally needed this

  • @_epe2590
    @_epe2590 2 года назад +7

    It would be great if you did a video covering automatic differentiation next!

  • @zhou6486
    @zhou6486 2 года назад +1

    looking forward to more fancy topics in Deep Learning. Btw, thanks for sharing.

  • @funsupervised
    @funsupervised 2 года назад +1

    Subscribed just for that intro

  • @nikolakalev4914
    @nikolakalev4914 Год назад +1

    Thank you for this really good explanation!

  • @markmalkowski3695
    @markmalkowski3695 2 года назад +4

    Your videos are great!! I just saw your video on decision trees and you explained the concepts so clearly, I immediately subscribed.
    Would you ever go over Patient Rule Induction methods (PRIM)? It seems like a really interesting algorithm in OLAP contexts, but all I really see of it are complicated, math-notation-heavy white papers and patent applications that tweak the original to be more efficient (but use their own made up lexicon to describe it).

    • @statquest
      @statquest  2 года назад +1

      I'll keep that in mind.

  • @jawadmansoor6064
    @jawadmansoor6064 2 года назад +1

    I liked the intro.
    Tensormaster!

  • @mPajuhaan
    @mPajuhaan Год назад +1

    Very interesting way to teach :)

  • @girirajtomar519
    @girirajtomar519 Год назад +1

    You are amazing bro ! Thanks for the amazing vidoes.

  • @valentinthonen7120
    @valentinthonen7120 2 года назад +2

    I love your videos about neural networks, could you also make some videos about policy gradients, which tend to be nice for continuous data.

    • @statquest
      @statquest  2 года назад

      I'll keep that in mind.

  • @adrianwalchli8407
    @adrianwalchli8407 2 года назад +2

    Uhhahah, boxes with numbers inside🤗. Very exciting!! They come in different colors, right? 🤩

    • @statquest
      @statquest  2 года назад

      Ha! Of course!!! BAM! :)

  • @superk9059
    @superk9059 2 года назад +2

    Sorry, Mr.Josh, I can't watch the premiere, because my area is 01:00 at that time😂😂😂 I will definetly watch the video the 2nd day🤔🤔🤔👍🏻👍🏻👍🏻

  • @LindyXLindy
    @LindyXLindy 2 года назад +1

    I live for the guitar intro and BAMs

  • @vedachintha
    @vedachintha Год назад +4

    Sir, you have taught me more in few videos than my Professors did in 1 full year. I am ever grateful to you.
    Also, could you please do more videos on Tensor flow (theory part e.g., eager/graph execution, name scopes, placeholders etc.)?

    • @statquest
      @statquest  Год назад +1

      I'm doing PyTorch right now if you are interested in that. Just search for PyTorch on this page: statquest.org/video-index/

  • @mohammadidreesbhat1109
    @mohammadidreesbhat1109 Год назад +1

    BAM, BAM, BAM, BAM..................BAM.. Great Sir

  • @souravdey1227
    @souravdey1227 2 года назад +1

    Sir, please continue this series on Tensors. Especially tensor factorization.
    Please.

    • @statquest
      @statquest  2 года назад +1

      I'll keep that in mind!

  • @rusundevelopment7674
    @rusundevelopment7674 2 года назад +1

    StatSquatch is totally awesome!

  • @dosadoodle
    @dosadoodle 2 года назад +5

    Why such a long delay from the time this video is posted to time it is actually available? A full week seems excessive...

    • @statquest
      @statquest  2 года назад +2

      This is the first time I've even tried doing a Premiere so I have no idea what the normal procedure is. How long do people usually have to wait? I picked a week out simply I thought 1) it would be fun to try a premiere (since I've never done one before and want to see what it is like) and 2) I'm all booked until a week from today. Would it be better to not announce the video/premiere until later this week?

    • @dosadoodle
      @dosadoodle 2 года назад +5

      @@statquest I'd suggest 4-24 hours between upload and the release time, maybe up to 48 hours for a major event release. The reasons it is awkward to set a longer delay:
      1) For people who get notifications, unless it is a premiere for an unusually important video that they should indeed be looking forward to as an event, it can be annoying to get notified about something that can't be watched for multiple days.
      2) The video gets added to the Subscriptions feed right away (as a Premiere), even though it isn't watchable until the date. So it just sits there cluttering the feed. This can have two effects: (a) For people who hide videos after they've watched them in this feed, it's tempting to just hide the video if it is sitting there for too long. (b) And for those that don't use the "hide" feature, the video will also be buried by the time it goes live even if it is resurfaced at the release. In this second case, the value of the Premiere is largely lost, because the reminder was buried under a bunch of other videos for several days, so the value of a reminder via Premier doesn't do much good.
      That's my line of thinking anyways.

    • @statquest
      @statquest  2 года назад +1

      Awesome!!! Thanks for the tips!!! I really appreciate it. I'll keep this in mind for the next Premiere that I do.

  • @nafisahmed6247
    @nafisahmed6247 Год назад +1

    Thank you, i was about to leave this planet because of the wonderful people who are given the task to teach students about ML but cant teach a thing and give zero when they fail eventually.

  • @aayushjariwala6256
    @aayushjariwala6256 2 года назад +2

    Hoping that you are gonna make a series on CNN from this video🤞

    • @statquest
      @statquest  2 года назад +2

      I have a video on CNNs here: ruclips.net/video/HGwBXDKFk9I/видео.html however, in the future I plan on more applied videos that show how to do it in PyTorch-Lightning.

  • @Pedritox0953
    @Pedritox0953 2 года назад +1

    Excellent video!

  • @jimparsons6803
    @jimparsons6803 Год назад

    Interesting. Thanks. I come from manifold/engineering point of view. Which turns out to be a useful mental tool for some sorts of chemistry. Y' have to imagine, often, how some sorts of molecules interact. Using or having a background in manifold or Linear Algebra, turns out an excellent adjunct. Who knew? I thought that the maths were just a lot of fun at the time.

  • @KorawichKavee
    @KorawichKavee 7 месяцев назад

    Great video. I dont see that tensors in math and physics are somehow different from Ml, though, because they are still the same tool, just with different applications. You still even have Einstein's summation notation (Einsum).

  • @iliasaarab7922
    @iliasaarab7922 2 года назад +3

    Super excited for this one!

  • @Antz_411
    @Antz_411 Год назад

    Little slow, but great explanation.
    Thanks!

    • @statquest
      @statquest  Год назад

      Thanks!

    • @Antz_411
      @Antz_411 Год назад +1

      @@statquest No no, thank you!!
      At 1.25 speed it was awesome!

    • @statquest
      @statquest  Год назад +1

      @@Antz_411 1.25xBAM!!!

  • @izzatulummah1594
    @izzatulummah1594 Год назад

    Hi Josh! Thank you for all your amazing videos! Can you make a video about Graph Neural Network? Thanks a lot!

  • @TheLeoPoint
    @TheLeoPoint 2 года назад

    😆let's go ,I think I can't able to sleep well tonight ,i need at least 3 day to proper classification n get command on it , but as always it's really help me a lot to clear my all the doubts n confusion 💥 💥 double bam 😄 👍

    • @statquest
      @statquest  2 года назад

      :)

    • @TheLeoPoint
      @TheLeoPoint 2 года назад +1

      @@statquest thanks from bottom of my heart sir lots of ppl getting skills base quality knowledge 🙏👍

  • @HIKARIC-fv2pw
    @HIKARIC-fv2pw 4 месяца назад +1

    the song is really awesome

  • @KritiAlam
    @KritiAlam 5 месяцев назад +1

    Multiple bams!!
    Thats so easily bammed to me now!!

  • @TurbidSugar19
    @TurbidSugar19 2 года назад +1

    Tensors for students, their mamas and papas
    Tensor for breakfast and thoose whos from Belfast
    Bim para bam bom paw...
    StatQuest ! 💘

    • @statquest
      @statquest  2 года назад

      That's awesome!!! :)

  • @hellochii1675
    @hellochii1675 2 года назад +2

    9:02 shameless self promo -> proudly self promo 😆 😆 😆

  • @BooleanDisorder
    @BooleanDisorder 8 месяцев назад +1

    This was tense 😊

  • @charitarthchugh
    @charitarthchugh 2 года назад +2

    BAM!

  • @BillHaug
    @BillHaug 2 года назад +1

    Another banger

  • @xyZenTV
    @xyZenTV 2 года назад +1

    I would really love it if you could do a video on Projection Pursuit Analysis, since there aren't any great videos explaining the statistical underpinnings. Thanks for the excellent content as always!

    • @statquest
      @statquest  2 года назад

      I'll keep that in mind.

  • @THEMATT222
    @THEMATT222 2 года назад +1

    Ooo0Oooo very exciting!

  • @tomoki-v6o
    @tomoki-v6o 2 года назад +2

    Automatic Differentiation

  • @niceday2015
    @niceday2015 2 года назад +1

    Bam! Tensor is flowing

    • @statquest
      @statquest  2 года назад

      Ha! you made me laugh! :)

  • @davidj9977
    @davidj9977 Год назад

    "Tensor cores are processing units that accelerate the process of matrix multiplication", so then we're calling them Tensors instead of Matricies, so we can use Tensor cores, which multiply matricies. Makes sense.

    • @statquest
      @statquest  Год назад

      Unfortunately Neural Networks have lots of terminology along these lines.

    • @andrewdunbar828
      @andrewdunbar828 Год назад

      Well tensors are generalized matrices not limited to two dimensions to matrices so just as 2D concepts are useful in our 3D world I'm assuming matrix operations are useful in tensors.

  • @PritishMishra
    @PritishMishra 2 года назад

    Nice video... btw any plan on making videos on transformer neural networks and attention?

  • @jeffersonmcgee9560
    @jeffersonmcgee9560 Год назад

    My only question is: Why can tensors run in gpus? I've been trying to find information on it for the longest time and still found nothing.
    Why can't numpy arrays be stored in GPU?
    Thanks in advance!
    PS: Thanks to statquest, I was able to pass my data science class!!

    • @statquest
      @statquest  Год назад

      GPUs have their own instruction set, which is different from what you find on a standard GPU, so you have to code for that specifically. For details, see: en.wikipedia.org/wiki/CUDA

  • @quantumboss500yearsago2
    @quantumboss500yearsago2 Год назад

    The simple explanation is that a tensor is something that transforms like a tensor

  • @sallu.mandya1995
    @sallu.mandya1995 2 года назад +1

    thanks

  • @gama3181
    @gama3181 2 года назад +1

    Ugh math ? Anti-BAM!!!
    Awesome explanation :) !!
    I'm biologists and used to think that tensors in math and ML are the same ! Anyone knows how to think them ?

    • @statquest
      @statquest  2 года назад +1

      The tensors from math have specific mathematical properties that are completely ignored by people that do neural networks.

    • @gama3181
      @gama3181 2 года назад +1

      @@statquest thank you Josh :)

  • @LuizHenrique-qr3lt
    @LuizHenrique-qr3lt 2 года назад +1

    RNN, NLP and word embedding pliss !!! Tkss!!!

    • @statquest
      @statquest  2 года назад +1

      I'm working on them.

  • @Vessel__02
    @Vessel__02 2 года назад +1

    Would you be able to make a video on how tensors support automatic differentiation?

    • @statquest
      @statquest  2 года назад

      That's a good idea. I'll keep that in mind.

  • @DanjasLP
    @DanjasLP Год назад

    So Tensors are basically just faster matrices?
    And also, is there a difference between tensors and safetensors when talking about image generation AI?

    • @statquest
      @statquest  Год назад

      Tensors also have automatic differentiation. And, as far as I can tell, "safetensor" is a way to store tensors on disk that comes with some nice features, like not having to load the entire file into memory in order to inspect the values.

    • @DanjasLP
      @DanjasLP Год назад

      @@statquest Ahh okay, I think I got it now :) Thanks a lot!

  • @shamsulazhar
    @shamsulazhar 2 года назад +1

    Oh wow! He's gone heavy metal now.

  • @DarioOliveri
    @DarioOliveri 7 месяцев назад

    Hi, I Need a more Advanced video about tensors... The feed forward step can be written as g(Wx+b) where W is square weights matrix, x is the input vector, b is the bias and g the activation function.. now. What if x is not a Vector, but Is a Matrix or a cube? I Need the generalized algorithm for feedforward step. There Is no place on the internet with that algorithm. Thank you

    • @statquest
      @statquest  7 месяцев назад

      I'll keep that in mind.

  • @sxx2491
    @sxx2491 Год назад +1

    once again, saved my ass

  • @HardFault0x00
    @HardFault0x00 2 года назад

    Sooo, tensor is array or ndarray with extra properties for storing neuralnet weights and bias?

    • @statquest
      @statquest  2 года назад

      Yes, and they store your data so that you can take advantage of hardware acceleration and automatic differentiation.

    • @manujarora5062
      @manujarora5062 Год назад

      Indeed tensors are also storing inputs and output values.

  • @bahayesilyurt9433
    @bahayesilyurt9433 2 года назад +3

    they be creating tension. thas it

  • @fatihozgurardc310
    @fatihozgurardc310 2 года назад

    Waiting for vanishing and exploding(BAMMM) gradients!

  • @gbchrs
    @gbchrs 2 года назад +1

    exciting 😆

  • @HakikatBirSinghBhatti
    @HakikatBirSinghBhatti 2 года назад +1

    Bamm !!!

  • @vic11du06
    @vic11du06 2 года назад

    I have a Deep Learning exam in two days, so thanks I guess

  • @kuntalnr
    @kuntalnr 2 года назад +1

    I love you

  • @muhammedyavas5765
    @muhammedyavas5765 Год назад

    I think that would be awesome for GRU units and we can compare with LSTM. Please !!!

  • @creativeprojectsmaker6113
    @creativeprojectsmaker6113 Год назад +1

    triple bam,!!!!!!!!!!

  • @THEMATT222
    @THEMATT222 2 года назад +2

    Noice 👍

  • @alexandrsoldiernetizen162
    @alexandrsoldiernetizen162 2 года назад

    This guy sounds like Mr. Garrison from South Park.

  • @JapiSandhu
    @JapiSandhu 2 года назад +1

    BAM

  • @Ilemaurice687
    @Ilemaurice687 2 года назад

    Hello this one is homework
    Question:
    To examine the bone mineral density of women with ankle fractures, the investigators recruited 10 postmenopausal women with ankle fractures and 12 healthy postmenopausal women to serve as controls. The stiffness index of the lunar Achilles in each woman was obtained. The mean stiffness index for the ankle fracture group was 76.4 with a standard deviation of 5.83. In the control group, the mean was 82.3 with a standard deviation of 6.34. Assume that both samples are drawn from normal populations.
    (i) Test at 5% level of significance, whether the variances of the stiffness
    indices for the two groups are equal.
    (ii) Using p-value approach, examine whether these data provide sufficient
    evidence to conclude that, in general, the mean stiffness index is higher
    in healthy postmenopausal women than in postmenopausal women
    with ankle fractures? Take a=0.05
    (iii) Obtain a 95% confidence interval for the difference of two population
    mean stiffness indices. Does this interval confirm the conclusion derived
    in part (ii).

    • @statquest
      @statquest  2 года назад

      If you want help with homework, you should post to some of the stats channels on Reddit. Those people are super helpful! BAM!

    • @Ilemaurice687
      @Ilemaurice687 2 года назад

      @@statquest what name is the channel ple

    • @Ilemaurice687
      @Ilemaurice687 2 года назад

      @@statquest please

  • @HAWk2k25
    @HAWk2k25 2 года назад

    Could u also make one for the assumptions of linear and logistics regression

    • @statquest
      @statquest  2 года назад +1

      I'll keep that in mind.

  • @grabbenskarve3518
    @grabbenskarve3518 2 года назад

    Could you do a video about "Bach training", or what it is called :), and how all partial derivatives are handeld in those situations? For example if they are added into a sum, or that the average derivative is calculated.

    • @statquest
      @statquest  2 года назад

      For details on "batch training" see my video on Stochastic Gradient Descent: ruclips.net/video/vMh0zPT0tLI/видео.html Also, whether or not we add or average the derivatives depends on the loss function. If we use the Sum of the Squared Residuals, we simply add. If we use Mean Squared Error, we use the average.

    • @manujarora5062
      @manujarora5062 Год назад

      @@statquest not clear about what you mean by adding the derivatives.
      Are you referring to adding the derivative to weight/ bias ?

    • @statquest
      @statquest  Год назад

      @@manujarora5062 For each data point, we calculate the derivative. We can add them, or we can average them. For details, see: ruclips.net/video/sDv4f4s2SB8/видео.html

  • @Byyaroff
    @Byyaroff 2 года назад +1

    BAMM!!!

  • @Spectacurl
    @Spectacurl 2 года назад

    As a physicist, now I'm very confused

    • @statquest
      @statquest  2 года назад

      Yes, for Physics, tensors are a little more than just fancy data structures that are optimized for high speed computing.

  • @somyaagarwal2942
    @somyaagarwal2942 7 месяцев назад +1

    NOOO MATH IS NOT UGHH, ITS AWESOMEEEE

  • @Charles-tw4qs
    @Charles-tw4qs 2 года назад +1

    💋

  • @younesselhamzaoui6783
    @younesselhamzaoui6783 2 года назад

    Thank you. HOWEVER, NO ENOUGH EXPLANATION. I'D LIKE TO ASK YOU TO THIS TUTORIAL WITH MORE DETAILS AND VERY SLOW! PLEASE

    • @statquest
      @statquest  2 года назад

      I'll keep that in mind.

  • @PriyanshuSingh-hm4tn
    @PriyanshuSingh-hm4tn Год назад +1

    goood