Nuts and Bolts of Applying Deep Learning (Andrew Ng)

Поделиться
HTML-код
  • Опубликовано: 29 окт 2024

Комментарии • 173

  • @caitlynj7466
    @caitlynj7466 4 года назад +60

    He’s truly energetic! Campaigning during day time and teaching programming at nights. Respect!

    • @keithcayden5028
      @keithcayden5028 3 года назад

      pro tip : watch movies on kaldroStream. I've been using it for watching loads of movies lately.

    • @kennethnicholas5938
      @kennethnicholas5938 3 года назад

      @Keith Cayden Yup, been using kaldroStream for since november myself :)

    • @waynefrancis5843
      @waynefrancis5843 3 года назад

      @Keith Cayden Definitely, been watching on KaldroStream for since december myself :D

    • @vivaanalbert6643
      @vivaanalbert6643 3 года назад

      @Keith Cayden definitely, I have been using kaldroStream for since november myself =)

    • @dariuschong4574
      @dariuschong4574 2 года назад +3

      I can't tell if this is a joke or you're confused between Andrew Yang and Andrew Ng XD

  • @NithinVasisth
    @NithinVasisth 8 лет назад +48

    Such an amazing talk, and he kept it so simple. You cannot help but admire this guy.

  • @atlantis_expedition_member4747
    @atlantis_expedition_member4747 8 лет назад +186

    We definitely need another online course from Andrew Ng. His course on Coursera is the start of many many people into machine learning. I hope that he at least update his course.

    • @jasonwu1769
      @jasonwu1769 8 лет назад +37

      Andrew's machine learning on Coursera is one of the best courses, online or in classroom, I've ever taken.

    • @JoseLaruta
      @JoseLaruta 7 лет назад +5

      you're right, his course was like the initial kick for me in this amazing world of machine learning, could you imagine one with deep learning, gpu optimization and IoT?

    • @LubaNikit
      @LubaNikit 7 лет назад +2

      this is exactly what I have been thinking about today

    • @alexandra-stefaniamoloiu2431
      @alexandra-stefaniamoloiu2431 7 лет назад +4

      The world needs a deep learning course taught by him.

    • @luvsuneja
      @luvsuneja 7 лет назад +3

      I am doing the ML course right now. Really loving it.

  • @elamirino8261
    @elamirino8261 8 лет назад +38

    HE has taught me so much on Machine Learning. We all owe him :)

    • @kumarsen88
      @kumarsen88 7 лет назад +5

      I think he is the starting point of everybody of our generation, studying Machine Learning. The books of Tom Michell or Christopher Bishop were of no help to me atleast. :P

  • @xXxBladeStormxXx
    @xXxBladeStormxXx 8 лет назад +9

    Oh man! I had forgotten just how good Andrew was, but after watching this video I've been reminded thoroughly of that fact. It's been so many years since I took his intro class on coursera, but boy! He still got it!

  • @physiophile
    @physiophile 7 лет назад +1

    Andrew Ng is such an inspiring mentor. At the same time, I find it incredible that he gives practical and down-to-earth suggestions -- such as the ones he gave out toward the end of this talk. Only a sincere man who knows his field deep is able to do this.

  • @whizyoga
    @whizyoga 6 лет назад +1

    Hereby I declare myself as the biggest fan of Ng. He has this amazing capability of simplifying the most complex equations. Hats off to you sir. !!

  • @pumplove81
    @pumplove81 7 лет назад +4

    this man is pure genius..so well spoken ..i hung on to every word and was blown away ! fan boy now ..more Ng classes please :D

  • @lykiamusic
    @lykiamusic 6 месяцев назад

    finding your channel back in the day changed my life. thanks Lex.

  • @rameshm2485
    @rameshm2485 8 лет назад +10

    Andrew Ng is the best at teaching us machine learning , deep learning all the stuff. GURU

  • @priyankbhardwaj902
    @priyankbhardwaj902 8 лет назад +1

    Soft voice, the ability to convey in simple terms to masses, openness. Awesome Guy

  • @rikenm
    @rikenm 7 лет назад +21

    He seriously needs to create a DL Coursera course. PLZZZZ. You are the best professor I have ever had. We all hope you create a new course. Thank you.

    • @MichaelCastillo1
      @MichaelCastillo1 7 лет назад +6

      He just did. It's even better than his original Machine Learning course. deeplearning.ai

    • @sksqhubham
      @sksqhubham 6 лет назад +2

      He did. Part 3 of the deeplearning.ai course is exactly this talk.

    • @believer8754
      @believer8754 2 года назад

      @@sksqhubham is this open source ?

  • @DylanHogg
    @DylanHogg 7 лет назад +3

    This section is great: Importance of understanding bias/variance, especially with train/train-dev/dev/test datasets at 49:48 including Ng's workflow for how to address various issues.

  • @hardboyz4400
    @hardboyz4400 4 года назад +1

    Andrew Ng looks so much like Andrew Yang.
    Soft voice, the ability to convey in simple terms to masses, openness. Awesome Guy
    Thank you for the upload :)

  • @BikashDebnath
    @BikashDebnath 7 лет назад +9

    Mr. Andrew Ng inspired me to get into Machine Learning. He now inspired me to get into Deep Learning. Simple!!

  • @vaibhavkumar38
    @vaibhavkumar38 4 года назад

    Respect for Andrew Ng... so much knowledge made available free of cost to all of us. Done a tremendous job to bridge social inequality to make knowledge (almost) equally available to the students and professionals alike.

  • @dadecountyboos
    @dadecountyboos 3 года назад

    understanding & tuning of bias variance between stages is my big takeway from this (not to detract from any part...) this was an incredible lecture.

  • @jamesteow36
    @jamesteow36 7 лет назад

    Such an inspirational and humble speaker. Thank you so much for uploading this.

  • @viviand73
    @viviand73 5 лет назад +109

    Andrew Ng looks so much like Andrew Yang.

    • @blasemmanuelvillarino1754
      @blasemmanuelvillarino1754 4 года назад +8

      I was expecting this kind of comment lol

    • @shadman_rafi
      @shadman_rafi 4 года назад +12

      He is basically Andrew Yang without the "Ya" 😂

    • @Stwinky
      @Stwinky 4 года назад +5

      not really just both asian lol

    • @whitesalmon0925
      @whitesalmon0925 4 года назад +1

      I am curious about what were the genes that make them very influential individuals.

    • @curtisswarhawk539
      @curtisswarhawk539 3 года назад

      They are actually 2nd cousins

  • @nitinkandpal9991
    @nitinkandpal9991 7 лет назад

    Great great lecture. When ever i see any video of Andrew sir I get very excited for ML.

  • @sabr9906
    @sabr9906 7 лет назад +16

    Andrew Ng is my ML sensei

  • @matveevtam
    @matveevtam 8 лет назад +3

    Such an amazing video! Made me finally clear about bias/variance and also higly motivating.

  • @tb7220
    @tb7220 7 лет назад

    What a great man show (y)... I love this voice .. I have already gone through various video of Mr .Ng during machine learning course.. his voice inspired me do to lot in AI...

  • @ImtithalSaeed
    @ImtithalSaeed 6 лет назад +17

    We are all in debt to Andrew Ng

  • @gautamkarmakar3443
    @gautamkarmakar3443 7 лет назад

    I can say humbly, that if we even understand 10% what he is saying we will be able to open a startup that is going to be successful or we can develop a moderately complex deep network from scratch. One of the top figure in DL and AI who means business.

  • @MsFearco
    @MsFearco 4 года назад

    4 years later this content got through me- deep learning is still not good enough :)
    Your content is great Lex.

  • @triathloninspired
    @triathloninspired 8 лет назад +1

    Very motivating statements in the last few minutes. Thanks a lot for uploading.

  • @ilyasaroui7745
    @ilyasaroui7745 7 лет назад

    who dislikes this video !! this man is literally an awesome person !!

  • @microdrone
    @microdrone 6 лет назад +1

    Ingenious, very comprehensive grasp of the subject

  • @binghuiwang6347
    @binghuiwang6347 8 лет назад +2

    Very amazing talk.. Words are simple but profound. Provide us the methodology to understand and learn to understand machine learning.

  • @MaheshKumar-iw4mv
    @MaheshKumar-iw4mv 5 месяцев назад

    Amazing talk! He is a researcher one can look up to! ❤

  • @stringph
    @stringph 7 лет назад +4

    I missed how the use of end-to-end DL for speech recognition 'proves' that phonemes don't exist. Maybe it just means the DL algorithm had an internal representation of something like phonemes?

  • @szuh1
    @szuh1 7 лет назад

    READER DIGEST: Prof. Andrew Ng, (a psychologist, prof. of Stanford CS Dept & Chief Sci. of Baidu), gave an excellent and sequential review in Sep 27 2016 in the traditional marker & white board fashion about "Nuts & Bolts of Applying Deep Learning".
    He has summarized excellently three saturation curves for a small, a medium, and a big architectures of ANN's respectively upward.
    Furthermore he has summarized current algorithms in four buckets: traditional deep learning (DL), Reinforcement learning, Convolution NN for images, and the unsupervised DL, ICA, etc.
    He goes on to comment on the phonemes for speech processing (NB: He has dedicate RUclips on speech) and other applications of machine learning.
    His gave excellent error analysis, e.g. from human 2%, data 5%, bias %, multiple variances, etc at the level of training set, or develop set over fitting or under fitting are quite insightful,before you blame the machine learning.
    Also, He recommend to build a unified data warehouse is a necessary preparation for novice, He went on to address the complicate exemplar, e.g. 30K hours training set and 10 hours development (for generalization) and test
    This part of experience could perhaps augment DL error analyses with what a NIH called Double Blind with Negative Control (DBNN)statistical analysis adopted in medical community .
    While Internet Coursera can be stopped and re-run until one fully understood; but one can not do that in a real time lecture.

  • @stevenliu4592
    @stevenliu4592 7 лет назад

    Thans for sharing. This talk is full of insights and best practices. But its word is very simple and concise.

  • @gilbertobatres-estrada5119
    @gilbertobatres-estrada5119 8 лет назад

    Thanks a lot for the upload, I learned many good practices on working with DL.

  • @GauravPadawe
    @GauravPadawe 5 лет назад

    The great Andrew Ng.

  • @Scranny
    @Scranny 7 лет назад

    The title of this video is partially misleading. It's *mostly* a general machine learning methodology lecture. Still, it was a great inspiring lecture. Thanks for posting.

  • @jasonwu1769
    @jasonwu1769 8 лет назад

    I'm going to start training the neural networks in my brain on machine learning weekend after weekend for 52 weeks from today on.

  • @arunmrao2
    @arunmrao2 8 лет назад +1

    Thanks for posting - excellent materials for all the speakers - will attend next year !!

  • @赵潜-x2l
    @赵潜-x2l 6 лет назад

    incredible useful and so amazing,one of the best speech I ever heard...

  • @Movewithkhu
    @Movewithkhu Год назад

    15:06 the fact that phonemes n audio to transript is harder than generation of new images

  • @yalmuzique
    @yalmuzique 4 года назад

    Although I am a Bernie guy, I have much respect for Andrew nYang ;)

  • @TheGodSaw
    @TheGodSaw 7 лет назад

    SO many great people working in deep learning. And so many great youtube videos:D

  • @samuisuman
    @samuisuman 7 лет назад +1

    Very nice, neat and clear talk. I always like his lectures. One thing that I wonder is that how one should initialize the number of hidden layers and number of hidden units of a DNN model when we start training. On the internet, there are many notions but I did not find any standard method.

  • @asadrasheed5625
    @asadrasheed5625 4 года назад +1

    I didn't understand at 27:23, if the training error is high then it's mean we are having high bias in training error. Please explain this point a little bit. Thanks

  • @chaozhi3255
    @chaozhi3255 7 лет назад

    太精彩了,andrew老师讲的很有启发性 赞

  • @hunternewberry5860
    @hunternewberry5860 5 лет назад +29

    I didnt know andrew yang was this involved in AI

  • @berdore
    @berdore 8 лет назад +1

    Tks for sharing the videos. These talks are amazing.

  • @krajkumar6
    @krajkumar6 7 лет назад

    great video from Andrew Ng. I particularly liked the closing bit @ 1:10 mins on the advice on how to get good at ML.

  • @peregudovoleg
    @peregudovoleg 6 месяцев назад

    In the middle 1st row, in red shirt (with laptop) is Andrej Karpathy.

  • @krackerslacker
    @krackerslacker 2 года назад

    Thank you Lex!

  • @feraudyh
    @feraudyh 7 лет назад +3

    Thanks for uploading, but I had to don some headphones to make out what he was saying.

  • @TheSzakara
    @TheSzakara 7 лет назад

    What a super dude. Thanks Andrew.

  • @abdullah1924
    @abdullah1924 7 лет назад

    Excellent talk, highly recommend !

  • @jkhongy
    @jkhongy 5 лет назад

    Great Teaching and Thanks for Professor Ng

  • @annawilson3824
    @annawilson3824 2 года назад +1

    How to become a great ML researcher: 1:12:31

  • @Anders01
    @Anders01 4 года назад

    Machine learning looks promising. Still pretty narrow AI but it will be interesting to see if general machine learning is invented soon, maybe not in 2020 but who knows. Exponential progress!

  • @fleXcope
    @fleXcope 7 лет назад

    Looking forward to his next textbook.

  • @masa26762
    @masa26762 6 лет назад

    Very nice practical lecture. About his rule of thumb though, I don't think our doctors decide on cancer image in 1 second. Is he underpromising, over delivering?

  • @kozzuli
    @kozzuli 8 лет назад

    Ty for sharing!! Andrew is great man.

  • @sudharsankrishnaswamy5847
    @sudharsankrishnaswamy5847 6 лет назад +1

    If you are here for some advice on how to build a ML/DL career, start from here 1:10:25

  • @dhankkhush1088
    @dhankkhush1088 2 года назад

    I

  • @ssjiv5610
    @ssjiv5610 8 лет назад +1

    Thank you for the upload :)

  • @Nohandlefool
    @Nohandlefool 4 года назад +1

    Andre Yang going brazy..MATH

  • @varunvermaendless
    @varunvermaendless 5 лет назад

    Amazing talk, but what if the test set is unlabelled will it be still be useful to use some part if it as validation set?

  • @newbie8051
    @newbie8051 Год назад

    One thing that Deep Learning has failed at is transcribing Andrew's lectures. It's not very clear for non-native speakers and the volume does not help at all.
    Understanding the video took me like 8hrs

    • @newbie8051
      @newbie8051 Год назад

      Also I hate that the volume is super low, maybe needs a GAN to improve it's amplitude 💀💀

  • @xxjoeyt07xx
    @xxjoeyt07xx 2 года назад

    God damn, his hand moves so fast when he's writing on the board

  • @DmitryKan
    @DmitryKan 7 лет назад +1

    Andrew mentions "Bigger model". What does it mean? Can a model be made bigger with the same amount of training data?

    • @wayne7936
      @wayne7936 7 лет назад +1

      Yup! The main innovation of DL is the ability to chain together and jointly-optimize computational steps. These are called layers. So, making a bigger model means chaining more layers together and, thus, doing more (deeper) computations.
      On slide 29 in this link, www.slideshare.net/iljakuzovkin/paper-overview-deep-residual-learning-for-image-recognition, you can see a side-by-side visualization of different models built for the same data. The one on the left from has 8 layers. And the one on the right has 152. It's not always the case, but the larger, bigger, deeper model performs much better.

    • @DmitryKan
      @DmitryKan 7 лет назад

      Thanks, Wayne! This makes sense. So when you mention more layers -- this does not mean new architecture? These are Andrew's suggestions in case of high training error: 1. Bigger model. 2. Train longer. 3. New model architecture.

  • @ProfessionalTycoons
    @ProfessionalTycoons 6 лет назад

    very great talk.

  • @RoxanaNoe
    @RoxanaNoe 8 лет назад +1

    Thanks for sharing this :)

  • @davidclark314
    @davidclark314 2 года назад

    Thanks!

  • @wenfeng7777
    @wenfeng7777 7 лет назад

    great talk indeed!

  • @francescos7361
    @francescos7361 2 года назад

    Love him

  • @kunal2010cool
    @kunal2010cool 6 лет назад

    Thanks for the great lecture :)

  • @Elijahtorrence1
    @Elijahtorrence1 5 лет назад +2

    Not to promote stereotypes but... Andrew Yang ? Is that you

  • @LIQUIDSNAKEz28
    @LIQUIDSNAKEz28 5 лет назад

    God damn, Andrew Yang's a math teacher too!??

  • @kyleschlicht4800
    @kyleschlicht4800 5 лет назад

    that was a pretty good talk

  • @swadesonline
    @swadesonline 7 лет назад +1

    This guy is a genius.

  • @laxmisharma6162
    @laxmisharma6162 Год назад

    How can I attend these talks in person ?

  • @sanketpatel8430
    @sanketpatel8430 3 года назад

    Love this❤️

  • @mbappekawani9716
    @mbappekawani9716 3 года назад

    brilliant

  • @atlantis_expedition_member4747
    @atlantis_expedition_member4747 7 лет назад

    I thought that getting more data for a high variance model doesn't fix much?
    Didn't he himself say that in his Coursera course?

    • @johnnyq4260
      @johnnyq4260 6 лет назад

      Imagine you have three non-colinear points on a graph. You would be able to achieve perfect fit with a 2nd-degree polynomial. The training error would be zero, but the model would probably not generalize well. If I gave you a thousand additional data points, the parabola would not be able to pass through the data points, but would probably generalize better.

  • @jsarvesh
    @jsarvesh 7 лет назад

    is that pieter abbeel the front row wearing the blue t-shirt?!

  • @任师洋
    @任师洋 7 лет назад

    Why this man keep mentioning Baidu? What's the relationship?

  • @tylerbarker4763
    @tylerbarker4763 6 лет назад

    At the begening of the video, Ng Andrew, goes through a couple of steps to attempt to separate him from the lesson. He then Seperates your outgoing attention , theres lots of sound stuff going on , intent of forced listening to gain access to . calculating (setting the tone) what volume is, where action to volume is. multiple sub division. or a spliced wire to be put back together (figured accordingly)TGB He is using the bilingual trick here though, I mean what can you say/whats to say, if you have it, your made not to use it, its going to surface in some platform. Lets make it good Andrew (chineese (Asian)pie sign TGB) I'm gonna put it on a grilled cheese sandwhichTGB
    But he knows its there, uses it uniformly in a specific place.

  • @ModernTruthRevelation
    @ModernTruthRevelation Год назад

    Is the knowledge shared here still relevant after 6 years?

  • @kevalan1042
    @kevalan1042 7 лет назад +1

    Great talk! He should make a NN that writes notes on the board for him though ;)

  • @neurite001
    @neurite001 7 лет назад

    The human error rate on rating this video as of right now is 10 / (1300 + 10) = 0.7%.

  • @jimmyedwarddater7348
    @jimmyedwarddater7348 3 года назад +1

    Andrew Y. Ng needs to log out of My Cellphone and My Google Account !

  • @johnk8174
    @johnk8174 6 лет назад

    Topnotch.

  • @NAVEENKUMARLs
    @NAVEENKUMARLs 4 года назад

    Gilbert Strang of Deeplearning 👌

  • @closingtheloop2593
    @closingtheloop2593 6 лет назад

    AdHoc, not very impressed. I was hoping for a proof on say optimizing design, not some words of advise. Meh..

  • @xyx-f4p
    @xyx-f4p 7 лет назад

    Bravo!

  • @xuedonghou4487
    @xuedonghou4487 7 лет назад

    How to generate subtitles

  • @leikolaboeproduction5785
    @leikolaboeproduction5785 6 лет назад

    Damn, I thought the title was "Nuts and Bots!"

  • @karitasonntag3556
    @karitasonntag3556 7 лет назад

    ,Er der noget der kan lære mig at bruge internettet?

  • @Dynamite_mohit
    @Dynamite_mohit 4 года назад

    Sweet

  • @NicholasKujawa
    @NicholasKujawa 4 года назад

    2:10 Hi 👋

  • @davidalancoia389
    @davidalancoia389 8 лет назад +1

    Great presentation. Thanks! One suggestion: Use slides--PowerPoint, Prezi, etc. That doesn't preclude writing on the whiteboard over the slides when needed. Stanford, right?

    • @thecoolfarhan1
      @thecoolfarhan1 8 лет назад +4

      He prefers using whiteboard instead of ppts in stanford

    • @davidalancoia389
      @davidalancoia389 8 лет назад

      Even if that's so, one can learn to stretch beyond one's limitations and biases for the benefit of more effectively imparting information to one's audience. The material and knowledge is captivating, but it could be delivered more effectively.

    • @aicryptobro
      @aicryptobro 8 лет назад +4

      I've been going to math conferences for the last 5 years. Every single power point presentation has been bad, no matter how much effort people put in it.

    • @jimdowling7492
      @jimdowling7492 8 лет назад

      I was there. My impression was that he 'winged' it. But Andrew Ng can get away with that. You have to understand he has a young kid, he's a prof, heads up Baidu's AI lab. He doesn't have any time to do slides. Presentation was still great, even if his writing is illegible.

    • @davidalancoia389
      @davidalancoia389 8 лет назад

      Look, I enjoyed and learned from Ng's presentation. His knowledge and perspective are very impressive. I guess I should attend a math conference, Roy, so that I could witness such presentations first-hand. In my experience, though, most science and math lecturers just don't want to take the time (or really know how) to communicate effectively in writing (and more often than not, women make the best math lecturers, but that's another story).
      So many math, physics and engineering books are so often incomprehensible as reading rather than reference material. There are notable exceptions, of course, which demonstrate that more effective communication is possible. To that I would point to Eli Maor (especially e: The Story of a Number) or more to the point, Richard Feynman's physics lectures. Because I wasn't fortunate enough to see Feynman lecture, I'm left wondering if he redrew on the board each of his diagrams for each lecture. It seems like that would have been a waste of time, but it doesn't have to be that way.
      Andrew Ng, was basically copying from his hand-written notes onto a white board, Jim, rather than thinking aloud. (Unfortunately, there doesn't seem to be an option in this window for me to drop a sample whiteboard element from the lecture for illustration.) However, it would be a simple matter to turn the notes into slides by first having typed them rather than having written them by hand (although at times, even for simple lectures, I use all three steps). Of course, it is spontaneity and the absence of forethought that makes whiteboarding effective with an audience.
      The beauty of slides, of course, is that they can be reused as needed. Say one has a 100-slide lecture, and a 15-slide segment (especially one that defines terms, etc.) might be ideal for another audience, even with some modification. BTW, I recall little in the Ng lecture regarding complex mathematical formulae that would have made slide-making a challenge. And there's nothing precluding augmenting a lecture by writing on a whiteboard with prepared slides.
      Finally, I should mention collaboration with someone who could help. Stephen Wolfram wrote and self-published an interesting book a few years ago (A New Kind of Science, 2001). I'm not acquainted with him in any way and I occasionally demonstrate the efficacy of Wolframalpha.com, but it would have been a much better book -- and maybe 50 or so pages shorter -- had I (or someone) edited it. People do collaborate, but more effective collaboration is possible.
      Imagine how much more effective Ng could be if using good slides. Not only could he expand his audience, shorten his lecture (or include more material) and save himself later work, but he could spend more time making effective eye contact with his audience. Etc. (Yes, I'm a little garrulous.)

  • @Alex-vg7bw
    @Alex-vg7bw 6 лет назад +2

    "Humans are pretty good at computer vision" @54:30
    lol