165 - An introduction to RNN and LSTM

Поделиться
HTML-код
  • Опубликовано: 3 окт 2024

Комментарии • 85

  • @sonhdang
    @sonhdang 3 года назад +15

    I've watched dozen of videos on LSTM and this is the best one so far. Thank you so much sir. Greetings from UCLA!

  • @christophbrand9015
    @christophbrand9015 3 года назад +2

    The first youtube tutorial I saw which explains a LSTM in detail, e.g. why a Sigmoid or why a tanh is used within the cell. Great!

  • @AshishBamania95
    @AshishBamania95 2 года назад

    Can't believe that this is free. Thanks a lot. You are building a community of future researchers and innovators here!

  • @pfever
    @pfever 3 года назад +14

    Best LSTM explanation I have watched! All your videos are superb! I want to watch them all from beginning to end! Thank you for such detailed and intuitive explanations! :D

  • @MercyBedada
    @MercyBedada 6 месяцев назад

    I get valuable Understanding. I realy appriciate the way of your explanation.

  • @dizhang947
    @dizhang947 Год назад +1

    amazing work, thank you so much!

  • @omniscienceisdead8837
    @omniscienceisdead8837 2 года назад

    Best explanation out there, i understood, what is happening both conceptually and mathematically

  • @alteshaus3149
    @alteshaus3149 3 года назад +1

    Thank you very much for this video sir!

  • @zhiyili6707
    @zhiyili6707 2 года назад

    Thank you very much! It is well explained!

  • @jolittevillaruz5234
    @jolittevillaruz5234 3 года назад

    Very intuitive video!

  • @kukuhiksanmusyahada7615
    @kukuhiksanmusyahada7615 2 года назад

    Great presentation sir! thank you so much!

  • @elisavasta2684
    @elisavasta2684 2 года назад +3

    One of the best explanation ever on LSTM! Greetings from Politecnico di Milano!

  • @indranisen5877
    @indranisen5877 2 года назад

    Thank you Sir, Nice explanations.

  • @aminasgharisooreh9243
    @aminasgharisooreh9243 4 года назад +1

    Thank you, it is really helpful

  • @RAHUDAS
    @RAHUDAS 2 года назад +1

    At 19:31, he mentioned how many units of LSTM , the units parameters is not for how many units of LSTM in any layer, it is for hidden state dimension.
    And for how many LSTM depends on input shape[0].

    • @Droiduxx
      @Droiduxx Год назад

      So if I understand well, if we consider the input to be a sequence of x elements, each "LSTM" unit contains x states, and returns a list of x vectors passed to the LSTM units of the next hidden layer. Am I right ?

    • @RAHUDAS
      @RAHUDAS Год назад

      @@Droiduxx yes, but consider return_sequence, and return_stae arguments also, their default values false , to see the full picture, kindly turn on return sequence.
      Example -
      x = tf.range(60)
      x = tf.reshape(x,(5,3,2))
      # shape - ( batch, time, num-features)
      lstm = tf.Keras.Layes.LSTM( 7, return_sequence= True)
      Output = lstm(x)
      Print(Output.shape)
      # answer (5,3,7)

  • @gakhappy
    @gakhappy 3 года назад

    Great work sir. keep on doing great job

  • @cryptodude5359
    @cryptodude5359 2 года назад +1

    Amazing tutorial! I got a question:
    At 14:59 you explain the forget gate.
    In the lower-left corner, the cell gets ht-1 (last timestep) as input. Is it possible to have a sequence of past days as input?
    For example ht-1 & ht-2 & ht-3 ... etc. to spot potential trends in the data. Maybe with multiple variables. Giving every single timestep an additional weight.

  • @awesome-ai1714
    @awesome-ai1714 Год назад

    11:40 What is going on with the arrows? Signal from previous cell merges with current Xt, but there is no operator. Signal from left and signal from bottom Xt. And they both go to 3 gates?
    Edit: ok I see, its explained later

  • @tchintchie
    @tchintchie 4 года назад +2

    I can´t help but find this channel incredibly undersubscribed!!!

    • @DigitalSreeni
      @DigitalSreeni  4 года назад

      I’m glad you like the content. I rely on you guys to spread the word :)

  • @dantec.dagandanan3732
    @dantec.dagandanan3732 2 года назад

    Thanks!

    • @dantec.dagandanan3732
      @dantec.dagandanan3732 2 года назад

      I know this little amount of money is not enough to say thank you. Keep the good works ser, 🥰

    • @DigitalSreeni
      @DigitalSreeni  2 года назад +1

      Thank you very much. No amount of money is little. Every penny counts :)
      Bulk of the money goes to charities that help with cancer research and eye surgeries for poor people. So the society benefits from any amount that is contributed. Thanks again.

  • @lh2738
    @lh2738 2 года назад +1

    Nice video, so well explained and not too long, along with a full tutorial. Probably one of the best ones about LSTM. Thanks and please keep up the good work! Greetings from France!

  • @bobaktadjalli
    @bobaktadjalli Год назад

    Hi, well explained! Could I have your slides?

  • @vzinko
    @vzinko Год назад

    Why is there a dropout after the final LSTM layer?

  • @learn2know79
    @learn2know79 2 года назад +1

    I was struggling to understand the basic concept of LSTM and watched dozen of videos and finally found the best one so far. Thank you so much for letting us understand. Greetings from GIST!

  • @AhmedFazals
    @AhmedFazals 5 месяцев назад

    Awesome! Thanks sir.

  • @saaddahmani1870
    @saaddahmani1870 2 года назад +1

    Good, thanks a lot.

  • @VCodes
    @VCodes 3 года назад +1

    great. thx a lot

  • @JJGhostHunters
    @JJGhostHunters Год назад

    Hi DigitalSreeni...I am a PhD candidate investigating applications of MLPs, CNNs and LSTMs. I see that you have amazing graphics for these model types in your videos.
    Would you be willing to share these graphics for the model architectures with me so that I may use them in my dissertation and defense presentation? I certainly would give you credit for them.
    Thank you for your time!

  • @nicolamenga8943
    @nicolamenga8943 Год назад

    Thank you for the video.
    I have a question.
    The number of units (50) is the number of the so called "hidden units", also known as "hidden size"?

  • @jahanzaibasgher1275
    @jahanzaibasgher1275 2 года назад

    Thank you so much :)
    Subscribed after watching your first video.

  • @sherrlynrasdas8387
    @sherrlynrasdas8387 Год назад

    Can you teach us how to use LSTM and ARIMA in ensemble learning in forecasting time series data?

  • @aomo5293
    @aomo5293 Год назад

    Thank you, honestly it s very clear.
    Please I am looking for a tutorial on image classification but using local images dataset.
    Have y made a one before.
    Thank you again

  • @davidomarparedesparedes8718
    @davidomarparedesparedes8718 4 месяца назад

    Great explanation! Thank you so much!! : )

  • @-mle566
    @-mle566 2 года назад

    thank you, nice video for LSTM new learners :)

  • @Toss3geek
    @Toss3geek 10 месяцев назад

    谢谢老师

  • @gadisaadamuofficial2946
    @gadisaadamuofficial2946 Год назад

    really, thank you for your more clarification!

  • @rolandosantos7755
    @rolandosantos7755 3 года назад

    i love your video...i am just starting to learn machine learning and its very useful'

  • @stevenzhou7358
    @stevenzhou7358 3 года назад

    Thanks for your videos! It's really helpful. I have a small question. Could you explain a little more about the meaning of units? Is it mean the number of hidden layers or the number of neurons in a layer?

    • @DigitalSreeni
      @DigitalSreeni  3 года назад

      May be this helps... stats.stackexchange.com/questions/241985/understanding-lstm-units-vs-cells

    • @stevenzhou7358
      @stevenzhou7358 3 года назад +1

      @@DigitalSreeni Thanks a lot! It's very helpful.

  • @karamjeetsinghmakkar3323
    @karamjeetsinghmakkar3323 Год назад

    Dear Dr. S. Sreeni,
    Thanku for your informational videos regarding cnn.
    Kindly make LSTM for image classification tasks.
    Thanku.

    • @DigitalSreeni
      @DigitalSreeni  Год назад

      LSTM is primarily used for processing sequential data. While it is possible to use LSTM for image classification tasks, it is generally not the best choice as it is designed to model sequential dependencies in data, whereas images are inherently spatial and do not have an obvious sequential structure. Images are typically processed using CNNs, which are specifically designed to handle spatial data and can effectively extract features from images using convolutions.

  • @nisa_ssa
    @nisa_ssa 3 года назад

    Thank you so much for this video...

  • @alex-beamslightchanal8743
    @alex-beamslightchanal8743 2 года назад

    Nice tutorial! Thank you!

  • @hudaankara5616
    @hudaankara5616 4 года назад +1

    Hi sir. thank you for much for all your videos. Could you provide us with tutorial to implement LSTM & RNN with Python Please?

    • @DigitalSreeni
      @DigitalSreeni  4 года назад +1

      Yes... they should be out this week.

  • @yangfarhana3660
    @yangfarhana3660 3 года назад

    I've viewed several vids on LSTM but this breakdown is the best!!

  • @AveRegina_
    @AveRegina_ 2 года назад

    I'm using RNN for my PG thesis work. I've a query. Do we have to run stationarity test for our time series data before feeding it in the neural network model... or this step is only required in traditional time series models like ARIMA?

    • @DigitalSreeni
      @DigitalSreeni  2 года назад

      RNNs are capable of learning nonlinearities (compared to ARIMA) and therefore should be able to learn from the input data without doing any stationarity pre-processing. This is especially true if you use LSTMs. Also, please note that you need lot more training data for RNNs compared to ARIMA. You may find this blog useful to understand the effectiveness of RNNs: karpathy.github.io/2015/05/21/rnn-effectiveness/

  • @edwardbowora
    @edwardbowora Год назад +4

    Best teacher ever.

  • @claybowlproductions
    @claybowlproductions Год назад

    Sir you are a gem!

  • @ziyuelu1734
    @ziyuelu1734 2 года назад

    thanks!

  • @sadafmehdi2991
    @sadafmehdi2991 3 года назад

    Nice Explanation Sir!

  • @Balakrish-cl9kq
    @Balakrish-cl9kq 2 года назад

    I feel very gifted that I got the suggestion from RUclips, the right video....

  • @mehdisdikiene8752
    @mehdisdikiene8752 3 года назад

    I've watched many videos and read a lot about LSTM but this is the first time i really understand how LSTM works. Thumbs up thank you!

  • @rahuliron1635
    @rahuliron1635 3 года назад

    awesome explanation thank you very much

  • @manideepgupta2433
    @manideepgupta2433 3 года назад

    Amazing Sir.

  • @XX-vu5jo
    @XX-vu5jo 4 года назад

    Lol ever heard of transformers???

    • @DigitalSreeni
      @DigitalSreeni  4 года назад

      Now sure what your meant by your comment, was that a question?

  • @aminasgharisooreh9243
    @aminasgharisooreh9243 4 года назад

    please make a video about attention in images

  • @aristideirakoze8098
    @aristideirakoze8098 2 года назад

    We are infinitely grateful

  • @ramchandracheke
    @ramchandracheke 4 года назад

    First like a video then watch it !

    • @DigitalSreeni
      @DigitalSreeni  4 года назад

      Thanks for your blind confidence in the video, I hope your opinion doesn’t change after watching the video :)

  • @kanui3618
    @kanui3618 4 года назад

    nice explanation!

  • @s.e.7268
    @s.e.7268 3 года назад +1

    I am so happy to discover this channel! :)

  • @pattiknuth4822
    @pattiknuth4822 3 года назад

    His continuing use of "ok?" "ok?" "ok?" "ok?" is incredibly annoying.

    • @adhoc3018
      @adhoc3018 3 года назад +2

      And you are not annoying at all.

    • @DigitalSreeni
      @DigitalSreeni  3 года назад +6

      Poor choice to comment on personal trait rather than content of the tutorial, ok?