Few-Shot Learning (3/3): Pretraining + Fine-tuning

Поделиться
HTML-код
  • Опубликовано: 6 окт 2024
  • НаукаНаука

Комментарии • 49

  • @ammarulhassan5851
    @ammarulhassan5851 3 года назад +15

    What an amazing series on Few-Shot learning! I've seen some papers, such as FUNIT, that discuss the generation of a few-shot image. This is the first time I've looked for few-shot image classification learning. I honestly believe that there is no better explanation than this series. I've just subscribed and look forward to seeing more series similar to these. Many thanks

  • @MicheleMaestrini
    @MicheleMaestrini 5 месяцев назад +1

    Thank you so much for this series of lectures and slides. I am doing a thesis on few-shot learning and this has really helped me understand the fundamentals of this algorithm.

  • @hjiang3456
    @hjiang3456 2 года назад +2

    For sure the best intro to few shot learning one can find on RUclips. Thank you for the great contents. Hope to see more contents like this in English.

  • @marooncabbagemaroon6532
    @marooncabbagemaroon6532 3 года назад +1

    on of the most explicit few-shot learning lesson !!!!!

  • @impulse1712
    @impulse1712 2 месяца назад

    What an explanation in detail,loved the way you explain things , thank you very much sir.

  • @adityasrivastava8903
    @adityasrivastava8903 3 года назад +3

    Want to seriously thankyou for making videos on few shot learning......please try making some videos on few shot generative modelling if possible

  • @jcrobin1991
    @jcrobin1991 2 года назад +4

    Thank you for the amazing lecture series! I've learnt so much from them. Just one suggestion - it would be very nice if you can point us to some simple code example that applies those fine-tuning techniques mentioned in the lecture which we can play around with to have a better understanding of those concepts. Thanks again!

  • @banalasaritha570
    @banalasaritha570 Год назад +1

    amazing explanation.. bow to you👏

  • @gabiryoussef9194
    @gabiryoussef9194 3 года назад +2

    Many thanks for your great work. please extend to other machine learning related topics.

  • @norman9174
    @norman9174 Год назад

    I am from India , Such a amazing lecture , it blows my mind how everything works . Now iIunderstand it not something very high class ...its just a bunch of vectors on which we have to deal with .

  • @alphonseinbaraj7602
    @alphonseinbaraj7602 3 года назад +3

    Really wonderful and great explanation. Because i used to study books to learn ..but here all references available. Please will you give some tricks and steps for transfer learning techniques and few real time projects also ..My request .. Thanks

  • @RyanMcCoppin
    @RyanMcCoppin Год назад

    Dude, you are a boss teacher. Thanks for sharing.

  • @chanramouliseshadri512
    @chanramouliseshadri512 2 года назад

    Thank you Shusen. Great explanation

  • @stewartmuchuchuti20
    @stewartmuchuchuti20 9 месяцев назад

    Awesome. Well explained. Well simplified.

  • @JuanMiguelMoralesOliva
    @JuanMiguelMoralesOliva 3 года назад

    Me ha sido realmente útil esta excelente y didáctica explicación, muchas gracias!!

  • @fionamukimba1956
    @fionamukimba1956 3 года назад

    This is a great lecture prof. Please do a review lecturer on Siamese networks, trends and areas of application.
    I hope my request and others in the comments will be attended to.

  • @sheikhshafayat6984
    @sheikhshafayat6984 2 года назад

    This video is really really good, wish you make more such!

  • @t.pranav2834
    @t.pranav2834 2 года назад

    Great explaination. Thanks for this series.

  • @jasonwang9990
    @jasonwang9990 2 года назад

    Amazing tutorials! Absolutely great job!

  • @essuanlive
    @essuanlive 3 года назад

    thank you much for a wonderful explanation

  • @williamberriosrojas595
    @williamberriosrojas595 3 года назад +1

    Great videos!! Thanks a lot :)

  • @woddenhorse
    @woddenhorse 2 года назад

    Amazing Playlist 🔥🔥

  • @thesisTk
    @thesisTk Год назад

    Great series!

  • @AjinkyaGorad
    @AjinkyaGorad 7 месяцев назад

    Softmax associates while learning, and identifies while inference

  • @dnnsdd5418
    @dnnsdd5418 3 года назад +2

    Hi! Thank you for a great video, very interesting topic!
    I have some questions. When you say that we could train the "pretrained CNN" using the siamese network, what is meant by that? Isn't the Siamese network made for embedding and then evaluating? Why would we need to pretrain another CNN using this, when the SNN is already doing it? Or is the "pretrained CNN" another name for the two "twin" CNN-models used in the SNN?
    Thanks in advance!

  • @felixschmid7849
    @felixschmid7849 3 года назад

    Great explanations! Thanks!

  • @sonninh8987
    @sonninh8987 3 года назад

    Great explanation

  • @serviofernandolimareina5365
    @serviofernandolimareina5365 2 года назад

    Excellent!

  • @himalayasinghsheoran1255
    @himalayasinghsheoran1255 3 года назад

    Great explanation.

  • @zhalehmanbari6172
    @zhalehmanbari6172 Год назад

    Fantastic 🌸

  • @feidu11
    @feidu11 2 года назад

    Many thanks

  • @Amir-tg9nf
    @Amir-tg9nf 2 года назад

    Thanks a lot

  • @impactguide
    @impactguide 2 года назад

    Thanks for this great lecture! I really like having a "real world" example, before going into the mathematical details. I was wondering something though... Is taking the mean of the support set vectors always justified or a good idea, or is there some possible generalization? As an example, for some bird species the males are brightly colored, while females are more plainly colored. If I have both a female and a male bird in my support set, the average of these two might be a "strange" vector which is relatively distant from either a male or female bird.
    I suspect using the discussed method would probably still work, as far as classifying birds goes, and of course you could work around this by having a female_bird and male_bird class in the support set, and adding the p_j values up. But on the other hand, they are stil examples of the same "thing", i.e. a bird, it's just that the "thing" in question has several forms. Is there some smart way of approaching such a problem?

  • @stracci_5698
    @stracci_5698 2 месяца назад

    Are the siamese networks not performing a fine-tunning? when the model weights are learned to perform the task?

  • @8eck
    @8eck 2 года назад

    What if there are 10.000 classes and we need to predict, to which class this quarrel belongs to? We will have to create a matrix of all 10.000 classes the same way as you have shown in your video?

  • @AbhishekSinghSambyal
    @AbhishekSinghSambyal 2 месяца назад

    Which app do you use to make presentations? How do you hide some images/arrows in the slides like an animation? Thanks.

  • @amoldumrewal
    @amoldumrewal 3 года назад

    Hey, really nice series. Great work man! I have one question:
    Since we are now using cosine similarity the range for inputs for softmax is [-1,1]. This might hinder the max probability for the correct class as it can go upto ~89% in best case scenario.
    Are you aware of a way by which we can make the probabilities for a 100% sure prediction be equal to ~1.0?

    • @EranM
      @EranM 2 года назад

      take absolute value of cosine similarity

  • @lchunleo
    @lchunleo 2 года назад

    Can.few shot classification replace supervised classification even if there r data available?

  • @santanubanerjee5479
    @santanubanerjee5479 28 дней назад

    What does it mean when the gradient propagates back to the CNN as well? What is changed in the CNN?

  • @MrSupermonkeyman34
    @MrSupermonkeyman34 2 года назад

    Does anyone know what the difference in accuracy is if you train the network as a siamese network compared to training in the standard way?

  • @haoyin3366
    @haoyin3366 3 года назад

    非常感谢!!我很好奇,fine-tuning新建的classifier 是通过影响W还是通过影响CNN网络的weight来影响embedding的呀? 要实现的话是建两个网络吗?谢谢!

  • @EranM
    @EranM 2 года назад

    Did anyone in here implemented this?

  • @nacho7953
    @nacho7953 2 года назад

    do you have any code example?

  • @8eck
    @8eck 2 года назад

    Can we keep 1000 classes as mean vectors of their 1000 images? So 1000 mean vectors for 1000 classes with 1000 images per class.

    • @EranM
      @EranM 2 года назад +1

      yes you can.

  • @EranM
    @EranM Год назад

    Sorry but the fine tuning approach just degraded my model accuracy.