1:25 Pattern-Verbalizer Pairs 2:33 HuggingFace’s NLP Viewer and Next Word Prediction Visualization 4:40 Description of the Task and Next Word Prediction Visualization 7:10 Patterns Tested in the Ppaer (Yelp, News Classification, Yahoo Questions, MNLI) 10:36 Avoiding Catastrophic Forgetting 11:45 Combining PVPs 12:48 Iterative PET 14:05 Experimental Results 16:10 Automatic Verbalizer Search 18:01 Quick Comparison wtih Semi-Supervised state-of-the-art in Computer Vision
Hi! Thank you for educational content! I wonder if you can give beginners some reccomendations about how to start learning AI from scratch (maybe some books or courses u took before). All the best and more subscribers!
This review is amazing! So, we can use this PET approach to pre-train a language model on our specific domain and by defining a verbalizer to map our labels to natural language words, we can annotate a large set of unlabeled data. Right?
1:25 Pattern-Verbalizer Pairs
2:33 HuggingFace’s NLP Viewer and Next Word Prediction Visualization
4:40 Description of the Task and Next Word Prediction Visualization
7:10 Patterns Tested in the Ppaer (Yelp, News Classification, Yahoo Questions, MNLI)
10:36 Avoiding Catastrophic Forgetting
11:45 Combining PVPs
12:48 Iterative PET
14:05 Experimental Results
16:10 Automatic Verbalizer Search
18:01 Quick Comparison wtih Semi-Supervised state-of-the-art in Computer Vision
Thx a lot it helped me a lot to understand one of the most impacting technique for a winning solution in FB3 kaggle competition
Great Video Sir...it would be of great help if you could put a tutorial of how to train our own PET.
Best ai youtube channel ever!
Great presentation and demo. Could you please share the link for the demo?
Thank you! The demo is linked in the description of the video as "Next Word Prediction"
Good job with the demo!
Thank you!!
Hi! Thank you for educational content! I wonder if you can give beginners some reccomendations about how to start learning AI from scratch (maybe some books or courses u took before). All the best and more subscribers!
Thank you! I recommend starting out with Andrew Ng's lectures on youtube and some keras tutorials!
This review is amazing! So, we can use this PET approach to pre-train a language model on our specific domain and by defining a verbalizer to map our labels to natural language words, we can annotate a large set of unlabeled data. Right?
Thank you so much! Yes! However, finding these verbalizers can be a bit of a headache depending on the task
NLP is an acronym that was already in use. This was not what I wanted.