- Видео 158
- Просмотров 183 952
Greg Durrett
Добавлен 25 авг 2020
CS378NLP Fall 2020 "intro"
i probably should've spent this time on the actual course material
Просмотров: 2 208
Видео
CS371N/388 NLP "trailer" (fall 2023)
Просмотров 3,1 тыс.Год назад
course website, including videos and assignments: www.cs.utexas.edu/~gdurrett/courses/online-course/materials.html
Position Encodings (Natural Language Processing at UT Austin)
Просмотров 1,5 тыс.Год назад
Part of a series of video lectures for CS388: Natural Language Processing, a masters-level NLP course offered as part of the Masters of Computer Science Online at UT Austin. For accompanying readings, see www.cs.utexas.edu/~gdurrett/courses/online-course/materials.html
Chain of Thought (Natural Language Processing at UT Austin)
Просмотров 650Год назад
Chain of Thought (Natural Language Processing at UT Austin)
Transformer Architecture (Natural Language Processing at UT Austin)
Просмотров 2,1 тыс.Год назад
Part of a series of video lectures for CS388: Natural Language Processing, a masters-level NLP course offered as part of the Masters of Computer Science Online at UT Austin. For accompanying readings, see www.cs.utexas.edu/~gdurrett/courses/online-course/materials.html
Language and Vision (Natural Language Processing at UT Austin)
Просмотров 317Год назад
Part of a series of video lectures for CS388: Natural Language Processing, a masters-level NLP course offered as part of the Masters of Computer Science Online at UT Austin. For accompanying readings, see www.cs.utexas.edu/~gdurrett/courses/online-course/materials.html
Future Risks of Large Language Models (NLP for High School)
Просмотров 168Год назад
Part of a series of videos on Natural Language Processing aimed at introducing high school students to language modeling. Module landing page: www.cs.utexas.edu/~gdurrett/courses/nlp-module/ This module about machine learning is produced as part of the NSF Institute for Foundations of Machine Learning at UT Austin, University of Washington, and Wichita State. www.ifml.institute/
Transformer Language Modeling (Natural Language Processing at UT Austin)
Просмотров 1,6 тыс.Год назад
Part of a series of video lectures for CS388: Natural Language Processing, a masters-level NLP course offered as part of the Masters of Computer Science Online at UT Austin. For accompanying readings, see www.cs.utexas.edu/~gdurrett/courses/online-course/materials.html
Factuality of LLMs (Natural Language Processing at UT Austin)
Просмотров 667Год назад
Part of a series of video lectures for CS388: Natural Language Processing, a masters-level NLP course offered as part of the Masters of Computer Science Online at UT Austin. For accompanying readings, see www.cs.utexas.edu/~gdurrett/courses/online-course/materials.html
T5 (Natural Language Processing at UT Austin)
Просмотров 804Год назад
Part of a series of video lectures for CS388: Natural Language Processing, a masters-level NLP course offered as part of the Masters of Computer Science Online at UT Austin. For accompanying readings, see www.cs.utexas.edu/~gdurrett/courses/online-course/materials.html
Language Grounding (Natural Language Processing at UT Austin)
Просмотров 508Год назад
Part of a series of video lectures for CS388: Natural Language Processing, a masters-level NLP course offered as part of the Masters of Computer Science Online at UT Austin. For accompanying readings, see www.cs.utexas.edu/~gdurrett/courses/online-course/materials.html
Zero-shot Prompting (Natural Language Processing at UT Austin)
Просмотров 670Год назад
Part of a series of video lectures for CS388: Natural Language Processing, a masters-level NLP course offered as part of the Masters of Computer Science Online at UT Austin. For accompanying readings, see www.cs.utexas.edu/~gdurrett/courses/online-course/materials.html
Neural Chatbots (Natural Language Processing at UT Austin)
Просмотров 282Год назад
Part of a series of video lectures for CS388: Natural Language Processing, a masters-level NLP course offered as part of the Masters of Computer Science Online at UT Austin. For accompanying readings, see www.cs.utexas.edu/~gdurrett/courses/online-course/materials.html
Intro to ChatGPT and NLP (NLP for High School)
Просмотров 995Год назад
Part of a series of videos on Natural Language Processing aimed at introducing high school students to language modeling. Module landing page: www.cs.utexas.edu/~gdurrett/courses/nlp-module/ This module about machine learning is produced as part of the NSF Institute for Foundations of Machine Learning at UT Austin, University of Washington, and Wichita State. www.ifml.institute/
Reinforcement Learning from Human Feedback (Natural Language Processing at UT Austin)
Просмотров 1,8 тыс.Год назад
Part of a series of video lectures for CS388: Natural Language Processing, a masters-level NLP course offered as part of the Masters of Computer Science Online at UT Austin. For accompanying readings, see www.cs.utexas.edu/~gdurrett/courses/online-course/materials.html
Using Transformers (Natural Language Processing at UT Austin)
Просмотров 1,3 тыс.Год назад
Part of a series of video lectures for CS388: Natural Language Processing, a masters-level NLP course offered as part of the Masters of Computer Science Online at UT Austin. For accompanying readings, see www.cs.utexas.edu/~gdurrett/courses/online-course/materials.html
Seq2seq Models (Natural Language Processing at UT Austin)
Просмотров 1,1 тыс.Год назад
Seq2seq Models (Natural Language Processing at UT Austin)
Mathematics of Language Modeling (NLP for High School)
Просмотров 535Год назад
Mathematics of Language Modeling (NLP for High School)
RNNs and their Shortcomings (Natural Language Processing at UT Austin)
Просмотров 1,1 тыс.Год назад
RNNs and their Shortcomings (Natural Language Processing at UT Austin)
Beam Search (Natural Language Processing at UT Austin)
Просмотров 1,3 тыс.Год назад
Beam Search (Natural Language Processing at UT Austin)
Ethics: Bias (Natural Language Processing at UT Austin)
Просмотров 292Год назад
Ethics: Bias (Natural Language Processing at UT Austin)
Attention (Natural Language Processing at UT Austin)
Просмотров 1,9 тыс.Год назад
Attention (Natural Language Processing at UT Austin)
Multi Head Self Attention (Natural Language Processing at UT Austin)
Просмотров 1,2 тыс.Год назад
Multi Head Self Attention (Natural Language Processing at UT Austin)
Understanding ICL: Induction Heads (Natural Language Processing at UT Austin)
Просмотров 1,2 тыс.Год назад
Understanding ICL: Induction Heads (Natural Language Processing at UT Austin)
GPT-3 (Natural Language Processing at UT Austin)
Просмотров 911Год назад
GPT-3 (Natural Language Processing at UT Austin)
Neural and Pretrained Machine Translation (Natural Language Processing at UT Austin)
Просмотров 257Год назад
Neural and Pretrained Machine Translation (Natural Language Processing at UT Austin)
Instruction Tuning (Natural Language Processing at UT Austin)
Просмотров 3,8 тыс.Год назад
Instruction Tuning (Natural Language Processing at UT Austin)
ChatGPT The Basics (NLP for High School)
Просмотров 474Год назад
ChatGPT The Basics (NLP for High School)
Can you come teach at my school?
this deserves way more views! Thank you again for the awesome videos ❤️ You are so helpful
I have been reviewing all your videos for my NLP masters program. I love how well articulated they are. Very great overview! Thank you so much for sharing this on youtube
way better explained than my professor at ucsd
Hi, that was great!
🤣🤣🤣
very clear, thanks!
awesome teacher
Professor, I just wants to say "THANKS FOR ALL YOUR EFFORT". God Bless you!
Thanks a lot for sharing your great content.
Interesting, thanks!
i dont understand anything :(
There is a bit of pre-requisite knowledge for this to make sense.. you can try and explore other videos and come back to this if you wish..
Good explanation. Thanks for posting!
Thank you, but you started explainning GD and suddenly jumped to SGD
Thanks Professor Durrett! I'm currently a undergrad student from Bangladesh, doing this course to get my prior knowledge for my upcoming thesis in NLP. Hope your course will make me grow more and more interest in NLP which seems super fun to me already. Thank you again! <3
I like this ... Thank You.
Thank you so much for such content.
In the paper by Vaswani et. al., they describe their sinusoidal positional encoding as "a geometric progression from 2*pi to 10000 * 2*pi". Any help decoding this sentence? Thanks
I watched the whole series videos. Thank you for your hard work!
👍👍👍😉
thank you...that was a very clear explanation to a complicated topic...
Best class intro ever haha
sad lols haha
That's the awesome trailer!!!!
very clear explanation! Thank you❤❤❤
In time stamp 2:05 it is implied that chatGTP is an encoder-decoder? Isn't it a decoder-only architecture?
*PromoSM* 💃
Can you please explain how adding an extra feature to the feature vector the equivalent of having a entire bias vector? Correct me if I’m wrong, but a bias vector would contain biases for each feature (or node in a NN layer), whereas adding a bias as a single new feature would be a single bias alongside all the features so could only have an aggregate effect. It seems like these are not equivalent and would have dimensionally different impact/results.
correct me if i'm wrong, but i think the b bias itself was supposed to be appended to the w vector (as 1 was appended to the f(x) vector) which would then be equivalent to the + b in the original expression.
How do you generally handle misspelled words in pre-processing? Do you rewrite them as corrected words or treat them as UNK?
ahaha this is so cool. I'm excited!!
super nice :D
Dang it. Now the updates come through. I took the course a year too early 😢. I'm hyped for my classmates at least.
Great trailer! I'm ready 💪
I'm ready..
Nice trailer! I took the course 2 years ago before all this NLP breakthrough and I really enjoyed it
Hi Prof Durrett, thank you so much for releasing your course material online! I took the past version of this course last year through the MSDS program, and I'm super excited to go through the new material!
[Mask] = [your mom]
This lecture is highly intuitive . Thank You !
Thank you so much for helping me learn this concept.
I tried using a sabre fencing athlete and it thought it was a baseball player or something, probably because I used little context words.
I think the logistic function is: 1/1+e^{-f(x)} instead of e^{+f(x)}
1/(1+e^(-f)) = e^f / (1+e^f)
Lol chaos
very nice :)
Hello
Hi there I am joining in Fall 2022
Hey is anyone else planning to do the entire online CS388? Looking for a study partner to improve our chances of completing the entire course and all 6 assignments.
Would love to. I hope you finished the course. It’s so surreal that the basic goals discussed in slide 1 are built and are accessible to anyone with a smartphone
Great lecture
You sir, are the best part of of my morning so far. The day can only get better after seeing this.
The is the blockbuster of 2020
interesting idea :)