Natural Language Processing With Python and NLTK p.1 Tokenizing words and Sentences

Поделиться
HTML-код
  • Опубликовано: 22 дек 2024

Комментарии • 571

  • @arjunvenugopal4763
    @arjunvenugopal4763 5 лет назад +167

    Published on 2015. Watching on 2019. Still the best tutorial available on RUclips.

  • @GraveOW
    @GraveOW 8 лет назад +91

    I swear man. Every time I have a question that I think will yield 0 results on google I find one of your videos. Thanks for doing what you do!

  • @treyandrews201
    @treyandrews201 8 месяцев назад +6

    Made 8 years ago and still easier to understand than my professor. Hope the series is still relevant.

  • @elizabethhanks1042
    @elizabethhanks1042 3 года назад +7

    Finally a tutorial that a beginner can actually follow! I've been trying to install NLTK for HOURS, but after following this tutorial, 20 minutes later... bam! Everything is figured out! Thank youuuuuuu!!!

    • @sentdex
      @sentdex  3 года назад +1

      Glad I could help!

  • @TheCrimson147
    @TheCrimson147 9 лет назад +41

    I love your easy to follow tutorials! You are an expert yet you don't skip basics for us.

  • @s.v.d.9534
    @s.v.d.9534 3 года назад +3

    I have zero experience with programming, but this tutorial is so clear and accessible I actually feel like I know what I'm doing. Thank you so much!

    • @sentdex
      @sentdex  3 года назад

      Great to hear!

  • @austinbakanec4952
    @austinbakanec4952 9 лет назад +29

    Everything I search for python on you tube, I find your channel.

  • @MyRohit143
    @MyRohit143 3 года назад

    Published on 2015. Watching on 2021. Still the best tutorial available on RUclips.

  • @sudhanbhattarai5088
    @sudhanbhattarai5088 4 года назад +20

    This dude deserves a Nobel prize for all the free gems he uploads to RUclips. What a guy. Hats off !!

  • @lakshmianjan7424
    @lakshmianjan7424 7 лет назад +1

    Hi sentdex, the tutorials are too good and any novice to nlp can understand the concept well. The way you teach methodically is super!! Especially the calm and cool way you teach. It would really help many.

  • @robertc2121
    @robertc2121 6 лет назад +1

    I cant praise your courses enough. Not only do they offer an introduction, but you seem to be able to seamlessly progress and transition into the really useful complex tools too. Not only this course, but all of them. I use Udemy and Datacamp a lot, and they are both excellent, but your python courses really are a step above even DataCamp. Thank you so much !!!

  • @shanalaurenc
    @shanalaurenc 9 лет назад +67

    Hi Sendtex, absolutely smashing tuts, really love the calm relaxing way you teach. Please keep up the awesome work...python is great to use and hardly any good intros on specialised modules such as NLTK....reading python documentation is like watching paint dry so verbose and uninspiring...Regular Expressions are a pain - you're right they take forever to formulate and never parse what you need. Look forward to watching all the playlists. :)

    • @sentdex
      @sentdex  9 лет назад +19

      +Shana L Thanks for the kind words, glad you enjoy the tutorials!

    • @gyermolenko
      @gyermolenko 8 лет назад +8

      I've just giggled a bit about Sendtex's "smashing tuts" and I am sorry..

  • @GauravSingh-yf2ey
    @GauravSingh-yf2ey 3 года назад

    This is my best tutorial experience from RUclips. It's amazingly well paced. I whole-heartedly thank the person who made this...

  • @aleezasoomro6155
    @aleezasoomro6155 2 месяца назад

    Watching this in 2024 and it still remains the best tutorial in the domains of NLTK and NLP! ❤

  • @davidsimmonds4182
    @davidsimmonds4182 7 лет назад +1

    Fantastic series. Gotta love Harris and his silly humor. Explanations are excellent and he makes it the easiest time I ever "learned" the main features of a language form scratch. And I'm learning a marketable skill while I'm at it. Fantastic stuff!!

  • @jaideepadhvaryu9642
    @jaideepadhvaryu9642 9 лет назад +4

    Recently started a NLP project and found yours nltk series.
    You have fabulous work with the videos. Thanks much!

  • @שחרימיני-ג8פ
    @שחרימיני-ג8פ 3 года назад

    2021. Still the best Python NLP tutorial on RUclips.

  • @ElatedHanabi
    @ElatedHanabi 8 лет назад

    I was having lunch in my cubicle, and I decided to learn something on RUclips during lunch. Then I was like, I want to see if there is any NLP tutorial that can be entertaining. I watched this video. And I was like, ok I have to google this guy. Check his linkedin. He is inspiration. BTW, zero dislikes so far. Way to go Harrison.

  • @maltototte95
    @maltototte95 7 лет назад +27

    "ptdrrr" is the French equivalent of "lm(f)ao" ^^. Thank you for this video.

  • @beerajsaikia
    @beerajsaikia 5 месяцев назад +2

    i will be dammed 9 years old playlist, just saw the first video and completely understood tokenizer better than my uni prof

  • @whalingwithishmael7751
    @whalingwithishmael7751 5 лет назад +3

    Dang. You're basically like monitoring the sentiment of the entire world! That's freakin' awesome

  • @MistaT44
    @MistaT44 6 лет назад

    Insanely helpful tutorials man. I am coming from a java background and have almost 0 experience in python but the way you have explained every single thing from downloading and installing to every detail. Its just insane.

  • @SnapSizzle1554
    @SnapSizzle1554 3 года назад

    Simply the best! Posted on 2015, still watching in 2021 :)

  • @yeeboho
    @yeeboho 7 лет назад +1

    Hi Sentdex, thank you so much for the videos. Your explanation/teaching is 100 times better than my university professor. I'm looking forward to watching the rest of your videos.

  • @fytubevw
    @fytubevw 4 года назад

    The day I got my feet wet and fingers numb with nltk, watched this excellent tutorial! Thanks! :)

  • @rembautimes8808
    @rembautimes8808 4 года назад

    Who knew one should never eat cardboard? Great example 😊 and good set of resources for NLTK. Thanks

  • @shacklemanwarts1305
    @shacklemanwarts1305 3 года назад

    I love how he teachs us Statistical analysis and data reconfiguration

  • @lunasabroso7172
    @lunasabroso7172 4 года назад

    you are a legend for all the work you've done! been using your website for years and it's so weird to know the creator is so like humble about it lol

  • @bhuvanaggarwal7387
    @bhuvanaggarwal7387 4 года назад

    Doing great work bro, have watched almost all of your tutorials, absolute best over whole of yt.

  • @kennedykaufman6063
    @kennedykaufman6063 8 лет назад +490

    ed snowden teaches python now?

    • @vadimborisov2313
      @vadimborisov2313 7 лет назад +49

      tough life in russia you know

    • @vickyredwon
      @vickyredwon 7 лет назад +1

      lol

    • @ghoumrassi
      @ghoumrassi 6 лет назад +8

      6:44 'whoops I guess I hate the US' - guess that proves it xD

    • @AMINE-yy3zb
      @AMINE-yy3zb 6 лет назад +1

      I always see Snowden talking when I see him lol

    • @uvedalewood1826
      @uvedalewood1826 6 лет назад

      @@AMINE-yy3zb wallahu fuckbar

  • @darkseid3225
    @darkseid3225 9 лет назад

    This is so cool, an easy module to use implement within statistical models on various probabilistic outcomes. I can't find a more useful channel on Python than yours.

  • @1flovera
    @1flovera 9 лет назад

    Hey! I was the whole afternoon waiting to download the NLTK thingy. For those developers that live in a country with low speed internet connection (Like me), do not despair! :). Good video (Y) :)

  • @Stefanslaapt
    @Stefanslaapt 9 лет назад

    You are the Python Guru! Keep up the good work, really liking the vids.

    • @sentdex
      @sentdex  9 лет назад

      Stefan van der Leeden Thanks, glad you're enjoying! I have lots of fun making them.

  • @eabnowhus
    @eabnowhus 8 лет назад

    thank you for the awesome tutorials. I don't usually write comments (laziness) but I wanted to for your videos, cause they are great. Please keep up the great stuff!

  • @arjunc1482
    @arjunc1482 4 года назад +129

    2020 attendence Here!

  • @TheSam1902
    @TheSam1902 7 лет назад

    Man you're awesome, I love your videos, thanks a lot for making such a great series on NLTK !

  • @mega6699
    @mega6699 8 лет назад

    Thank you again for this easy introduction to NLTK which is very vauable for lazy people like me who get scared when they see the NLTK book :))) I've subscribed to the pythonprogramming site!

  • @walkertai7220
    @walkertai7220 7 лет назад

    Absolutely brilliant. You understand what exactly the fans want!
    Cheers!

  • @DivineZeal
    @DivineZeal 6 лет назад

    mind blown. that globe visual chart is awesome

  • @swanithakvn1148
    @swanithakvn1148 8 лет назад

    Your tutorial is simply awesome!! Thanks a thousand times for your initiative....Keep going! :)

  • @marcoa5777
    @marcoa5777 4 года назад

    You are a fantastic teacher. Thanks from Switzerland

  • @faaizqadri5316
    @faaizqadri5316 5 лет назад +5

    it is time to update the videos on NLP, and introduce NNs with attention. Some intermediate tutorials on NLP would be beneficial.

  • @vinodb5050
    @vinodb5050 7 лет назад

    I love your videos , the way you teach us it looks very easy to understand....When you smiles in between that add relaxation while learning...keep it up...Thanks

    • @sentdex
      @sentdex  7 лет назад

      Great to hear!

  • @guhkunpatata3150
    @guhkunpatata3150 8 лет назад

    very nice , fast yet good explanation, easy to understand . keep up the good work (y)

    • @sentdex
      @sentdex  8 лет назад +1

      +Guhkun ccb Great to hear!

    • @guhkunpatata3150
      @guhkunpatata3150 8 лет назад

      +sentdex perhaps you could make a tutorial on how to train tagger using corpus with another language than English. It will be great I think?

    • @guhkunpatata3150
      @guhkunpatata3150 8 лет назад

      succes on training custom tagger, next : custom parser ( nlp is complicated, >.< )

  • @ligyantony6180
    @ligyantony6180 8 лет назад

    Really awesome, was really easy to understand with only basic knowledge of NLP and Python. Thank you very much

  • @redfox9239
    @redfox9239 4 года назад

    Damn. Having watched your videos for a solid two years (or maybe three) years now, this is PRETTY old

  • @ssagga
    @ssagga 8 лет назад

    Thank you for this great tutorial. I am actually new to Python and NLP. However, I found this tutorial to be increadibly easy to follow. Looking forward to watching the playlist.

  • @SaurabhDeochake
    @SaurabhDeochake 9 лет назад +1

    Yes! Yes! I was waiting for this, Thank you very much.

    • @sentdex
      @sentdex  9 лет назад +2

      Saurabh Deochake Yeah! I have been wanting to remake the NLTK series for a long time! Happy to share

  • @nimishjindal9271
    @nimishjindal9271 7 лет назад

    amazing video. Best nlp tutorials i have found till date.

  • @jasonhe6947
    @jasonhe6947 8 лет назад

    I really appreciate what you've done for python programming tutorial!

  • @fulliculli
    @fulliculli 5 лет назад

    "Ptdrrrrr" is like "lol" in french. It's an acronym for "Pété de rire" which literally translates to "Broken from laughing". This is from a lot of french people commenting on funny content.

  • @nczioox1116
    @nczioox1116 4 года назад

    You are awesome for making this series!!

  • @Singh-Sudhanshu
    @Singh-Sudhanshu 4 года назад +1

    watching in 2020, you are awesome

  • @joesadaka2534
    @joesadaka2534 8 лет назад +1

    Damn, you really do everything! This is great.

  • @krylatyy_seraphim
    @krylatyy_seraphim 2 месяца назад

    Now we have 2024, I didn't find something better, that this videos. It's maked retty good

  • @faraazmohammed3693
    @faraazmohammed3693 7 лет назад

    awesome man thanks a lot.exactly this is what I was expecting ..you explain so good..keep the good work and keep sharing..god bless you man

    • @sentdex
      @sentdex  7 лет назад +1

      Great to hear, glad you're enjoying!

  • @nishantkumar3997
    @nishantkumar3997 4 года назад +1

    HI @sentdex , since it's 2020 and there's quite an upgrade, what do you say about making a tutorial regarding NLP regarding all algorithms out there ? Like GPT-2 , BERT (just the popular ones)
    Whatever else you would like to include .

  • @starmole5000
    @starmole5000 5 лет назад

    Bravo. Great intro to NLP and its basic application. Subbed and liked.

  • @Vishal85d
    @Vishal85d 6 лет назад

    Hey It’s great to learn from you and the way your teaching is amazing you cover almost everything that helping me a lot. Thank you so much

  • @sairamsubramaniam8316
    @sairamsubramaniam8316 4 года назад

    Dude is like takakakak and the sentence pops out without any spelling errors. Dayum bruh!!

  • @grow3384
    @grow3384 6 лет назад +5

    thanks:) Your tutorial is really good for the beginners like me.

  • @shreyagupta7885
    @shreyagupta7885 8 лет назад

    Your videos are actually amazing. This really helped a lot.

    • @sentdex
      @sentdex  8 лет назад

      Great to hear!

  • @suomynona7261
    @suomynona7261 2 года назад

    thank you. little do you may know, you are building the future.

  • @Rochbenritter
    @Rochbenritter 9 лет назад

    I learned with the old ones :D, nice that you are updating ;)

    • @sentdex
      @sentdex  9 лет назад +3

      Rochbenritter Yeah, much needed update! First few videos in this one will be similar (pos tagging, named ent rec, chunking...etc), then we'll dive into some more interesting tasks like text classification, which the other one didn't quite do.

  • @integralyogin
    @integralyogin 6 лет назад

    oh boy this is going to be an amazing series

  • @displayname7t4
    @displayname7t4 2 года назад

    ptdddrr comes from french is slang for 'peté de rire' which stands for 'broken from laughter'
    Thanks for tutorial

  • @sasav4697
    @sasav4697 8 лет назад +8

    Thank you for impressive tutorial videos.

    • @sentdex
      @sentdex  8 лет назад +3

      Happy to share!

  • @gokuljagannath6563
    @gokuljagannath6563 8 лет назад

    Great introduction to nltk.......!!!! Thank you!!!!

  • @muhammadmuinmundzir9981
    @muhammadmuinmundzir9981 4 года назад

    Watching from 2020, great explanation!

  • @anilsarode6164
    @anilsarode6164 4 года назад

    Great !! Lots of love from India.

  • @ajlu5955
    @ajlu5955 9 лет назад +1

    谢谢!!
    Thanks a lot man! This is exactly what I'm looking for, you really helped me a lot!! Thanks again! :D

    • @sentdex
      @sentdex  9 лет назад

      Jiahong Lu Happy to share!

  • @riderblack6401
    @riderblack6401 6 лет назад +2

    Give you millions of thank you!

  • @vinodh100
    @vinodh100 9 лет назад

    Wow !!
    It was so pleasing and soothe
    Cool keep post more on every tech. you know

  • @zxlvckj1402
    @zxlvckj1402 6 лет назад +1

    I just found your videos and started to watch these. I have a simple question. Does any of your videos cover topic modeling (LDA)?

  • @grandadshands
    @grandadshands 9 лет назад

    I don't mean to be a complete douche, but 'corpora' is the plural form and 'corpus' is the singular. These are really useful videos, though, so thanks!

    • @sentdex
      @sentdex  9 лет назад

      Sarah Pleef I am aware of the definitions. Not really sure why you felt the need to say this. Did I miss-speak somewhere in the video about this? It is also important to note that a "corpus" is almost always also a "corpora," and visa versa, unless it's literally one document.

  • @nassehk
    @nassehk 9 лет назад

    Dude I love your videos. Thanks for sharing.

    • @sentdex
      @sentdex  9 лет назад

      Nasseh Khodaie Great to hear! Happy to share.

  • @pedrorevolorio2660
    @pedrorevolorio2660 9 лет назад

    pumped for this!

  • @stacymaimoon4189
    @stacymaimoon4189 2 года назад

    Hello Harrison, thanks for this short and practical NLTK introduction. As you kindly mentioned you would accept questions, so I have one: how do I proceed if I need to create a word and a sent tokenizer for a language not supported by the NLTK tokenizer? You mentioned a procedure involving unsupervised learning and a possibility to 'create an own language'. Could you please give me a hint how I shall start to do that? TIA.

  • @beautifulanimals209
    @beautifulanimals209 5 лет назад

    Sir kindly make tutorials on these contents which are required for future with projects. Thanks??
    Natural language processing using NLTK and Python
    Module Contents:
    • Basic text analysis with NLTK
    • Text pre-processing
    • Stopword removal
    • Stemming and lemmatization
    • Parts of speech tagging
    • Chunking
    • Named entity recognition
    • Wordnet with NLTK
    • Text classification
    • Converting word to features
    • Classifying text documents using NLTK
    • Integration with scikit-learn classifiers
    • Gensim
    • Word2vec
    • Investigating data biasness using NLTK
    • Twitter sentiment analysis using NLTK

  • @alainakhan8389
    @alainakhan8389 3 года назад +1

    To the point explanation .

  • @youwang9156
    @youwang9156 4 года назад +1

    can anyone tell me what software he was using to plot the 3d graph at 2:22? thanks a lot, really appreciate

  • @kenadair6044
    @kenadair6044 2 года назад

    great video... very helpful.... (just a quick heads up, though: "corpora" is plural of "corpus," i.e., "body," in this case: "body of language content"). One corpus -> many corpora

  • @letaniaferreira1649
    @letaniaferreira1649 7 лет назад

    Great kick start tutorial. Thanks a bunch!

  • @css7021
    @css7021 2 года назад

    16:28 print(word_tokenize(ex_text)) ---> is not parsing Mr. separately
    o/p: 'Mr.Uchiha'
    what am I missing something??
    Edited: I see It separates when there is a space after "."

  • @whoisabishag3433
    @whoisabishag3433 Год назад

    Timestamps
    [ 00:00:47 ] NLTK is why I started learning Python

  • @calfolkionized
    @calfolkionized 6 лет назад

    Hey man Thanks for the good work! Great videos!

  • @ehsan2547
    @ehsan2547 7 лет назад

    Thank you man
    I have learnt alot from your videos

  • @morelife4127
    @morelife4127 7 лет назад

    Man you're the BEST!

  • @gregjohnson2335
    @gregjohnson2335 5 лет назад

    holy crap, you have tutorials for everything

  • @nomanshaikhali3355
    @nomanshaikhali3355 4 года назад

    Hi, Which will be better for stock prices sentimental analysis
    Bag of words
    Tfidf
    Also discussed with reason plz?
    Looking forward to hearing from you soon!!

  • @laba2723
    @laba2723 7 лет назад +1

    Great great video. I have a problem. When I am downloading all the packages, it stopped at the pantex lite package and the status said out of date. What should I do now

  • @pratik6447
    @pratik6447 7 лет назад

    Awesome!! Perfect for starters!

  • @techgamer1333
    @techgamer1333 3 года назад

    Explanation is Good enough!

  • @karthiksockalingam9567
    @karthiksockalingam9567 9 лет назад +7

    For Ubuntu users ( default is python 2.7.9 - to change that to 3.4+)
    1.Create a document or (sudo gedit ~/.bash_alias)
    2. Enter the alias for python or type "alias python=python3" in the document. Save and close
    3. Then (source ~/.bash_alias)
    Python switched to 3.4+

    • @ahmedomar222
      @ahmedomar222 7 лет назад

      man no need to do that just type python3 in the terminal and that will do it and also for packages use pip3 if you want them to installed for python3

    • @thuyluctran3738
      @thuyluctran3738 6 лет назад

      Install Anaconda or Miniconda and you will have everything you need!

  • @Nidhiisharma_4
    @Nidhiisharma_4 9 лет назад

    Hw to apply tokenization on csv or txt file...which we hv saved in ur previous tutorials?

  • @MONAD_0
    @MONAD_0 3 года назад

    Thank you! watching in 2021.

  • @PrinceESL
    @PrinceESL 7 лет назад +1

    Where's a good place to ask about nltk.download() on OSX. I can see from stack overflow that a lot of people have problems. None of the solutions they mentioned work for me.

  • @Talk2Asap
    @Talk2Asap 3 года назад

    Hi. Thank you for the video. I have a question is NLTK considered part of machine learning or it is a statistical way of applying NLP?

  • @chriszhang3629
    @chriszhang3629 9 лет назад

    NICE video! Really help me a lot. Thanks!

  • @brendanmilton5025
    @brendanmilton5025 8 лет назад +1

    Hi, Love these videos! Just wondering what the best way would be to make sense of data I had gathered from a flyer via OCR ie: organizing it into EVENT,DATE,LOCATION etc... do you think clunking?