Word2Vec Part 2 | Implement word2vec in gensim | | Deep Learning Tutorial 42 with Python

Поделиться
HTML-код
  • Опубликовано: 13 янв 2025

Комментарии • 114

  • @codebasics
    @codebasics  2 года назад +2

    Check our Deep Learning Course (in PyTorch) with Latest, Industry Relevant Content: tinyurl.com/4p9vmmds
    Check out our premium machine learning course with 2 Industry projects: codebasics.io/courses/machine-learning-for-data-science-beginners-to-advanced

    • @alishaparveen4735
      @alishaparveen4735 2 года назад +1

      How we can apply multilabel classification after using Word2vec.

    • @anandakhan4160
      @anandakhan4160 2 года назад

      i solved my problem. thanks.

  • @muskankhandelwal9555
    @muskankhandelwal9555 3 года назад +14

    This playlist is really outstanding. The exercises are helping me a lot to remember the concept and practice it myself.

    • @codebasics
      @codebasics  3 года назад +3

      I am happy this was helpful to you.

  • @ADESHKUMAR-yz2el
    @ADESHKUMAR-yz2el 3 года назад +5

    the output made me WoW💯🔥
    the beauty of Mathematics and genius brains
    thanks to all the engineers and scientists who really work hard
    fun fact : my keyboard suggesting the next word while i'm typing reminding me of word2vec🥰
    these type of things motivates me to learn more about technologies

  • @namansethi1767
    @namansethi1767 3 года назад +3

    Thank you sir for this playlist . This is the only playlist on You tube which clear my all doubts related to deep learning

  • @dopervigest7012
    @dopervigest7012 3 года назад +4

    The similarity output on "great" and "nice" is 0.69, Nice!

  • @shivam6565
    @shivam6565 3 года назад +2

    This is exactly what I was looking for. Thank you so much for the part 2.

  • @omharne1386
    @omharne1386 Год назад +1

    This playlist is really outstanding. The exercises are helping me a lot to remember the concept and practice it myself.😀

  • @assafbotzer7952
    @assafbotzer7952 Год назад

    Concise, eloquent and brilliant. Thank you 🙏

  • @poojapatila5233
    @poojapatila5233 3 года назад

    I was looking for this topic since many days, Finally gone through your video, Its awesome..................

  • @omarh.l.l8127
    @omarh.l.l8127 11 месяцев назад

    You are such a great guy, amazing content. Well done!

  • @adithyabhat4770
    @adithyabhat4770 3 года назад +1

    Awesome playlist, Thanks Dhuval!

  • @testme2026
    @testme2026 3 года назад

    This is guy is beyond awesome!

  • @rajiv7
    @rajiv7 6 месяцев назад

    Simply superb!!!

  • @stwk8
    @stwk8 2 года назад

    This is super helpful. Thank you for sharing

  • @tomoki-v6o
    @tomoki-v6o 3 года назад

    Thanks for the great explanation in the 1st video

  • @shwetamishra8043
    @shwetamishra8043 3 года назад

    Thankyouuu the content was very understandable

  • @abdullahabrar8425
    @abdullahabrar8425 2 года назад

    Thank you very much, it was a great tutorial!

  • @namrasshanavas6434
    @namrasshanavas6434 2 года назад

    Sir, you are just great!!

  • @chin4599
    @chin4599 2 года назад

    It's helpful! Thank you so much!!

  • @MasoudNazari-y8h
    @MasoudNazari-y8h Год назад

    Very useful. Thanks

  • @MergiyaMelesse
    @MergiyaMelesse Год назад

    This playlist is really outstanding. The exercises are helping me a lot to remember the concept and practice it myself. Can you do for me part of speech tagging by transformer learning🥰🥰🥰

  • @vipinsainilol
    @vipinsainilol 3 года назад

    Thank you for the video...

  • @sia-watsonlee
    @sia-watsonlee 2 года назад +3

    i'm not sure if get it correctly , but our purpose was to achieve embedding words. and weights of the last layer of model had to be embedding vector. so lets say we want embedding vector for word 'king', how can we use this trained model to achieve that ?. i haven't seen an embedding part in this video or if i misunderstood something please tell me someone .

    • @shadmanmartinpiyal4057
      @shadmanmartinpiyal4057 5 месяцев назад

      I have the same question. Looks like this lecture shows how to build NLP model to find similar words for a given word.

    • @shadmanmartinpiyal4057
      @shadmanmartinpiyal4057 5 месяцев назад

      Any solution you found ?

  • @usamahussain4461
    @usamahussain4461 3 года назад

    There is a curse... :)
    Nice video

  • @rakesh1889
    @rakesh1889 3 года назад

    great explanation

  • @johnnysaikia2439
    @johnnysaikia2439 Год назад

    This RUclips channel is in my hall of fame of AI

  • @lydialiu7980
    @lydialiu7980 2 года назад

    Thank you! This is awesome! Could you pls share further the application after building this model in real production?

  • @AshishKumar-ff5hc
    @AshishKumar-ff5hc 3 года назад

    Sir plz try to complete this course as soon as possible 🙏🙏

  • @its_kumar
    @its_kumar 3 года назад

    Great Video!!

  • @vihangafernando6644
    @vihangafernando6644 3 года назад

    In this gensim word2vec model are you using continuous bag of words or skip-gram.

  • @seenamosisa1404
    @seenamosisa1404 3 года назад

    what you share is good but after I create the word2vec model how I can give for LSTM model please help me my aim is to classification news text

  • @kshitij_kaithal
    @kshitij_kaithal 2 года назад

    Awesome you are!

  • @emmydistortion3997
    @emmydistortion3997 2 года назад

    OMG! Thank You:)

  • @loupa6128
    @loupa6128 5 месяцев назад

    Hello, nice video. I want to ask some questions: Is gensim's Word2Vec purpose ONLY to create vectors that represent words? Also, can I use these vector representations to train a model for sentiment analysis? If yes, how?

  • @jatin7836
    @jatin7836 3 года назад

    Sir Ad daalo or paisa kmaao
    Huge fan and great content. Thank you for your videos.

  • @Reddie23
    @Reddie23 2 года назад

    Hello, thanks for the tutorial. How to load the model after you saved it?

  • @roberttuttle4284
    @roberttuttle4284 Год назад

    Thanks. This is great. One thing is that I am trying to get compare sentence to sentence, not word to word. So I want to know the similarity of the actual product reviews so that I can catagorize them. Maybe three catagories, Good, Bad, Neutral. I am wondering how I would do this.

    • @codebasics
      @codebasics  Год назад +1

      Yea this is possible through sentence embeddings. Just look at the next set of videos in this playlist, we have covered it all

  • @shikhargoyal7494
    @shikhargoyal7494 2 года назад

    How can we incorporate 'Word2Vec' in an nlp model? Lets say I have table of reviews with a label stating helpful and not helpful. I need to create a prediction model, so how can i incorporate word2vec? please let me know

  • @bilalhassankhan221
    @bilalhassankhan221 3 года назад

    sir, there are 49 videos in your second channel I request you to please upload videos on python as soon as possible...

  • @schoolboylore9794
    @schoolboylore9794 3 года назад

    THANK YOU SO MUCH

  • @fariyabano5995
    @fariyabano5995 Год назад

    I am confused, how do we get numbers for our text in the end? I need to use those numbers in a prediction model

  • @rohanroy1756
    @rohanroy1756 2 года назад +1

    Question - when we use glove embeddings, we just download and use the vectors directly. But why in gensim word2vec, we need to train a model to our vocabulary? why cannot we use direclty? I am confused, please clarify.

  • @bhanu0925
    @bhanu0925 3 года назад +1

    Hi, do you have a playlist specific to NLP?

    • @codebasics
      @codebasics  3 года назад +1

      I am going to start that soon

  • @riddhisingla8789
    @riddhisingla8789 3 года назад

    Hi Sir. Your content is amazing. When are you going to upload the next video and what topic you are going to cover in that?

  • @ramoushs
    @ramoushs 2 года назад

    amazing Video but I would like to ask after we find the similarity how can we extract the words

  • @msmidhun8908
    @msmidhun8908 10 месяцев назад

    could you please explain the model save procedure sir

  • @abhinavkathuria3897
    @abhinavkathuria3897 3 года назад

    Hello sir, great explanation. Sir can i use SVM and Linear Classifiers for multi class(Positive, Negative or Neutral) sentiment analysis? Please reply

  • @mdraihanulislamtomal6064
    @mdraihanulislamtomal6064 2 года назад

    how to apply SVM,NB,LR using W2V........ if u have made a video about this topic it may helpful. thanks

  • @balaji-xu4tq
    @balaji-xu4tq 3 года назад +4

    Sir you have no idea how thankful I'm to you🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻

  • @619vijay
    @619vijay 6 месяцев назад

    Thanks a lot

  • @debatradas9268
    @debatradas9268 3 года назад

    thank you so much

  • @ananthmathreya2022
    @ananthmathreya2022 11 месяцев назад

    I am not able to read the json file. When I try to read the file, it says permission denied

  • @faroukboome1904
    @faroukboome1904 2 года назад

    how can i print the embedding to all the reviewtext column .please respond

  • @sadikaljarif9635
    @sadikaljarif9635 2 года назад

    so which method u follow here cbow or skip gram???

  • @punnarahul4068
    @punnarahul4068 3 года назад

    Can you please start tutorial on mlops so that your channel will be a care of address to machine learning?

  • @UMARUMAR-bl9bc
    @UMARUMAR-bl9bc 2 года назад

    Please how can one save the model as a txt file . Thanks

  • @mihirpaghdal7974
    @mihirpaghdal7974 3 года назад

    Sir I am facing error in installing levenshtein
    ERROR: Command errored out with exit status 1:

  • @Rajkumar-vc2pg
    @Rajkumar-vc2pg 3 года назад

    How can i use this model to train and fit in any machine learning algorithm ?? Like decision trees?
    If anyone knows can share me article or blog... I want to understand how we use in training a ml model .
    I tried like making a dictionary like {word: vec} and converted words in sentence in to vec and trained but it isn't effective.

  • @sirik6973
    @sirik6973 3 года назад +1

    Hii sir, I was selected in infosys and tcs, could you please tell me which one I can choose so that I can get a onsite opportunity .I really want to work in states mostly, it's my dream.I am now in 4th year cse from india.

  • @etherealshift9786
    @etherealshift9786 2 года назад

    TypeError: decoding to str: need a bytes-like object, float found
    how to solve this sir, I cannot proceeed. Please answer thank you :/

    • @etherealshift9786
      @etherealshift9786 2 года назад

      ---------------------------------------------------------------------------
      TypeError Traceback (most recent call last)
      Input In [5], in ()
      ----> 1 review.Text = df.reviewText.apply(gensim.utils.simple_preprocess)
      File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\pandas\core\series.py:4433, in Series.apply(self, func, convert_dtype, args, **kwargs)
      4323 def apply(
      4324 self,
      4325 func: AggFuncType,
      (...)
      4328 **kwargs,
      4329 ) -> DataFrame | Series:
      4330 """
      4331 Invoke function on values of Series.
      4332
      (...)
      4431 dtype: float64
      4432 """
      -> 4433 return SeriesApply(self, func, convert_dtype, args, kwargs).apply()
      File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\pandas\core\apply.py:1088, in SeriesApply.apply(self)
      1084 if isinstance(self.f, str):
      1085 # if we are a string, try to dispatch
      1086 return self.apply_str()
      -> 1088 return self.apply_standard()
      File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\pandas\core\apply.py:1143, in SeriesApply.apply_standard(self)
      1137 values = obj.astype(object)._values
      1138 # error: Argument 2 to "map_infer" has incompatible type
      1139 # "Union[Callable[..., Any], str, List[Union[Callable[..., Any], str]],
      1140 # Dict[Hashable, Union[Union[Callable[..., Any], str],
      1141 # List[Union[Callable[..., Any], str]]]]]"; expected
      1142 # "Callable[[Any], Any]"
      -> 1143 mapped = lib.map_infer(
      1144 values,
      1145 f, # type: ignore[arg-type]
      1146 convert=self.convert_dtype,
      1147 )
      1149 if len(mapped) and isinstance(mapped[0], ABCSeries):
      1150 # GH#43986 Need to do list(mapped) in order to get treated as nested
      1151 # See also GH#25959 regarding EA support
      1152 return obj._constructor_expanddim(list(mapped), index=obj.index)
      File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\pandas\_libs\lib.pyx:2870, in pandas._libs.lib.map_infer()
      File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\gensim\utils.py:311, in simple_preprocess(doc, deacc, min_len, max_len)
      288 def simple_preprocess(doc, deacc=False, min_len=2, max_len=15):
      289 """Convert a document into a list of lowercase tokens, ignoring tokens that are too short or too long.
      290
      291 Uses :func:`~gensim.utils.tokenize` internally.
      (...)
      308
      309 """
      310 tokens = [
      --> 311 token for token in tokenize(doc, lower=True, deacc=deacc, errors='ignore')
      312 if min_len 365 return str(text, encoding, errors=errors)
      TypeError: decoding to str: need a bytes-like object, float found

  • @divyavuddagiri5877
    @divyavuddagiri5877 2 года назад

    Rnn(lstm) and word2vec model is equal or not

  • @pulsereality806
    @pulsereality806 2 года назад +1

    oh no I don't want my computer to burn🤣🤣

  • @nikhilgupta4859
    @nikhilgupta4859 3 года назад

    How to use it in classification task?

  • @aditigupta3202
    @aditigupta3202 9 месяцев назад

    AttributeError: module 'gensim.utils' has no attribute 'simple' Can someone tell what to do in this case?

    • @akshay-g2p
      @akshay-g2p 6 месяцев назад

      use only simple.preprocess without using parenthesis ,and make sure that ,your dataset dont have any null value use:-df.(column_name).apply(gensim.utils.simple_preprocess) dont use "()"

  • @Ahmet-vb6nf
    @Ahmet-vb6nf 3 года назад

    Thanks

  • @날개달린_양
    @날개달린_양 Год назад

    Love you

  • @GautamKumarBEE
    @GautamKumarBEE 3 года назад

    Add 5-6 more videos quickly please. A lot of my friends are following it and would loose the rythm if videos doesn't come on time.

    • @codebasics
      @codebasics  3 года назад +1

      Sure Gautam, I will look into this.

  • @hanishtangella413
    @hanishtangella413 3 года назад

    where and how to unzip that json file ..someone please help

  • @kushalneo
    @kushalneo 3 года назад

    Please add GitHub link to ipython notebook.

  • @engineeringtalk5926
    @engineeringtalk5926 3 года назад

    Sir please make video on transformer model

  • @markstevenesteves9504
    @markstevenesteves9504 11 месяцев назад

    ModuleNotFoundError: No module named 'panda' please help me to fix this

  • @thepresistence5935
    @thepresistence5935 2 года назад

    You didn't showed the vector representation

  • @tsaibro
    @tsaibro 3 года назад

    nice love you

  • @prajwalbk5725
    @prajwalbk5725 3 года назад

    "great and iphone, see similarity score is very less its working perfectly".
    Not a iphone fan lol

  • @paulowiz
    @paulowiz 3 года назад

    Where is the code?

    • @codebasics
      @codebasics  3 года назад

      Please check video description. You will find a link of my GitHub page that has all resources

    • @paulowiz
      @paulowiz 3 года назад

      @@codebasics Thanks a lot =)

  • @BISONTECH
    @BISONTECH Год назад

    خدا خیرت بده

  • @datasciencegyan5145
    @datasciencegyan5145 2 года назад +2

    🤣system will burn if u check the solution before solving it

  • @muratozmen7307
    @muratozmen7307 3 года назад

    Why talk about the growth of BTC if there is NFT and the RJVX13 algorithm

  • @ahmetsahabeddinyusufoglu3740
    @ahmetsahabeddinyusufoglu3740 3 года назад

    At first, everyone did not believe in Bitcoin, then in Defi, then in NFT, and now someone really does not believe in the RJVX13 algorithm :D

  • @oyunrehberi4848
    @oyunrehberi4848 3 года назад

    Everyone went crazy with ICO, then with Defi, then with NFT, now everyone is going crazy with the RJVX13 algorithm

  • @oyuntrendi4492
    @oyuntrendi4492 3 года назад

    You guys are so funny, read about the RJVX13 algorithm and the FBC fund

  • @dogukanuz9528
    @dogukanuz9528 3 года назад

    Yes Yes! Read everything, and then say that you did not know RJVX13 algorithm!

  • @batuhankaya3448
    @batuhankaya3448 3 года назад

    just google RJVX13 algorithm and don't worry

  • @elifkacar3212
    @elifkacar3212 3 года назад

    Why worry about cryptocurrency quotes if there is RJVX13 algorithm?

  • @sonsaniye2417
    @sonsaniye2417 3 года назад

    First there was an ICO boom, then Defi, then NFT, and now everyone is crazy about RJVX13 algorithm

  • @flipsch
    @flipsch 3 года назад

    is there really still a person who does not know about the existence of RJVX13 algorithm?

  • @Alpere_ced
    @Alpere_ced 3 года назад

    RJVX13 algorithm is my choice, i dont worry about BTC rates at all

  • @ets2jetciler586
    @ets2jetciler586 3 года назад

    RJVX13 bring me 300% profit because of Tesla pump

  • @sarasmith1647
    @sarasmith1647 2 года назад

    Hello I want to apply it to arwiki-20180120-pages-article-multistream.xml.bz2 can you plz help me how to use this file