How To Speed Up Pandas By 4X Times- Modin Pandas Library

Поделиться
HTML-код
  • Опубликовано: 10 сен 2024
  • github: github.com/kri...
    Unacademy Pinnacle: Comprehensive and Concise Track to Become an Expert (C++)
    unacademy.com/...
    Check out their Star educators here: unacademy.com/...
    ⭐ Kite is a free AI-powered coding assistant that will help you code faster and smarter. The Kite plugin integrates with all the top editors and IDEs to give you smart completions and documentation while you’re typing. I've been using Kite for a few months and I love it! www.kite.com/g...
    All Playlist In My channel
    Interview Playlist: • Machine Learning Inter...
    Complete DL Playlist: • Complete Road Map To P...
    Julia Playlist: • Tutorial 1- Introducti...
    Complete ML Playlist : • Complete Machine Learn...
    Complete NLP Playlist: • Natural Language Proce...
    Docker End To End Implementation: • Docker End to End Impl...
    Live stream Playlist: • Pytorch
    Machine Learning Pipelines: • Docker End to End Impl...
    Pytorch Playlist: • Pytorch
    Feature Engineering : • Feature Engineering
    Live Projects : • Live Projects
    Kaggle competition : • Kaggle Competitions
    Mongodb with Python : • MongoDb with Python
    MySQL With Python : • MYSQL Database With Py...
    Deployment Architectures: • Deployment Architectur...
    Amazon sagemaker : • Amazon SageMaker
    Please donate if you want to support the channel through GPay UPID,
    Gpay: krishnaik06@okicici
    Telegram link: t.me/joinchat/...
    Please join as a member in my channel to get additional benefits like materials in Data Science, live streaming for Members and many more
    / @krishnaik06
    Please do subscribe my other channel too
    / @krishnaikhindi
    Connect with me here:
    Twitter: / krishnaik06
    Facebook: / krishnaik06
    instagram: / krishnaik06

Комментарии • 44

  • @ShringarKashyap
    @ShringarKashyap 3 года назад +2

    Sir, Modin is an excellent library to speed things up- I tried it right away , but it still needs improvement when it comes to conditional value assigning and things like group by functions, as it might throw some errors based on the version.
    But apart from few setbacks, it is very very helpful when dealing with data which is huge in excel..
    Thank you sir !

  • @rishabhkumar-qs3jb
    @rishabhkumar-qs3jb 9 месяцев назад

    I was not aware about modin, awesome video to know about modin

  • @eugeneg3833
    @eugeneg3833 3 года назад +3

    Great video, please also make a tutorial on RAPIDS/CuDF

  • @avadheshchamola1513
    @avadheshchamola1513 3 года назад +3

    Sir, which laptop or CPU/GPU are you using for machine/Deep learning?

  • @mayursai7220
    @mayursai7220 3 года назад +3

    Bro please explain how to change my career path into cloud computing
    Currently i am working as uxdesigner
    Please do a video on that 🙏🙏

  • @ameermohamedr4982
    @ameermohamedr4982 3 года назад +3

    Please make some videos on Koalas and pyspark.

  • @azharsolkar7320
    @azharsolkar7320 3 года назад +3

    Much needed

  • @indhrakiranu3853
    @indhrakiranu3853 3 года назад +2

    Since modin has 70% of pandas, then can we use the both libraries interchangeably so that we can perform all the operations using pandas, i.e. import pandas as pd and import moding.pandas as pd1, now we use both in such a way that we can reduce time, is this possible??

    • @kumbalaanil8380
      @kumbalaanil8380 3 года назад +1

      yes

    • @indhrakiranu3853
      @indhrakiranu3853 3 года назад

      @@kumbalaanil8380 it means we can use, will there be any limitation?

    • @kumbalaanil8380
      @kumbalaanil8380 3 года назад +1

      @@indhrakiranu3853 if we consider.(import pandas as pd )and (import modin.pandas as pd1) so we can use both at any time
      Before that we need to restart the kernel

    • @indhrakiranu3853
      @indhrakiranu3853 3 года назад

      @@kumbalaanil8380 thanks got it

    • @엘더스크롤
      @엘더스크롤 3 года назад

      @@kumbalaanil8380 오.. 감사감사

  • @noobMLengineer
    @noobMLengineer 3 месяца назад

    How does modin perform for real-time ML pipeline? It's expected to receive about 10 data points per second

  • @vishalvanpariya1466
    @vishalvanpariya1466 3 года назад +3

    Sir please make video on tabnet

  • @nikt5678
    @nikt5678 3 года назад +2

    I have bachelor's degree in Bsc -IT. So it is necessary to complete master's in IT - MCA and then go for data scientist or data analytics field or directly go for data science course without doing masters in IT. please clear my doubt I am confused at this point please reply.
    without masters I get problems during interviews or compared to Engineering students.

    • @gokulakrishnanm
      @gokulakrishnanm 2 года назад

      Bro what you did? Did you get job with Bachelor or you take masters?

  • @sarahsindeband1508
    @sarahsindeband1508 Год назад

    I am receiving an error trying to install modin. Would anyone be able to help?

  • @sabyasachidas347
    @sabyasachidas347 2 года назад

    Thanks

  • @maheshmec1
    @maheshmec1 3 года назад

    it show error for modin. So before importing modin.pandas run following commands
    import ray
    ray.init()
    then
    import modin.pandas as pd

  • @reetikadhawan9399
    @reetikadhawan9399 3 года назад

    If the number of rows for x and y variable are not same to run regression.. what cud be done

  • @nadug3658
    @nadug3658 3 года назад

    Can we use modin library in a program where we are already using multiprocessing to speed up pandas library since modin uses multiprocessing internally??

  • @akshayr1263
    @akshayr1263 2 года назад

    Can we get all the features in pandas

  • @achintya_asthana
    @achintya_asthana 3 года назад

    Dataset Link is not mentioned in the description below
    Please mention the link

  • @venkateshnallapaneni8932
    @venkateshnallapaneni8932 3 года назад +1

    helpful thanks

  • @bhooshan25
    @bhooshan25 2 года назад

    does this help in Kaggle notebook also ?
    I will try now

  • @SUGATORAY
    @SUGATORAY 3 года назад

    What are your opinions on the use of swifter vs. modin for making pandas faster?

  • @siddharthm16
    @siddharthm16 3 года назад

    Will the effect also take place if we work on Google Colab?

  • @bhagotiashitanshu
    @bhagotiashitanshu 5 месяцев назад

    Dataset Link?

  • @kumararvind3933
    @kumararvind3933 2 года назад

    Krish Sir,after intallation modin, processing time turn more slower

  • @dps158
    @dps158 3 года назад

    Krish, it works on GPGPU also ??

  • @iftikhar3609
    @iftikhar3609 3 года назад +1

    Sir Do you have any community like Discord or slack for Data Science? if yes then please share it here

    • @janakiraam1
      @janakiraam1 3 года назад

      Yes krish sir have a discord community and also telegram community

  • @muhammadtanveerislam5998
    @muhammadtanveerislam5998 3 года назад

    very useful video

  • @Gamer_hai_hum
    @Gamer_hai_hum 3 года назад +1

    Sir from 3 video I'm asking can u please reply to my msg I need ur help to learn video about ML and DL with projects can u send ur link please

    • @krishnaik06
      @krishnaik06  3 года назад +1

      Please check the live stream playlist

    • @rajatdev2315
      @rajatdev2315 3 года назад +2

      Please refer course provided by learnbay

  • @Raja-tt4ll
    @Raja-tt4ll 3 года назад

    Nice

  • @janakiraam1
    @janakiraam1 3 года назад

    When i am executing first time import modin.pandas as pd i am getting below error:
    ConnectionError: Error 10060 connecting to 192.168.1.105:6379. A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.
    When i am executing import modin.pandas as pd second time getting below error:
    RuntimeError: Unable to connect to Redis at 127.0.0.1:6379.
    But when i try to import modin no error, can anyone help me here?

  • @jagadeeshabburi570
    @jagadeeshabburi570 3 года назад +1

    Krish is not a name it's a brand

  • @noobMLengineer
    @noobMLengineer 3 месяца назад

    How does modin perform on real-time ML pipeline? It's expected to ingest 10 data points per second

  • @matimba
    @matimba 3 года назад +1

    Thanks