Parallel HTTP requests using requests_futures

Поделиться
HTML-код
  • Опубликовано: 14 ноя 2024

Комментарии • 25

  • @ananyasrivastava5128
    @ananyasrivastava5128 4 года назад +4

    what you talked about the time is just breathtaking when heard it first time.

  • @jayaramkrishnakumar68
    @jayaramkrishnakumar68 5 лет назад +2

    I do learn best magical ways from your knowledge share. thanks for it and keep posting the awesome contents

  • @davidweinstein1943
    @davidweinstein1943 3 года назад

    Thanks for your video. It was useful, clearly explained and at the right pace!

  • @nilavarasan_v
    @nilavarasan_v Год назад

    Use C# for multi threading

  • @dennisasamoah2213
    @dennisasamoah2213 5 лет назад +1

    Really helpful

  • @himanshu3984
    @himanshu3984 Год назад

    What if we have to print the url also along with its status code?

  • @maheshsohan6331
    @maheshsohan6331 4 года назад +1

    Is there a way we can run these requests.get calls using asyncio... Like calling async function using sync function ?

  • @mithunnambiar1433
    @mithunnambiar1433 3 года назад

    Nice video. How do we convert the 'future' object that is returned into json or a valid data?

  • @lucastorres394
    @lucastorres394 3 года назад

    Are the results sorted? (Comparing to 'urls' index)

  • @himanshuranjan7021
    @himanshuranjan7021 4 года назад

    Just a quick question, i want to add the session.status_code feature of the request library in this concurrent.futures module, please tell me what i have to add, the code that you have shown in this video just uses session.get(url) but when i change it to session.get(url).status_code , it gives me an error, Please help!

  • @IndianPythonista
    @IndianPythonista  5 лет назад

    Code here: gist.github.com/nikhilkumarsingh/1808f161c0fb8f6bb1b792c782340921

  • @mithunnambiar1433
    @mithunnambiar1433 3 года назад

    first, it's a fantastic video. How to capture errors in this case? Just imagine, if one of the requests threw an error. How can we capture it.

  • @mehmetkollama
    @mehmetkollama 4 года назад

    Life saver

  • @nsnilesh604
    @nsnilesh604 3 года назад

    How to add user agent or headers with future session

  • @zarvispattionson8051
    @zarvispattionson8051 4 года назад

    What if i have not fixed urls?

  • @koh8614
    @koh8614 4 года назад

    I'm sorry but how does this affect internet congestion?

  • @drac8854
    @drac8854 4 года назад

    With request object we can do something like request.ok which gives true when response code is 200
    How to don it with future object?
    Edited :
    I am too freaking stupid i got my mistake just read the docs u can find it out too

  • @nirakarpadhy
    @nirakarpadhy 3 года назад

    !!! PETITION for making tutorials using examples of "POST" requests !!!
    @IndianPythonista
    Why does every tutorial and blog post always assume we only only need "get" requests?
    I try to implement the same code for "post" requests and I run into all sorts of errors.
    I wish you or someone on this earth for once did tutorials for fast http post requests.

  • @ThePirateHistory
    @ThePirateHistory 5 лет назад +2

    Useless lesson, where to apply it? if you used at least ThreadPoolExecturor, then this could be laid out, but such.
    Now everything works through javascript, respectively, you need to parse and run js, requests_html does not work well
    with async io, there you can use multyproces and multy threads if make that tutorial, it wil be realy good video!!

    • @IndianPythonista
      @IndianPythonista  5 лет назад +1

      The main intention is to introduce the viewer to requests_futures library which provides nice abstraction over ThreadPoolExecuter and ProcessPoolExexuter and let's you run concurrent code for requests library. This can be applied to any scenario where you have to send http requests in a batch. Good for scraping and crawling tasks.
      Think of the code presented in this video as an encapsulated version of what you will do using threading and multiprocessing library yourself.

    • @djebbaranon5892
      @djebbaranon5892 4 года назад +1

      Lol jalouse 😂😂 because he is better than u

  • @yaldramshahzad6281
    @yaldramshahzad6281 3 года назад

    help meee mannn