Talks - Łukasz Langa: Working Around the GIL with asyncio

Поделиться
HTML-код
  • Опубликовано: 1 июн 2023
  • You've heard it many times: the GIL is a problem for using all your CPU cores in one program. Among the generally accepted solutions there's multiprocessing, a way to orchestrate a group of worker processes to spread CPU load over many cores. This solves the problem for many use cases but if you have a lot of data to pass around there and back again, it's much less efficient.
    In this short talk we'll go through two examples of data processing with Python 3.11 and how asyncio with shared memory helps speed things up. To cover all bases, one example will run on macOS, the other on Windows Subsystem for Linux. You'll see how the built-in building blocks of Python allow to compose scalable systems. Our focus is on the base programming language. We won't be reimplementing data pipelines or covering any MLops best practices.

Комментарии • 6

  • @stevenwilson2292
    @stevenwilson2292 5 месяцев назад +5

    WTF was up with the virtue signalling at the beginning. Barf.

  • @eternalcheesecake
    @eternalcheesecake 11 месяцев назад +9

    So it seems that the presenter feels he needs to tell his audience what to believe right at the start of the technical talk? Isn't that a bait and switch? They came to a technical talk but are being hit with a divisive political position? Will his next talk be prefaced with his religious position as well? No thanks.

    • @versacebroccoli7238
      @versacebroccoli7238 10 месяцев назад

      What he said wasn't political. You would have to be a self outing biggot to read it that way.

    • @username2630
      @username2630 9 месяцев назад +1

      "some people should have human rights" is indeed an extremely divisive political position

    • @unperrier5998
      @unperrier5998 9 месяцев назад +1

      Not surprising that he works a Meta. I wouldn't have been surprised had he worked at Twitter too (not X obviously)

    • @eternalcheesecake
      @eternalcheesecake 9 месяцев назад

      @@username2630How interesting that that's what you think I'm referring to.