Building A Custom Context Manager In Python: A Closer Look

Поделиться
HTML-код
  • Опубликовано: 11 ноя 2024

Комментарии • 99

  • @ArjanCodes
    @ArjanCodes  Год назад

    💡 Get my FREE 7-step guide to help you consistently design great software: arjancodes.com/designguide.

  • @bigdaddy5303
    @bigdaddy5303 2 года назад +12

    Really glad I came across this channel. Been dabbling in python for about 4 months and have made some really good progress. Feel confident I can create everything I want, but I'm a chemical engineer, not a coder....but I want to create good habits and make stuff that a coder will not roll their eyes reading. This is the first channel that just skips the same repetitive basic coding stuff 99% of channels focus on and just focuses on being a smart coder. And it's all delivered so well. I find I learn more in a 10 minute video from you than some of these bigger channels don't even do in a 2 hour video. Plus your fast typing is so soothing lol.

  • @HeyThisIsAndrew
    @HeyThisIsAndrew 2 года назад +21

    It’s like your reading my mind. I wish I had a channel this good to help me improve with my understanding of Git CI/CD workflows and pipelines.

    • @ArjanCodes
      @ArjanCodes  2 года назад +13

      Glad you're enjoying it! I'll probably cover topics like this in the future (I'm working on a more generic DevOps video at the moment).

    • @Jordanmbr
      @Jordanmbr 2 года назад +4

      I feel the same way, Git CI/CD workflows and documentation is not always beginner friendly

  • @ibrahimtprdk6622
    @ibrahimtprdk6622 2 года назад +1

    I downloaded the document and didn't even realize I finished it in one go. Thank you for your thoughts and valuable information

    • @ArjanCodes
      @ArjanCodes  2 года назад

      Thanks so much Ibrahim, glad the content is helpful!

  • @AustinWitherspoon
    @AustinWitherspoon 2 года назад +12

    I knew about the class version of a context manager- but never knew about the function decorator version! Super cool.

  • @graveetone
    @graveetone Год назад

    thank you for covering this topic, specially for the async part of working with context managers!

    • @ArjanCodes
      @ArjanCodes  Год назад

      I'm glad you found the video helpful!

  • @djl3009
    @djl3009 2 года назад +2

    Nicely done! concise and thorough. I looked into custom context managers a few months ago and like many, settled on the class version, but after this video I think I'll be leaning towards the decorator.

  • @vasilijestosic8331
    @vasilijestosic8331 2 года назад

    Today I actually worked with custom context manager, dealing with FTP connections. This video is really good for deeper understanding of context mangers. Well done! 👏👏

  • @1337Hammersmith
    @1337Hammersmith 2 года назад +1

    It's amusing that this was the exact thing i stopped on this week, and thought, there has to be an easier way to manage contexts :)
    Insightful and well paced as always

  • @xaco56
    @xaco56 2 года назад +2

    Thanks for a fine explanation of context managers. A small quibble: I don't think "with" makes a new scope, because I have code that assigns a buffer to a new variable within a "with" and then accesses the variable outside of the "with" just fine.

  • @kemalcihanbastak8476
    @kemalcihanbastak8476 2 года назад +12

    Since you used yield function in connection part, can you make a video about when to use yield instead of return

    • @ArjanCodes
      @ArjanCodes  2 года назад +5

      Thanks for the suggestion!

    • @pranavnyavanandi9710
      @pranavnyavanandi9710 2 года назад +1

      Yes generators, iterators and descriptors, I have a hard time grasping them.

  • @rakesha9176
    @rakesha9176 2 года назад +3

    Your content is excellent and the quality of the videos are Top Notch. You deserve alot of views and subs ❣️🔥

    • @ArjanCodes
      @ArjanCodes  2 года назад +1

      Thank you so much 😄

  • @virtualraider
    @virtualraider 2 года назад +4

    Love the video! Just a small nitpick: I wouldn't put the commit inside finally, because you don't want to save things in a dirty state.
    I would put it on the else condition, or better yet, in a transaction context manager 🤓

  • @j.reddick5585
    @j.reddick5585 2 года назад +1

    Man! Every clip always has some depths! Love all the series! BTW, is there any chance that we can see UNCLE BOB explains how the INFAMOUS thread works in Python? lol

    • @pranavnyavanandi9710
      @pranavnyavanandi9710 2 года назад

      Yes, about the GIL and python not supporting multithreading.

  • @jordansilke3629
    @jordansilke3629 2 года назад +1

    Helpful video with clear, practical examples as always!

  • @rrwoodyt
    @rrwoodyt 2 года назад +3

    Very timely video, considering what I'm working on today. I actually prefer the class-based context manager to the decorator version, though that is probably because I haven't used generators that much. Anyway, nice work on the video.

    • @felipealvarez1982
      @felipealvarez1982 2 года назад +1

      Hi Roy. I don't think you need to 'understand' the generator function. They way you _use_ it does not change. It is an implementation detail which can be ignored.

    • @rrwoodyt
      @rrwoodyt 2 года назад

      @@felipealvarez1982 You are absolutely right. As far as the implementation goes though, I find the class-based version more intuitive, and that's what I would do. I definitely appreciate the elegance of the generator version.

  • @davidbundgaard
    @davidbundgaard 2 года назад

    Interesting stuff, where was this when I needed this. Moved on to other languages for my app development.

  • @manonthedollar
    @manonthedollar 2 года назад +7

    In production code, would you put the entire `with` block inside a `try` block for cases where a connection can't be made (maybe application.db can't be opened and so the `finally` block would throw an exception too)? That's where I start to lose confidence in my design, because especially when I'm doing more than just a couple of things with an open db connection or file handle, most of my code is indented several levels inside some sort of massive function->try->with structure and it "feels" wrong but I don't know what I could be doing better.

    • @felipealvarez1982
      @felipealvarez1982 2 года назад

      Ajan codes discord channel can help. Share your code examples there 😊

    • @lawrencedoliveiro9104
      @lawrencedoliveiro9104 2 года назад

      I try to design my cleanup code to never throw an error. So for example if a connection was never opened, then the connection-closing logic should automatically become a noop in this case. That helps to keep things simple.

  • @golammuhaimeen2825
    @golammuhaimeen2825 2 года назад

    Soo good man! Great stuff! Love it!

  • @AlpNixTech
    @AlpNixTech 2 года назад

    Cool! It's nice to know there are much more uses cases of context managers than opening and closing files 😅

  • @qbrteam6398
    @qbrteam6398 2 года назад +1

    I would love to see a real life implementation of the hexagonal architecture using python. I haven't been able to see anything similar on RUclips.

  • @ali-om4uv
    @ali-om4uv 2 года назад

    Super helpfull video! I have hower some problems putting this to an actual usage. Lets say i want to have a databasemanager class that that handles all conection. Can create a new db on a server create new tables on existing dbs.....delete those . Further more it should be able to execute parameterized querrys were the querry is a variable and so on .... How would something like this been done professionally? Especially if we are dealing with a remote lets say sql server instance?

  • @miguelvasquez9849
    @miguelvasquez9849 2 года назад

    I already knew this, but what a good video

    • @ArjanCodes
      @ArjanCodes  2 года назад +1

      Thank you Miguel, glad you liked the video!

  • @siriusraja
    @siriusraja 2 года назад

    Hi Arjan, How do we implement connection pooling in this case? Do we need to move the connection creation line outside of the function?

  • @temik26
    @temik26 2 года назад

    Thanks for videos Arjan, they're helpful. First time I got acquainted with context managers is when I read Python Tricks book by Dan Bader

    • @ArjanCodes
      @ArjanCodes  2 года назад

      Thank you - glad you like the videos!

  • @tobiastriesch3736
    @tobiastriesch3736 2 года назад +2

    Cool video! I learn something new every time :)
    I also have a suggested topic/question:
    What's your take on normal SQL queries vs object-relational mappings, e.g. using SQLalchemy? Do or do not? How can I make best use of context managers here?

    • @joaquimt.duarte2538
      @joaquimt.duarte2538 Год назад

      I think these days I feel like trying we will have the best transpilers with AI. Like you write it in a simple library like tortoise orm or Django and it turns into more native and faster code.

  • @DrGreenGiant
    @DrGreenGiant 2 года назад

    Is there a way of using a context managed object at class scope rather than function scope. For example, acquiring the resource in __init__ then releasing it when the object gets destroyed. Hypothetical example; a logger class that opens a file when it is created, closes when destroyed.
    For context, I have a very performant function which extracts data from an FPGA, does some maths then needs to be logged. I don't like the idea of having to do a "with open(fn) as f" in every single loop for performance. (This is running at 2kHz and the "while" isn't even in this function contained by this class)

  • @ishtiaquehussain
    @ishtiaquehussain 2 года назад

    Learned something new, as always! Thank you! (btw, also learned how to pronounce your name, I was wrong the whole time) :D

  • @ipelezikis
    @ipelezikis Год назад

    This is a video I was looking for! A question. Why commit is included in a finally block and not in an else block. Is there a certain logic on why one is prefered than the other? Thanks in advance

  • @ade_niko
    @ade_niko 2 года назад

    What will be the return type for open_db method in this case?

  • @zenmaster24
    @zenmaster24 2 года назад

    do any of the ways shown have performance repercussions? would one way be more performant than another?

  • @kopytko998
    @kopytko998 2 года назад

    I have impression you are looking into my daily activity and send me suggestions how to improve my code :) Thank you

  • @thejedijohn
    @thejedijohn 2 года назад

    Great video. Loved the much steadier camera angles. And I learned about the context manager decorator. I didn't know we could write our own context managers without explicitly writing the dunder functions. Thanks!

  • @brianpack369
    @brianpack369 Год назад +1

    Using non invisible characters to define code blocks? We've gone full circle, everyone.

  • @aadithyavarma
    @aadithyavarma 2 года назад

    At min 9:00, how does the try work with only a finally and without an except. Shouldn't you always have a except for the try block?

  • @tuverentetil
    @tuverentetil 2 года назад

    Hi Arjan, can you also add snippets how to test code you're writing ? Seems that test are largely overlooked i.e i'd like to learn how to use pytest with context manager.

  • @ShlomoGottlieb
    @ShlomoGottlieb 2 года назад

    Video idea:
    Python coroutines and how it's used with 'yield' and 'yield from'. No matter how many times I look it up, I never manage to wrap my head around it.

  • @rahulprasad2318
    @rahulprasad2318 2 года назад +5

    Tbh, i like the class version better.

  • @JorgeEscobarMX
    @JorgeEscobarMX Месяц назад

    I learnt how to create my own context managers using classes and decorators.
    I got lost on async. Because I don't understand what async does, but I have seen it on web development programs.

  • @stefans8632
    @stefans8632 2 года назад

    Hi there,
    could you please me do download and install these 2 packages logging and sqlite3 ? Beause i tried from pycharm and comand prompt but without success :
    pip install logging
    ERROR: Could not find a version that satisfies the requirement logging (from versions: 0.4.9.6)
    ERROR: No matching distribution found for logging
    pip install sqlite3
    ERROR: Could not find a version that satisfies the requirement sqlite3 (from versions: none)
    ERROR: No matching distribution found for sqlite3
    Thanks,

  • @DmitryKorDimKorzunin
    @DmitryKorDimKorzunin 2 года назад

    What is the code hinting when you start the coding, is it some vscode extension?

    • @ArjanCodes
      @ArjanCodes  2 года назад

      I’m using GitHub Copilot here for code suggestions.

  • @flightmansam
    @flightmansam 2 года назад

    I like your style

  • @dponcelas
    @dponcelas 2 года назад

    Great video as always.
    It would be nice if you make a video explaining generators and coroutines in detailed, just as an idea 😊

  • @taglud
    @taglud 2 месяца назад

    A really good video

  • @channalbert
    @channalbert 2 года назад

    I might be missing the point here, but what is the difference between putting “connection.close()” after a try-catch clause and adding it inside “finally”?

    • @estebanartavia7827
      @estebanartavia7827 2 года назад +1

      If you put it outside and your code raises an exception, your connection will be still open depending on the error because your execution might finish before touching that line. Finally executes regardless of a failure or exception.

    • @channalbert
      @channalbert 2 года назад +1

      @@estebanartavia7827 wow! I knew there had to be a reason. Thank you.

  • @nateriver8261
    @nateriver8261 2 года назад

    Make please a video about descriptors and their role in a python ecosystem

  • @monooo
    @monooo 2 года назад +1

    Nice video

  • @Khushpich
    @Khushpich 2 года назад

    Cool video and nice beard Arjan

  • @richard1598
    @richard1598 2 года назад

    A bit out of context (no pun intended ;-): why I need to declare a function explicitely as "async" (as in async def main()" when using an async-y keyword or calling some async function makes it cristal clear, that the function itself is per definition async? Saw this in multiple languages already and always asked myself "wth" is this boilerplate for?

  • @maroben225
    @maroben225 2 года назад +1

    How the fuck i did not fi'd your channel earlier !!! Man my youtube is all about tech and python stuff how come never found you !!! Please try promoting ur channel somehow
    I am learning great stuff feom you especially we are hungry for more design patterns and new python stuff.
    Also of you can make videos about driven events in python...or probably also covering fastapi with its pydantic models and dive deeper ... You can go deeper in dependency injection and pydantic models sqlchemy ...please consider this.
    And like man seriously im sooo fucking happy fouding a senior like you 🎉🎉🎉🎉🎉

    • @ArjanCodes
      @ArjanCodes  2 года назад +2

      Thanks so much! Glad that you’re here and thanks for the suggestion!

  • @farazahmed1668
    @farazahmed1668 5 месяцев назад

    Why we need to close the database connection every time?

    • @ArjanCodes
      @ArjanCodes  5 месяцев назад +1

      Databases will have a maximum number of connections. If you don't close the connection, the number of open connections just goes up and the database won't accept new connections once you reach the maximum and then your application stops working.

    • @farazahmed1668
      @farazahmed1668 5 месяцев назад

      ​@@ArjanCodeswow its so simple. so that's why we need to close the connection every time. thank you MR. Arjan.

    • @ArjanCodes
      @ArjanCodes  5 месяцев назад

      You’re welcome!

  • @vincenzo-cortino
    @vincenzo-cortino 2 года назад

    afaik with statement doesn't create a scope

  • @ekebro
    @ekebro 2 года назад +1

    I just have to protest. SQLute is an objectively better name for the class. When in doubt, go for the musical alternative.

    • @ArjanCodes
      @ArjanCodes  2 года назад

      Haha, I was definitely fighting with my keyboard there 😂

    • @quillaja
      @quillaja Год назад +1

      @@ArjanCodes I appreciate watching you mess up typing in your videos. It makes me feel like I'm not the only fat fingered keyboard klutz programmer.

  • @danielcrompton7818
    @danielcrompton7818 7 месяцев назад

    I still don’t get why you yield not return…

  • @nathantoulbert4406
    @nathantoulbert4406 2 года назад

    I really hope I'm a seagull in my next life. Just imagine living life as the shitter, and not the shittee!!!

  • @art4eigen93
    @art4eigen93 Год назад

    Tapped in for a seagull manager video but totally disappointed to see no seagulls. Disliked :p

  • @k.s.chaithanya121
    @k.s.chaithanya121 2 года назад

    First comment