Scaling Distributed Systems - Software Architecture Introduction (part 2)

Поделиться
HTML-код
  • Опубликовано: 12 дек 2024

Комментарии • 101

  • @ADevStory
    @ADevStory  6 месяцев назад

    Hey folks!👋 Want to have hands-on practice on these concepts? 🤓
    Try out CodeCrafters.io we have partnered and you can get 40% off 💸with this link: app.codecrafters.io/join?via=DevStory
    They have great hands-on tutorials and easy to get up to speed with complex systems. Check them out!

  • @AshrafSada
    @AshrafSada 3 года назад +24

    Thank you for the rarely discussed topics about at the essence of software engineering on RUclips, these information can be found in books (expensive ones), and universities in theory only, but you put such a great effort to explain in simple basic way practical use-case scenario of such concepts, great work keep it going.

    • @ADevStory
      @ADevStory  3 года назад +3

      Oh really nice comment! Thank you very much and I'm glad you enjoyed it!

  • @RealGameTitan
    @RealGameTitan 4 года назад +18

    Your handwriting is really impeccable.

    • @ADevStory
      @ADevStory  4 года назад +1

      Thank you very much. Not my proudest skill xD

  • @Pritzier
    @Pritzier 4 года назад +16

    Very underrated channel!

    • @ADevStory
      @ADevStory  4 года назад +1

      Thank you! I guess it's mostly that's newer. I need to get the word spread xD

  • @marlonconrado6136
    @marlonconrado6136 3 года назад +2

    This kind of video should have more likes.

  • @Kyrogue
    @Kyrogue 3 года назад +7

    Thanks for the series, love the explanations followed by practical examples!

  • @tumultuousgamer
    @tumultuousgamer 2 года назад +1

    I knew these concepts, but putting them together like that was great! Thanks!

    • @ADevStory
      @ADevStory  2 года назад +1

      Glad it was useful!

  • @astuteToddler
    @astuteToddler 2 года назад +1

    Every concept is concise, clear and gradual. Best video I have watched so far. Thanks a lot 😊

    • @ADevStory
      @ADevStory  2 года назад

      You are welcome! Glad you enjoyed the video :)

  • @stachowi
    @stachowi 3 года назад +6

    wow, your videos are technically accurate, and to the point! just subscribed thank you!

    • @ADevStory
      @ADevStory  3 года назад

      Thank you! Hopefully more content coming soon!

  • @curiousgeorge6307
    @curiousgeorge6307 2 года назад +2

    Thank you so much for these videos!! So helpful and so well-explained

    • @ADevStory
      @ADevStory  2 года назад

      Glad it was useful to you! If you would like me to explain another topic feel free to suggest 😁

  • @VitaliiKhotei
    @VitaliiKhotei Год назад +1

    Very cool series, keep going man!

    • @ADevStory
      @ADevStory  Год назад

      Thanks! Glad you liked it!

  • @publicfare8939
    @publicfare8939 4 года назад +3

    Thanks for sharing, great video!

  • @dadaabiola2474
    @dadaabiola2474 2 года назад +1

    Game changer! 👍

  • @rajarshibarman4474
    @rajarshibarman4474 3 года назад +4

    Great content hope you will add more videos to this software architecture series... and if you dont mind can you also make a video on what books, courses, etc you used to learn about software architecture?

    • @ADevStory
      @ADevStory  3 года назад +1

      Oh yeah. A good idea! Just in case, I've put some recommended books/links in the description, but definitely a video would be cool too.

  • @chithiravelupothirajan9974
    @chithiravelupothirajan9974 10 месяцев назад +1

    Hi Chiristian, Great Content, Thanks for this wonderful video. I have one question, what is that BE represents in your layered architecture diagram?

    • @ADevStory
      @ADevStory  10 месяцев назад +1

      Thank you! Glad you liked it.
      BE represents an instance of the Back-End service

  • @hurk991
    @hurk991 Год назад +1

    great series!

    • @ADevStory
      @ADevStory  Год назад

      Thanks! Glad you liked it!

  • @JuMiMi86
    @JuMiMi86 3 года назад +1

    Thank you; incredibly helpful

  • @bookhaven6689
    @bookhaven6689 3 года назад +1

    thanks for sharing! very helpful!

  • @abhishek-94
    @abhishek-94 10 месяцев назад

    Hi, your channel is very good! Please make more videos on all aspects of system design and architecture.
    You mentioned horizontal scaling is not cheap to do? Isn't the reverse true, as we can get a lot of commodity hardware when we want, unlike in case of vertical scaling where we need a expensive machine.

    • @ADevStory
      @ADevStory  10 месяцев назад

      Hello! thanks! I'm glad you are enjoying the content!
      So in terms of hardware, commodity hardware is cheaper but you need many more than just one server. But I was referring mostly to the architecture complexity of building software that scales horizontally vs vertically. You need to take way more considerations like load balancing, network, consistency level, transactions, etc
      Hope is clear now :)

  • @kayeshparvez
    @kayeshparvez 3 года назад +2

    Thank you for the video. One question: if the databases are separate then how will they be synched ? and what did you actually mean by "keeping state" ?

    • @ADevStory
      @ADevStory  3 года назад +4

      So if you want to have the database separated there are different ways. One of the most common and easiest ones is by doing sharding (explained in the video), which means dividing the data in different sets and storing them separately. If you want to keep replicas of the same information, other complexities arise, like certain coordination (aka consensus) between the different database instances.
      Keeping state means any type of data that you want to store or modify. From a user session to any specific data related to your business.
      Hope is clearer :)

    • @kayeshparvez
      @kayeshparvez 3 года назад +2

      @@ADevStory got it now, thanks for clear explanation ❤️

    • @ADevStory
      @ADevStory  3 года назад +1

      Anytime!

  • @rexcode1759
    @rexcode1759 3 года назад +2

    your drawings really help

  • @HectorChozaGaribay
    @HectorChozaGaribay 9 месяцев назад +1

    Muy buen video. Saluos desde México

  • @kspv2806
    @kspv2806 2 года назад +1

    very helpful thanks

  • @peiliangyuan9420
    @peiliangyuan9420 Год назад +1

    Can you please help me what "BE1" and "BE2" mean around 5:23? Does BE mean balance equalizer? Please help. Thanks.

    • @ADevStory
      @ADevStory  Год назад +1

      BE means Back-end. Just a representation of a service

    • @peiliangyuan9420
      @peiliangyuan9420 Год назад +1

      Thank you so much for your quick response! Very helpful!

    • @ADevStory
      @ADevStory  Год назад

      Happy to help!

  • @ricardoolartepuell2011
    @ricardoolartepuell2011 2 года назад +1

    Great information!! what do you mean with "state" for the CAP Theorem?? :)

    • @ADevStory
      @ADevStory  2 года назад +2

      Glad you liked it!
      What I mean by state is basically data that resides on a specific server . If all your servers were equal there's no problem if the network partitions, but that's only possible if they are _stateless_.
      For example: if the servers just do sum of 2 number that you send on your request, in case of failure of some servers there's no problem regarding CAP.
      On the other hand if you are handling data, say you register new products in a catalog in the servers, if they all save data to a common database, the risk is in the database going down. If you have multiple instances of the database where you write to, they have to sync between them. And that's when the CAP theorem applies.

  • @ivandrofly
    @ivandrofly 7 месяцев назад +2

    Thank you :)

    • @ADevStory
      @ADevStory  7 месяцев назад +1

      You're welcome!

  • @BeSharpInCSharp
    @BeSharpInCSharp 3 года назад +1

    perfect video. keep them coming...

    • @ADevStory
      @ADevStory  3 года назад

      Thank you! Any specific topic you would like to see?

    • @wdj5922
      @wdj5922 3 года назад +1

      @@ADevStory resiliency, performance, database types (cassandra, HDFS, ...), datalake vs datawarehouse, microservices, principles of Kubernetes & Docker

  • @SuSu-zd9vb
    @SuSu-zd9vb Год назад +1

    Thank you!

  • @ntcuong01ct1
    @ntcuong01ct1 2 года назад

    Dear Friends,
    When I design a software system, I divide it into 3 categories:
    1/ Conceptual: I will state the names of the software that will respond to the requirements of the business process from users, describe the names of the software to be processed and the behaviors.
    2/ Logical: I can define software architecture by applying architectural pattern in this step and I will include constraints on availability, scalability, maintainability. I also describe in detail the function of each component. This step
    3/ Physical: Define programming language, platform to realize the description in Logical step.
    Could you recommend?. Thank you.

  • @safetime100
    @safetime100 2 года назад +1

    Very nice 👍 thanks

  • @navjotsingh2457
    @navjotsingh2457 2 года назад +1

    ty

  • @chrispure7461
    @chrispure7461 2 года назад +1

    Since you are partitioning DB in to multiple DB's , BE1,BE2,BE3 are not connected to DB1,DB2,DB3 right? any BE server can send requests to any DB server based on hashvalue ? got bit confused by diagram

    • @ADevStory
      @ADevStory  2 года назад

      Great question! It's actually left intentionally vague. It can be either way depending if you are going for replication or sharing. In sharding you could make a backend talk to different DBs based on a hash value for example. But in replication you could make it only read from a specific instance. If you need write, and want to scale the data layer (DB) then the backend s should either be able to pick a db to write to or there would another piece in the middle redirecting the traffic to the specific db instance
      Hope is clearer!

  • @breakoutgaffe4027
    @breakoutgaffe4027 4 года назад +1

    Great video

  • @LightVibrationPresenseKindness
    @LightVibrationPresenseKindness 11 месяцев назад +1

    great channe!

    • @ADevStory
      @ADevStory  11 месяцев назад

      Thank you! Glad you liked it!

  • @AhmadNurzidRosli
    @AhmadNurzidRosli 2 года назад +1

    Hi Dev, i have one silly question....what is actually state and stateless means here?

    • @ADevStory
      @ADevStory  2 года назад

      Hi!
      So basically state means if you store any type of data.
      For example: if you have a service that when it receives 2 numbers it returns the sum of them it would be stateless. If you have a service that serves as a contact list and whenever you ask for a user it returns the phone number if it was registered, the phone number would be the state.
      Hope it's clearer

    • @AhmadNurzidRosli
      @AhmadNurzidRosli 2 года назад

      ​@@ADevStory Thanks for your prompt respond Dev. It's really helps.
      Thanks again for the explanation.

  • @bito2437
    @bito2437 3 года назад +1

    Good learning

  • @hasnathridoy
    @hasnathridoy Год назад

    Bro what do you mean by BE1, BE2, BE3 on the figure? 5:23

    • @ADevStory
      @ADevStory  Год назад

      I just meant different backend instances (BackEnd instance 1, BackEnd instance 2 and BackEnd instance 3)

  • @amirmhanna3997
    @amirmhanna3997 3 года назад +2

    What's the meaning of the term "state"?

    • @ADevStory
      @ADevStory  3 года назад +3

      State means data. It's the information you operate on and/or want to store. Is it clearer ?

  • @nihadawad4681
    @nihadawad4681 3 года назад +1

    thank you

  • @MansiMasi
    @MansiMasi 3 года назад +1

    What does "BE" stand for in the diagram?

    • @ADevStory
      @ADevStory  3 года назад +1

      It stands for Back End

    • @MansiMasi
      @MansiMasi 3 года назад +1

      @@ADevStory thank you!

    • @MansiMasi
      @MansiMasi 3 года назад

      @@ADevStory so you’re saying the nodes are back end components that get distributed to the database, right?

    • @ADevStory
      @ADevStory  3 года назад

      Kind of. I mean that you can distribute the processing and the data in different nodes.
      For example: if you need to do more processing, you can have multiple backend nodes to do the processing. And for the database you can do the same splitting the load between different databases.
      Not sure if it's clearer 😅

    • @ADevStory
      @ADevStory  3 года назад

      Anytime!

  • @Mndeto
    @Mndeto 3 года назад +1

    Thanks!

  • @32342dsfdsv
    @32342dsfdsv Год назад +1

    Is it possible to add english subtitles?

    • @ADevStory
      @ADevStory  Год назад +1

      It already has right? If you press on the CC icon in RUclips.

    • @32342dsfdsv
      @32342dsfdsv Год назад +1

      ​@@ADevStorysorry! Thanks! Somehow I maybe missed it

    • @ADevStory
      @ADevStory  Год назад

      No problem!

  • @PabloGnesutta
    @PabloGnesutta 2 года назад +1

    Hermano! Buen contenido. Gracias.
    Sería épico si agregas una card al final del vídeo que te lleve al siguiente :)

    • @ADevStory
      @ADevStory  2 года назад

      ¡Pensé que estaba! Vale lo reviso. ¡Muchas gracias!

  • @carolhring
    @carolhring 3 года назад

    What is the definition of HASH?

    • @ADevStory
      @ADevStory  3 года назад +1

      Will link to Wikipedia: en.m.wikipedia.org/wiki/Hash_function
      But paraphrasing, basically a hash is a value that represents another value uniquely in a hash function. It could be anything but it has to be unique for the same input.
      For example, you can have a "simple hash function" that for a given string returns the number of letters in it (the hash). In this case: the hash of "house" would be 5, and the hash of "cat" would be 3.
      Hope it's clearer!

  • @tanjirmahabub5105
    @tanjirmahabub5105 2 года назад

    You can use doodly for making hand writing animation video

    • @ADevStory
      @ADevStory  2 года назад

      Yeah, but actually prefer pen and paper 🙂

  • @АлияАбдыева-й1ь
    @АлияАбдыева-й1ь Год назад +1



  • @GeorgeCaldero
    @GeorgeCaldero 3 года назад +2

    A un español hablando inglés le entiendo mejor que a un inglés hablando inglés, yea!

    • @ADevStory
      @ADevStory  3 года назад

      Jajaja qué bueno :)

  • @deathangel908
    @deathangel908 Год назад

    1:15 not what I expect :)

  • @marksto6581
    @marksto6581 3 года назад

    Noice'n'eezy!

  • @johntube7554
    @johntube7554 2 года назад

    Bad quality. All parts need to be in one video. Made into un necessary partitions for monetization.

    • @ADevStory
      @ADevStory  2 года назад +1

      Hey man sad to hear you didn't enjoyed it. On each one I try to improve quality but it has been a learning curve for me. I appreciate any feedback on things that can be improved .
      Besides of that just wanted to correct you on the monetization part since that's not the reason. My goal was to make them short and more digestable.
      Videos over 8 minutes can actually include more ads inside so not a big difference monetization wise vs splitting. I also try to make them shorter than that and in the new ones I'm also removing the longer intro/closure to reduce the unnecessary filling.
      Not saying I made them without interest in monetizing but not the reason for the split :)