Это видео недоступно.
Сожалеем об этом.
How Dukaan moved out of Cloud and on to Bare Metal w/ Subhash | Ep 5
HTML-код
- Опубликовано: 15 авг 2024
- Build Your Own Redis / DNS / BitTorrent / SQLite - with CodeCrafters.
Sign up and get 40% off - app.codecrafte...
Dukaan recently moved out of public clouds like AWS, GCP, and Azure are hosting their infra on bare metal instances. Like you all, I had several questions given how counterintuitive the move is. So, to get answers and understand their journey, we have with us Subhash Choudhary, Founder and CTO of Dukaan.
Outline:
00:00:00 Precap
00:00:26 Introduction
00:01:11 Story of Subhash and Dukaan
00:09:00 Infra need of Dukaan
00:11:45 Their DB setup and what do they run on cloud v/s bare metal
00:16:48 Their Kubernetes and CICD setup
00:32:22 Isn't bare metal a fixed investment and How does it scale?
00:40:00 Where and how are they hosting their bare metal infra?
00:44:18 Breaking production and Live failover
00:46:51 How did they do failover?
00:54:12 How to debug a production issue and Dukaan's Observability Stack?
00:58:43 Leveraging CDNs
01:01:42 What about security patches in bare metal?
01:03:45 IOPS benchmarking across cloud and bare metal
01:11:42 Number of deployments per day
01:13:29 Reducing infra cost from 90000 USD to 1500 USD
01:22:07 Isn't cloud more reliable than bare metal?
01:27:00 Random discussion on databases
01:36:24 Like, Share, and Subscribe
Arpit's System Design Masterclass
System Design for Beginners: arpitbhayani.m...
System Design for Experienced Engineers: arpitbhayani.m...
Become a member for exclusive in-depth videos: / arpitbhayani
Redis Internals: arpitbhayani.m...
I teach a course on System Design where you'll learn how to intuitively design scalable systems. The course will help you
- become a better engineer
- ace your technical discussions
- get you acquainted with a massive spectrum of topics ranging from Storage Engines and high-throughput systems, to super-clever algorithms behind them.
I have compressed my ~10 years of work experience into this course, and aim to accelerate your engineering growth 100x. To date, the course is trusted by 1000+ engineers from 13 different countries.
Together, we will build some of the most amazing systems and dissect them to understand the intricate details. You can find the week-by-week curriculum and topics, benefits, testimonials, and other information here
arpitbhayani.m....
Other links
If you have solved an interesting problem and want to talk about it on my channel, check out
arpitbhayani.m...
CS Engineering and Software Development books that I have read
arpitbhayani.m...
Research papers that I have read
arpitbhayani.m...
Newsletter: arpit.substack...
LinkedIn: / arpitbhayani
Twitter: / arpit_bhayani
To follow the blogs and papers I am reading, join my telegram channel at t.me/asliengin...
You can find handwritten notes and text notes about this video at arpitbhayani.me.
Until next time, stay awesome :)
Yours truly,
Arpit
arpitbhayani.me
#AsliEngineering
This is truely an insane podcast!
Subhash by default speaks in 1.5x
His brain works faster than his speech
yep. I wanted to watch in 1.25x or 1.5x but couldn't understand him
i had to listen on .75 to understand
I literally checked if I’m on 1.5x
Same..instinctively i put the video on 1.5x as soon as it started but had to switch back once he started speaking 😂
Bro this cto is dope.... knowlege...curiosity....fearlessness...man insane... kudos to him...Thank you Arpit bhaiya for this podcast
This is literally crazy podcast, I do not think i have finished any podcast without a break ever till this one arrived. A good start to the weekend. Thanks Arpit for doing this.
Same, 1st podcast I completed.
I hope Arpit bring more content like this (not necessarily in podcast) but practical hands on for "asli engineering"
Never saw a world class dev process explained in plain Hindi like this before . Also please see if sensitive info is not being shown. ❤
Man he is knowledgeable and confident enough to show the inside workings of his company.
Really respect him
Amazing ! In my recent experience working in a similar company to Dukaan but for the Middle East region. They have struggled alot to reduce the cost of AWS bills, this is the real pain for startups. Eye opener this is called "Asli Engineering" hats off, we need more podcasts with Subhash .. Already a fan of him
It's great to see.
Man this video is insane. I thought I'll watch first 30 mins or so and sleep. But I couldn't skip any single minute. I've literally been doing engineering for last few years but it was all about writing code and code level optimisations but no one ever talks about these optimisations from the perspective of costs, thinking in such a way from first principles is really 'Asli Engineering'. From the insights from Subhash to the insights from Arpit at the end. It was super amazing. Ive never commented on any youtube video before, creating a channel just to comment on this one. Subscribed to your channel as well. Amazing video loved it!
I recognize this writing
I'm less knowledgeable to this topic. So 10pm k around video start kiya aur 1:11am ho rha hai. 1hr 37 min ka video ko dekhne mai itna time laga...
so many thing for me to know. bahut se unknown terms ko google search kr kr ke dekhna pada.learned many things. Plz keep it up !
I was like I will watch for 10 mins till my snacks would be finished and now I am having dinner watching this. Man, please do more podcasts like these. Got to learn a different thought process . Thanks Subhash and Arpit !! I hope to see more such podcasts on the channel.
This is peak of youtube! SO MUCH KNOWLEDGE in a SINGLE VIDEO!
One of the best podcast. I can say this is asli engineering and Subhash is very confident and fearless, "Fatega to dekha jayega, Zarurat hi ku h, complex krna hi ni h" 😄and he literally shutdown the actual server for the demo. I learnt, do not over design the architecture, just see the data and build.
he single handedly destroyed Devops Engineers/SRE/GCP/AWS (with facts and data of course).
But what a nice podcast full of TECHNICAL depth along with real time examples that he have shown.
My Key takeaways :
1. Learn KUBERNETES ! {will try to become the 5th SRE/Infra guy at DUKAAN}
2. Any system no matter how reliable , FATEGA !
3. Cloud vs On-prem (IOPS performance comparison)
lol how did he destroy devops engineers
@@yash_renaissance_athleteBhai most devops wala people I know can do run bare metal infra as well. Usually cloud ko padhne se pehle system handle krna aana hi chahiye. It's not really a big deal, most companies are moving some services to bare metal. Ye kaam bhi devops wale hi krenge
@@yash_renaissance_athlete not actually destroyed , destroy would be a little harsh word , but the need and use of a big devops/SRE team vs 3-4 guys who actually knows how to handle big infrastructure,(be it On-Prem vs cloud) and get stuff done.
@@animeshsingh4290 toh wahi toh mai bhi maanta hoo, but the main comment poster said “he destroyed devops engineers” and that’s why I asked him how did he destroy them
No.. he didn't.. He is just working with trade offs.. for some companies the traffic is so huge that they cannot afford the downtime with critical transactions.. and that downtime he doesn't care.. and basically managing 10 different other free services instead of using mainstream cloud.
This discussion was really a gem, from my experience what i have observed is when people talk about response time, everyone gets so defensive that the first point of check is either code, or query run time, adding multiple indexes to make the the query run faster, but we easily ignore the network calls most of the time. Some great take aways from this discussions for sure.
This CTO is amazing! Very inspiring and logical and keeps things simple! Ankit thanks for bringing this, looking for more
Completing it at 2:30am. I got so much to learn that I don’t know if I will get to sleep tonight or not. Amazing one man. Just happily overwhelmed & I am stunned looking at u guys. I’m 20 but now I want to learn & experience all these cool stuffs.
Great video Arpit Bro ❤❤❤
It's been great working with Subhash. Really glad to be a part of his impressive operation.
I work for a cloud provider so this is counter intuitive to I profess in general. However, the simplicity and ease with which Dukaan manage their infrastructure is amazing. My favorite thing was Subhash's enthusiasm for all this and how he takes pride in his tech work, truly inspiring!
I only worry about rapid scaling ability in future, however if the company doesn't project such an exponential growth, then this would work well for a foreseeable future.
What a brilliant podcast! Didn't shy from disclosing the real numbers... no one want's to find out the hard way. You and Subhash are proper engineers and I loved listening to you two talk technology. I've been a generalist for about 20 years, but love to experiment. I've learnt to setup servers etc. only since covid. So while my knowledge is surface level compared to you'll it was interesting to know that my learning is in the right direction. And just like you, i was astonished with the IOPS difference! Anyway, thank you for a wonderful podcast.
There is a reason behind high expense charges from these big cloud companies . They invent technologies. Docker and Kubernetes was backed by google . Open source is not free. Single command chalake instances spink karna was not possible few years ago. Google invested money in both docker and Kubernetes. So when you pay cloud bills it’s just not billing charges. it also includes R&D for current and future projects.
I liked this perspective lekin ye bhi socho ki why would they invest in open source? It's definitely not because they are so generous and want people to give open source alternatives of their products, if they invest it's because of their interest. They heavily use open source in their "big companies" and their investment is merely "giving back to the community" if not entirely their business interest.
but he has to take care of his own bottomline and his own business. I’m sure nobody biz or consumer including Google would care if he’s making poor business decisions to be socially right
Even though I didn't want to I had to pause the video and then like it before being mesmerized again 🔥🔥🔥
Great work Dukaan team, one of the best podcast out there. Keep posting 💥💥💥
ok pranav
This is truly “Asli Engineering” ❤
This was a really good podcast, Arpit. As an old IT guy, I always knew self hosting is cheaper. But these insights from founder were phenomenal.
Hats off you guys, literally I loved them this is what our Indian Software developer community needs ❤❤
I don't know you, I don't know this guy. I clicked on the video just by reading "Dukan". As an early stage engineer myself, this is a gem 💎 podcast on devops and cloud infrastructure. Got a lot of insites. Totally worth it my time! Looking for more valuable content like this now! ❤ 🔥
I'm not even a CS engineer but I am all here for this kind of content.
Podcast can't get more involved , inspiring , impactfull. Just Loved IT. Shubash is just a great guy. Thanks Arpit for putting this out here
The guy gave a thorough overview of GitOps, ArgoCD, and Kubernetes principles. This video is more a tutorial than a podcast. ❤
the moment he mentioned $1500 I was shocked, I've worked on both on-prem and cloud, currently working on the performance side of the applications but with these insights I will always check the underlying hardware as well.
Its real gem, loved it Arpit and Subhash. Anticipating more.
This is Tanenbaum's book done bottoms up. Great talk, insight, guts and engineering.
Does that book also cover these kinds of topic? I didn't read that much. But IIRC, it was about the computer stack bottom up
What an amazing podcast!!! Subhash sir is just on another level. Loved it throughout.
This man has what a clear understanding of thoughts... really impressed to know how things work.
I hope they make a similar episode when they go back into the cloud.
This is a magical discussion!!! Man, this is an awesome podcast. I have Subscribed to the channel and turn the notifications ON, and kept shooting such podcasts. Really knowledgable.
This was pure awesome. Loved every second of it ❤.
Subhash's approach towards the problems and their solutions and preparedness is just awesome. I very rarely comment on any videos but on listening to his realistic approach prompted me to comment. Really impressed by the unencumbered way of thinking. All the best to Dukaan and Kudos to "Asli Engineering by Arpit Bhayani" for this interaction.. 👍
Asli Desi Engineering, hats off to you guys 👌👌
Great Podcast, very enlightening even to someone who has very less knowledge about cloud Kudos to both 👏
The shock i got when i heard the COST difference! Man hats off!
This is the best engineering podcast I have ever seen in my life! Inspirational!! ❤
16:16 sums it up. This is great for a talk show and an engineering project. Especially for a retail focused startup, if you want to become a unicorn and then go for IPO, moving out of cloud is not a great strategy. Hybrid is the way to go.
This guy knows his stuff, awesome...
Great grip on his domain , a real guru .. love from Pakistan....
Insane. Hands down the most entertaining and enlightening podcast I have ever seen.
good interview, reminds me of my early days in startup, when our high-end server at datacenter crashed, and all the backup was on my laptop in office,
went to datacenter and i had to put the laptop in datacenter and run the business, surprisingiy laptop was in datacenter for 8 months, as we couldnt fix the highend machine as it was assembled and had multiple issues..
Subhash is very practical. Appreciate his approach to reduce costs while taking ownership of certain additional things that developers often want to skip these days. What I don't agree on the reliability aspect though is that although downtimes are ubiquitous across all infra services, you have to look at the normalised statistics. The extent of care aws takes to make sure there is always a fallback is likely much higher than a smaller player can afford. But of course, there's always the cost tradeoff and if it works out for Dukaan, that's awesome.
Bhai, meri shuruvat ese hi hardware si hui thi, bad me cloud me move kiya and started focusing there. But this gives me enough confidence to continue on hardware.
Already downloaded video for reference purposes.
As an SRE I got offended in the beginning but have been worked in both DataCenter and Cloud environments. Definitely understand his requirements and his way of finding a solution for it ( and his comment on SRE ).
pure knowledge..pure passion !!
no doubt why this video is most viewed in this channel..
Question to Subhash: When you say you are doing read replica of Postgres to cloud and in case your on-prem db services is down, you will still serve it via cloud that means you have allowed writes to that cloud database or your application will work only in read-only mode until you bring back your on-prem services? If you allow write to cloud database, how you bring that delta back on your on-prem services?
This is one of the best Tech discussion I have ever seen on youtube.
Dude got more microservices than twitter. 😂😂😂
Maza aa gya, soo much depth shared in a way like chai sutta aur charcha. Appreciate Subash for sharing things so transparently ❤
This was an amazing podcast. Hats off to how Subhash so easily touched so many aspects of Infrastructure.
Damn !!! This is insanely good discussion ... Absolutely loved it !!! Subhash proved that we can have full control of our Infra instead dumping loads of money into Cloud vendors !!! This was real fun ... keep them coming !!!
Just for fun, I brought all my old PCs; one of them is running Nginx primarily for load balancing and reverse proxy, while the rest are running Express.js instances, Jellyfin, Nextcloud, and others (In docker of course). In my server, I do serve recorded videos for local coaching centers. But backing up your data is important.
Did you provide ABR streaming locally?
very nice podcast, the people of my generation who started their career from cloud era only couldn't compare the bare metal and cloud performances and this is eye opening thing to see. great subhash sir
my first podcast ever, and its full of knowledge.
That’s what we call engineering, dekhte hai kya hota hai, kya fatega
Should have more such podcasts
Amazing CTO with tonns of knowledge and daring. Looking forward to work with him.
hatsoff to the dukkan's founder..that deep insight will help people like us who are self taught
We would like to see more of this kind of in-depth sessions it was really awesome to watch you guys.
Showing the internal infra setup on RUclips was the highlight.
Bring more of these kind of stuff.
Bhaisahab.. bawal kaat diye hain ekdum 😆
Kudos to Subhash for thinking in a very different and very realistic approach. Loved the podcast. and best of luck to you arpit for your analytical db endeavour 😀
Thank you Deependra 🙌
You Indians are gold-mine of knowledge. Love you both from across the border.
I am DevOps Engineer this guy almost concluded my entire job in just 1 and half hours😅😅
He is so incredibly honest. Lovely talk.
Never heard of this dukaan. Out of the blue you tube showed me :) checked google playstore, just looking into the 1st 4-6 comments close the app and stopped watching the remaining video. Not worth investing time.
What happened dude😂
My mind is blown , got to learn so many stuff my brain can't handle!!
Very informative video man, would love more of such videos/podcasts. Thanks 👍
There are more than 160 such videos on my channel. Do go through them. I have covered deep engineering concepts and real world systems.
@@AsliEngineering Oh, I will go through, Thanks 👍
Next level podcast💯🔥. I hope you continue inviting such talented people. Learnt alot🙌
I am planning the same, I spent 5 years learning about deploying on-premises servers now it's time to use it.
great knowledge source , both of you guys are amaziing , as a backend senior dev , learned a lot , thanks for this session!
This channel is underrated and this content is Gold
Duniya gol hai !! Ek jagah pe din hota hai, Ek jagah pe raat hota hai, Wow :)
The proxying logic was amazing
Knowledgable! I am also working on my startups it could give new startups a knowledge of future and critical thinking about their systems. Great!
After a long time I watched this long podcast at once! This was truly an amazing content. Thoroughly enjoyed listening to both of you. Thank you!
Are mere bhai…🤯🤯 itni humbleness..❤️❤️❤️
It's never a good content on the channel, it's always the best 😅🤣. Great insight 👍👍
India is going to eat the competitionin coming future.
We need more such engineers! 🙏
Crazy stuff , and crazy excitement , this shows how deeply he has done the things
This is 🔥🔥. Didn't expected that this will change my entire though process. The content of this podcast is of worth entire eng. degree.
Bro this is really dope podcast. Subhash is genius guy.. Never saw such a simple thinking can solve a big problem.
Thanks Asli Engineer for doing this podcast. I became a fan of Subhash Chaudhary from now.
you've earned a subscriber by introducing me to a new type of podcast. The cocktail of education and interview is very refreshing.
Wow, this is really good conversation.
Thank you Subhash for being so open.
Ane doh, Ane doh 😂😂, waiting for this video
Thanks guys for this discussion. Aaj neend achi aayegi. Invaluable insights from Shubhash !
Shubahsh Chowdhury is love yr he inspired me a lot for tech or he is a reason of my tech passion
I liked the person more than the pod cast, just after watching 5 minutes
Absolutely brilliant discussion. So much information in one video! Just run the video on 0.75x. 🙂
Great and insightful podcast. I have couple of doubts -
1. Why do they have servers all over the world when their sellers and users are only in India?
2. For all the servers spread across the world, won't they have to connect with one single db in a particular region (or do they have read-replicas in each region)?
To maintain redundancy?
That's what I think.Even I'm interested in knowing more.
I think all of those servers are served from a single DB in India.
Man this is dope! Would love to see a follow up podcast where we could see the database architecture. As in, are the databases sharded for a set of shops? Are all the app server regions of the same service hitting a single primary db?
Great podcast. It’s real stuff. Liked it a lot. Great if you do these similar ones from experts. May I ask one question, you mentioned why Kafka is fast. Can you please in details or give me some reference.
I am flattered by this podcast. Thanks Arpit for this podcast. One of the most amazing podcast i have got lots of learnings from..
This is the first channel to which I have subscribed while watching this video.
57:00 shows how government policies impact business mindset. If it was EU or other regions, the regulatory body would mandate few hundred days of data. Shows how talented we are... English is just a medium of communication and not a req to be in technical domain. Brilliant interview.
Really loved this podcast, This man is truly passionated for engineering.
I tried ignoring it several times as voice pace is too fast of the "Genius Guy Subhash" but always getting stick to this podcast :p
Totally insane, soch raha hu jeevan waste kar diya apna maine faltu ke kaamon mein being a developer
Subhash bhai is Asli Engineer, forget about system design jargons.. he is living system design😇
Thanks for making this and sharing it with us!