- Видео 56
- Просмотров 208 579
Tybul on Azure
Польша
Добавлен 13 июл 2023
This channel is all about free Azure trainings, especially in data-related areas.
DP-203: 54 - Exam overview and course summary
Hey Data Engineers!
It's official - my DP-203 course is now complete! After more than a year of hard work, it's finally ready to go.
In the final episode, I cover everything you need to know about the exam: how to register, the types of questions to expect, and tips for last-minute prep. I also share some exciting updates about what’s next for my RUclips channel.
But here’s the key takeaway: YOU’RE READY FOR THIS EXAM, AND YOU’LL PASS WITH EASE. TRUST ME
▬▬▬▬▬▬ IMPORTANT LINKS ▬▬▬▬▬▬
My LinkedIn profile: www.linkedin.com/in/piotr-tybulewicz-81a8793/
GitHub with my drawings: github.com/TybulOnAzure/DP-203
Azure Data Engineer Certificate page: learn.microsoft.com/en-us/credentials/certification...
It's official - my DP-203 course is now complete! After more than a year of hard work, it's finally ready to go.
In the final episode, I cover everything you need to know about the exam: how to register, the types of questions to expect, and tips for last-minute prep. I also share some exciting updates about what’s next for my RUclips channel.
But here’s the key takeaway: YOU’RE READY FOR THIS EXAM, AND YOU’LL PASS WITH EASE. TRUST ME
▬▬▬▬▬▬ IMPORTANT LINKS ▬▬▬▬▬▬
My LinkedIn profile: www.linkedin.com/in/piotr-tybulewicz-81a8793/
GitHub with my drawings: github.com/TybulOnAzure/DP-203
Azure Data Engineer Certificate page: learn.microsoft.com/en-us/credentials/certification...
Просмотров: 742
Видео
DP-203: 53 - 4th milestone - Streaming and data governance recapped
Просмотров 36321 день назад
Hey Data Engineers! We did it! We’ve successfully wrapped up another data engineering area, focusing on streaming and data governance. Catch the 53rd episode of my free DP-203 course, where I’ll recap these key topics and introduce a challenge to sharpen your skills. Enjoy! ▬▬▬▬▬▬ IMPORTANT LINKS ▬▬▬▬▬▬ My LinkedIn profile: www.linkedin.com/in/piotr-tybulewicz-81a8793/ GitHub with my drawings: ...
DP-203: 52 - Data governance with Microsoft Purview
Просмотров 76228 дней назад
Hey Data Engineers! It's time to take a deep dive into data governance. But what exactly does that mean? Is it simply about controlling data access, or is there more to it? In the 52nd episode of my free DP-203 course, I’m covering data governance in Azure and exploring how Microsoft Purview can help manage it effectively. Tune in and enjoy! ▬▬▬▬▬▬ IMPORTANT LINKS ▬▬▬▬▬▬ My LinkedIn profile: ww...
DP-203: 51 - Handling time & performance in Azure Stream Analytics
Просмотров 601Месяц назад
Hey data engineers! Did you know that time management is crucial in streaming solutions? Have you ever faced the challenge of dealing with events that arrive out of order or with significant latency? And how can you be sure your solution is performing optimally? It’s better to address these issues proactively before they impact your users. Join me in the 51st episode of my free DP-203 course, w...
DP-203: 50 - Azure Stream Analytics overview
Просмотров 967Месяц назад
Hey Data Engineers! We've successfully ingested streaming data into Azure using Azure Event Hubs, but it's just sitting there, untapped and underutilized. It's time to unlock its potential and dive into the insights it holds! In the 50th episode of my free DP-203 course, I'll guide you through Azure Stream Analytics-a powerful tool for processing streaming data. We'll explore its windowing func...
DP-203: 49 - Introduction to streaming, Event Hubs
Просмотров 1 тыс.Месяц назад
Hey Data Engineers! Tired of the same old batch processing? Let's dive into something more exciting-streaming and real-time data processing! In the 49th episode of my free DP-203 course, I'm exploring streaming, sharing real-world examples, outlining a high-level architecture, and taking a deep dive into the ingestion phase using Azure Event Hubs. Enjoy! ▬▬▬▬▬▬ IMPORTANT LINKS ▬▬▬▬▬▬ My LinkedI...
DP-203: 48 - 3rd milestone - Serve phase recapped
Просмотров 612Месяц назад
Hey data engineers! We’ve done it! We’ve just completed another phase of our projects: serving data to the end users/data consumers. Join me in the 48th episode of my free DP-203 course, where I'll walk you through the entire data serving process and present a challenge to help you refine your skills. Enjoy! ▬▬▬▬▬▬ IMPORTANT LINKS ▬▬▬▬▬▬ My LinkedIn profile: www.linkedin.com/in/piotr-tybulewicz...
DP-203: 47 - Azure Synapse Analytics - Serverless SQL Pool
Просмотров 1,1 тыс.2 месяца назад
Hey data engineers! We've all seen the modern data warehouse architecture that uses Dedicated SQL Pool for storing data and serving it to consumers. But do we really need another copy of the data? What if we could just use the lakehouse approach? Well, we can! The key component for this is the Serverless SQL Pool available in Azure Synapse Analytics. Join me in the 47th episode of my free DP-20...
DP-203: 46 - Dedicated SQL Pool security
Просмотров 8112 месяца назад
Hey data engineers! So you've decided to store your data in Synapse Dedicated SQL Pool. Great! But how do you secure that data? How do you make sure that only selected principals are allowed to query the data? Is there a way to restrict which columns and rows users can see? Join me in the 46th episode of my free DP-203 course, where I cover the following topics: • Firewall in Synapse • Transpar...
DP-203: 45 - Azure Synapse Dedicated SQL Pool - extra features
Просмотров 9962 месяца назад
Hey data engineers! Imagine we’ve designed our Dedicated SQL Pool using a star schema and allowed users to query it. But now we’re getting complaints that it’s incredibly slow, and users have to wait too long for the data. How can we handle concurrent workloads in a Dedicated SQL Pool? How can we prioritize important queries to ensure they are processed first? How can we reserve resources to en...
DP-203: 44 - Loading data to Dedicated SQL Pool
Просмотров 1,2 тыс.3 месяца назад
Hey data engineers! If you’ve chosen to use Dedicated SQL Pool for your data storage and serving needs, you might be wondering how to load data into it. What options are available, and what are their pros and cons? Join me for the 44th episode of my free DP-203 course, where I explore various methods for inserting data into Dedicated SQL Pool: • PolyBase • COPY INTO • ADF/Synapse data flows • A...
DP-203: 43 - Azure Synapse Dedicated SQL Pool - Architecture and overview
Просмотров 1,4 тыс.3 месяца назад
Hey data engineers! We've finished transforming our data - it's now pure, pristine, and ready to be consumed as facts and dimensions. Great! The only issue is that it's located in a data lake using the delta format, and not every consumer can connect to it. Or maybe we just prefer a good, old-fashioned, traditional relational data warehouse instead of this "data lake thing." What should we do? ...
Channel membership announcement
Просмотров 1,1 тыс.3 месяца назад
▬▬▬▬▬▬ IMPORTANT LINKS ▬▬▬▬▬▬ My LinkedIn profile: www.linkedin.com/in/piotr-tybulewicz-81a8793/ GitHub with my drawings: github.com/TybulOnAzure/DP-203 ▬▬▬▬▬▬ MEMBERSHIP ▬▬▬▬▬▬ Join this channel to get access to perks: ruclips.net/channel/UCLnXq-Fr-6rAsCitq9nYiGgjoin ▬▬▬▬▬▬ CHAPTERS ▬▬▬▬▬▬ 00:00 Introduction 00:17 RUclips membership offer 01:09 Joining the club 02:11 Junior Data Engineer level...
DP-203: 42 - 2nd milestone - transform phase recapped
Просмотров 9463 месяца назад
Hey data engineers! We did it! We’ve just wrapped up another phase of our projects: data transformations. Catch me in the 42nd episode of my free DP-203 course, where I’ll give you a rundown of the whole transformation phase and throw in a challenge to sharpen your transformation skills (yes, we’re still using Lego data). Enjoy! ▬▬▬▬▬▬ IMPORTANT LINKS ▬▬▬▬▬▬ My LinkedIn profile: www.linkedin.co...
DP-203: 41 - Transforming data with Data Flows
Просмотров 1,2 тыс.4 месяца назад
Hey data engineers! In our work, we often need to transform ingested data. So far, I've introduced you to three tools for this purpose: Azure Databricks notebooks, Synapse Analytics notebooks and dbt. However, all of them require you to write code using SQL, Python, Scala, or R. But what if you don't know any of these languages and still need to transform data? Is it possible? Yes, it is! You c...
DP-203: 40 - Extra features in Azure Synapse Analytics Spark Pools
Просмотров 1,1 тыс.4 месяца назад
DP-203: 40 - Extra features in Azure Synapse Analytics Spark Pools
DP-203: 39 - Azure Synapse Analytics - Spark Pools
Просмотров 1,6 тыс.4 месяца назад
DP-203: 39 - Azure Synapse Analytics - Spark Pools
DP-203: 38 - Transforming data with dbt
Просмотров 1,6 тыс.4 месяца назад
DP-203: 38 - Transforming data with dbt
DP-203: 37 - Orchestrating Databricks notebooks
Просмотров 1,4 тыс.5 месяцев назад
DP-203: 37 - Orchestrating Databricks notebooks
DP-203: 36 - Automating the process with Azure Databricks Autoloader
Просмотров 1,6 тыс.5 месяцев назад
DP-203: 36 - Automating the process with Azure Databricks Autoloader
DP-203: 35 - Writing data to ADLSg2 from Azure Databricks
Просмотров 1,5 тыс.5 месяцев назад
DP-203: 35 - Writing data to ADLSg2 from Azure Databricks
DP-203: 34 - Common data transformations
Просмотров 1,9 тыс.5 месяцев назад
DP-203: 34 - Common data transformations
DP-203: 33 - Connecting to ADLSg2 from Azure Databricks
Просмотров 2,1 тыс.6 месяцев назад
DP-203: 33 - Connecting to ADLSg2 from Azure Databricks
DP-203: 32 - A closer look at Databricks notebooks
Просмотров 2,3 тыс.6 месяцев назад
DP-203: 32 - A closer look at Databricks notebooks
DP-203: 31 - Introduction to Azure Databricks
Просмотров 3,1 тыс.6 месяцев назад
DP-203: 31 - Introduction to Azure Databricks
DP-203: 30 - Slowly changing dimensions, data lake structure
Просмотров 2 тыс.6 месяцев назад
DP-203: 30 - Slowly changing dimensions, data lake structure
DP-203: 29 - Introduction to dimensional modeling
Просмотров 2,3 тыс.7 месяцев назад
DP-203: 29 - Introduction to dimensional modeling
DP-203: 28 - 1st milestone (ingest phase recapped + challenge)
Просмотров 1,7 тыс.7 месяцев назад
DP-203: 28 - 1st milestone (ingest phase recapped challenge)
DP-203: 27 - Azure Synapse Analytics: Overview, Pipelines
Просмотров 3,4 тыс.7 месяцев назад
DP-203: 27 - Azure Synapse Analytics: Overview, Pipelines
DP-203: 26 - Introduction to Azure Logic Apps
Просмотров 1,8 тыс.7 месяцев назад
DP-203: 26 - Introduction to Azure Logic Apps
Thank you for making this video! Are columnstore indexes similar to hybrid storage?? Minus metadata and dictionary encoding 😅
😱😱 why is this series free!!! I dont believe it! 😅 Thank you again🙏
I am extremely happy to share that yesterday I have successfully passed my DP-203 exam. The entire credit for this success only belongs to you. The content that you created has been top notch and really helped me understand the Azure ecosystem. You are one of rare humans i have found who are always eager to help others and share their expertise. I have also become a member of your channel under Senior Data Engineer plan . It would be great if you can start creating some content around Gen AI and Azure Fabric. Thanks again.. I bow down to you
First of all: congratulations!!! I'm super happy that I was able to help you. Secondly: There is no Senior Data Engineer offer available yet :). But I'm considering adding it with some extra benefits. Finally: Gen AI - definitely not my thing. Fabric - maybe...
@@TybulOnAzure .. sorry i meant to say i have subscribed to your membership plan :)
Hi. Your Data Engineering tutorial videos are quite informative, explained in depth and in an interesting way. Would you also help us on become an Azure Technical Architect those who don't have any experience as an Architect.
Unfortunately, I don't have that in my plans.
I passed my certification exam, all thanks to this incredible playlist! I’m really grateful to you, @Tybul, for creating such an amazing series and being an outstanding teacher. Your guidance made all the difference!
That's awesome, congratulations 🎉!!!
Man, I want to tell you that you are doing a noble thing out there. Hats off to you for the content you are providing everyone for free. This world needs more people like you.
Thanks, I'm super glad you find those videos useful.
What next we can expect from you 😊
I'm still analysing various options...
Tybul, it maybe weird question but still asking. Am planning to switch my career to azure data engineer but am afraid 😢 whether this jobs will be replaced by ai in future Currently I have 5+ exp in IT industry Please reply. Thanks in advance.
I have no idea and I doubt there is anyone who could answer that question.
Thanks for quick reply tybul. In upcoming years, I see lots of data engineer demands going on. That's y I wanted to switch to this field. I hope atleast 8-12yrs. It safe
Your assistent at the end 😂😼
So basically Azure will loot you for anything you do!😂 once they have your data!
Yup, there is no free lunch.
@@TybulOnAzure hahah true! Thank you so much for making these videos! I find this sequence of explanation very interesting to listen to. ❤️
Thank you its perfect
Thanks!
Sheer genius way of teaching. Passion rekindled for wanting to learn again. Thank you master.
You are welcome. I'm glad you enjoyed it!
very help full video, that amazing pipeline that work on dynamic way. everything it try to make it generic. very very useful. thanks a lot for this informative video and full series. thanks tybul.
You are welcome, I'm glad you enjoyed it!
Hey i started doing your playlist around a week ago now i am in the middle of the course but have already gained much confidence things have become easy now, i tried doing this dp-203 many times but couldn't understand,, but now since last week things are completely changed for me. Once i complete the course i will surely recommend it to my linked in and for those who are reading my comment and want to start just go ahead this is the right place for you even if you are a beginner like me AGAIN A BIG THANKYOUUUUUUUU and a request please upload more videos you got a permanent subscriber !!!
Great! It's super motivating to read such comments, thanks!
why the hybrid storage stores data in chunk of groups? can't we just index data row by row so it will be more optimized than grouping(we will make sure that we will read the needed rows only)?
Sneaky Paws 49:39
Hi, I'm from Brazil and I am very happy to inform you that I passed the DP-203 exam, I would like to thank you very much for your videos, it helped me a lot because I work with SQL Server, but I have no experience with Data Engineering, but I intend to change that and I will study about the subject and work hard to become a Data Engineer, I have no words to express how much your videos help me, Thank you. Please keep up with the videos!
That's awesome, congratulations 🎉
Introduction is very good
Another great tutorial, only regret not watching earlier
Glad you liked it!
Hey tybul. Just a suggestion but why dont you do the az104 and az204 next and then the az400 😁.
Not a chance :)
Can you please tell what can be the estimated cost for all the practicals of this playlist if we use pay-as-you-go service and delete the resources after using it ?
The most expensive service is definitely Synapse Dedicated SQL Pool, so watch out for it. In case of the rest - it shouldn't cost more than $100.
Hello Tybul, Late to the party, I did not understand how did you write the pipeline expresiion. Do I need to refer to something to know about that?
Here you can find Microsoft docs about ADF expression language: learn.microsoft.com/en-us/azure/data-factory/control-flow-expression-language-functions
@@TybulOnAzure thankyou for sharing
Hello Tybul, Thanks for those videos, it's really helpful as I am preparing for DP 203. I had a doubt about minimum number of rows that table should contain before we create partitions, I saw different answers for this in many forums. From your explanation what I understood that it's 60 million rows, right? See the full context of the question below. You plan to create a fact table named Table1 that will contain a clustered columnstore index. You need to optimize data compression and query performance for Table1. What is the minimum number of rows that Table1 should contain before you create partitions?
I'm unable to discuss this as it seems to align with content from exam braindumps, which goes against Microsoft's policy
I passed my certification exam...all thanks to you!
Congratulations!!!
Best thing about you is, you kept on going, without caring like, comments , you did it for people. You challenged yourself and you did it. So nice of you. Thank you
Thank you so much 😊
I can't thank you enough for the playlist that you made !! best dp-203 learning material ! I have a question about multiple options question : How to tackle them because i suppose i get a lower score if i select 1 correct & 1 wrong answer compared to only 1 correct answer ?
Each multiple-choice question should include a clear explanation of how points are awarded for correct answers. Essentially, there is no penalty for selecting incorrect answers.
I have seen so many vidoes on this subject and no one has explained with such a clarity as you did, you are explaining as if you designed them :) thank you
Glad it was helpful!
Hi, thanks you for all these videos. can you please clear my confusion, does DP-600 requires DP-203 knowledge?
Probably I'll record a short episode soon that covers DP-203 vs DP-600 vs DP-700.
Since booking the exam, I had postponed it countless times. Then, I found your channel and started the learning path once more-this time, I made it! You have a true gift for simplifying complex concepts, and the way you summarize the study material is incredible. I enjoyed every single video you have posted here. I couldn't have passed the exam without your great explanations. And I have to mention, the cute cat in the background became my best study companion throughout the journey! Please dont change anything, just keep this style, your drawings helped me remember everything far better than the MS learning pages which is full of text.🐈⬛
Thanks a lot! And congrats on passed exam!!!
8:12 there are sneaky paws there
Actually, you might spot those paws in other episodes as well.
Loved watching your videos for DP-203. I am currently preparing for the exam. I have read that there will be an update to the DP-203 exam on the 24th of October2024. Will this make much difference if i sit the exam after this date please? From what I understand, the changes Microsoft make, are only minor? Thanks
It is marked as "minor" update so I wouldn't be concerned about it.
Thank you for all these videos. I will definitely continue to follow your upcoming projects. Cheers!
Awesome, thank you!
Just curious...In the Spark Pools section, we actually copied the Minifigs table from the dedicated SQL pool itself and wrote it back to the same table in dedicated SQL pool but in the diagrammatic representation you have shown that the data is read from data lake and loaded to dedicated SQL pool...am I missing something? Thanks
You are right - I read data from dedicated SQL Pool so the diagram is misleading. Sorry for that.
@@TybulOnAzure thank you for the confirmation...appreciate it...awaiting your next series!!!
Today was my first day working as a data engineer. Thank you for your help of getting me to this first milestone of my data career!
That's awesome! Congratulations on your new job!
Thank you Tybul
You are welcome.
First of all , your videos are great. Can you do a similar one for AI-102?
Not a chance as I don't know that area.
The whole course was great. I really like your style of teaching others (whiteboard, concepts, hand-on, challenges etc.). I hope you will be back soon!
Thanks! And yes - I'll be back.
I liked the way of teaching in a very simple manner.Also appreciating you for the efforts spent.You have very unique teaching style, so that anyone can quickly grab concepts.Once again thank you so much Tybule.Expecting lot of Data Engineering related content from you.
Thanks!
Hands down the best DE course out there, made by a professional. I have nothing to complain about in terms of the course content and its pace, maybe because I already made first steps at DE world and there are no completly new things to me, however it was very fun and knowledgeable repetition! From youtube end the production has been flawless - the whiteboard and drawings, notes, great sound in the videos, demos, presentations of results and everything archieved in github, what else one can one ask for? If I may suggest as the content goes, it would be very good if we get an episode/series on achieiving good SWE practices in our DE work. A lot us are not from IT background from university, doesn't know how to develop and maintain whole solution with good practices like in software development and I guess its very beneficial to go out of cloud service provider ecosystem and for example maintain code and integration in VS Code, if we still talk about Microsoft. I know we already got a CI/CD and integration episode, however it was just a tip in the iceberg when it comes to enterprise solutions and maintenance and this topic is often given a wide berth which takes toll on our daily work. Plus things like Docker, Kubernetes and more DevOps side of DE, but I guess they're highly advanced topics. To sum up, I would like to congratulate you on your first series and thank you thoroughly for your dedication and great content!
Thank you for this amazing series! You are a great teacher! Enjoying every minute of the video! 🎉
Glad you enjoy it!
Just a small doubt, In the earlier episode of Introduction to Data Factory the same linked service connection was successful in the first attempt, was it because you had configured the AzureSQLDb server earlier to allow the connection from all Azure services/ IP address.
Yes, it worked in the earlier episode as I configured it before recording that episode.
Juststarted this series yesterday. Im enjoying alot. Its awesome content and great explanation 👏.
Thanks!
@@TybulOnAzure Is there any chance to connect with you in linkdin
@RamanjaneyuluSomu sure, my profile is in the video description
@@TybulOnAzureThanks, just sent a connection request ❤
Thank you, @TybulOnAzure, for your excellent course and detailed explanations. They've given me the confidence to pursue the DP-203 certification. I plan to take the exam after completing your course.
Anybody noticed the cat 😅?
My cats think they are the stars of this course. If you see them doing anything ridiculous, just know they're trying to teach me how to get more views.
Great! 25:27 can't synapse infer the existing schema from parquet file?
It can - take a look at docs: learn.microsoft.com/en-us/azure/synapse-analytics/sql/develop-tables-external-tables?tabs=hadoop#create-and-query-external-tables-from-a-file-in-azure-data-lake