- Видео 244
- Просмотров 106 857
JBSWiki
Индия
Добавлен 8 янв 2022
✨Azure Databricks Series: Step-by-Step Guide to Upgrading Runtime and Scaling Worker & Driver Nodes✨
In this episode, we're diving deep into two essential aspects of optimizing your Azure Databricks environment: upgrading the Databricks runtime version and scaling your worker and driver nodes. Whether you’re dealing with large datasets or complex computations, this guide will help you enhance your cluster’s performance and efficiency. 🖥️⚡
🔍 Why Upgrading the Databricks Runtime is Crucial?
The Databricks runtime is the backbone of your Spark environment. It includes a specific version of Apache Spark, libraries, and pre-configured settings that are optimized for performance. Upgrading your runtime version ensures you’re using the latest features, improvements, and security updates. Here’s w...
🔍 Why Upgrading the Databricks Runtime is Crucial?
The Databricks runtime is the backbone of your Spark environment. It includes a specific version of Apache Spark, libraries, and pre-configured settings that are optimized for performance. Upgrading your runtime version ensures you’re using the latest features, improvements, and security updates. Here’s w...
Просмотров: 0
Видео
💡Azure Databricks Series: Step-by-Step Guide to Building and Running Your First Notebook💡
1️⃣ Step 1: Setting Up Your Azure Databricks Workspace 🛠 To start building your notebook, you first need to set up your Azure Databricks workspace. This is where all the magic happens! ✨ Creating a new resource: Begin by logging into the Azure Portal and creating a new resource for Azure Databricks. You’ll be asked to choose a subscription and resource group. Make sure to select the options tha...
👤Azure Databricks Series: Step-by-Step Guide to Compute and Cluster Management👤
1️⃣ Introduction to Compute and Clusters in Azure Databricks Azure Databricks is a fully managed, cloud-native Big Data and machine learning platform designed to simplify and accelerate the workflow for data engineers, data scientists, and analysts. A core component of Azure Databricks is the cluster, which is essentially a set of compute resources such as CPUs and memory that execute your code...
🌐Azure Data Factory Series: Step-by-Step Deployment from Azure Portal🌐
Просмотров 102 часа назад
Introduction 🌟 Welcome to our latest installment in the Azure Data Factory Series! In this video, we're diving deep into the step-by-step process of deploying Azure Data Factory using the Azure Portal. Whether you're new to Azure or an experienced data professional, this guide will help you navigate the deployment process with ease. 🚀 Azure Data Factory (ADF) is a powerful cloud-based integrati...
🚚Azure Data Factory Series: Copying Files from On-Premise to Azure Storage🚚
In this video, we are going to explore how to copy files from a file share located on an Azure Virtual Machine (VM) or an on-premise server to an Azure storage account using Azure Data Factory (ADF) 🚀. Azure Data Factory provides a powerful and scalable pipeline feature that allows for seamless data transfer between on-premise infrastructure and Azure's cloud environment. Whether you need to mo...
👌Azure Data Factory Series: Remove & Add Self-Hosted Integration Runtime Node for Resource Scaling👌
Hello, Data Engineers and Cloud Enthusiasts! 👋 Welcome to another exciting episode of the Azure Data Factory Series! In this video, we’ll be walking you through how to remove a server from a Self-Hosted Integration Runtime (SHIR) that has more than one node. Whether you’re looking to replace an existing server due to resource constraints or just scaling up for performance, this tutorial will gu...
🏢Azure Data Factory Series: Boosting SHIR Reliability with Multi-Node Setup🏢
Welcome back to our Azure Data Factory Series! Today, we’re diving deep into how to add a second node to the Self-Hosted Integration Runtime (SHIR) for workload sharing and high availability 🖥️💪. Whether you're working with massive datasets or mission-critical processes, ensuring continuous uptime is a must. With this setup, even if one node goes down, your data pipeline will keep running smoot...
🎯Azure Data Factory Series: Optimizing Storage Costs with ADF Data Copy🎯
📢 Introduction Welcome to another episode of our Azure Data Factory Series! 🚀 In this video, we're going to tackle a real-world scenario where you need to move large volumes of data from premium storage to standard storage. This is a common challenge, especially when looking to optimize costs while maintaining data integrity. 💼 The Azure Data Factory (ADF) is a powerful tool that can help you a...
📘Azure Data Factory Series: Integrating Key Vault with ADF for Enhanced Security📘
In this video, we're diving deep into one of the most crucial aspects of data security within Azure-using Azure Key Vault to securely manage and access secrets, particularly when connecting Azure Data Factory (ADF) to SQL Server. This step-by-step guide will walk you through everything you need to know to ensure your credentials remain safe and your data communications are protected. 🛡️ 🌟 Why S...
✅Azure Data Factory Series: Mastering Service Endpoints for Enhanced Security✅
Welcome to another episode of our Azure Data Factory Series! 🎉 In this video, we're diving deep into Service Endpoints and exploring how they can be used to enhance security in your Azure environment. If you're managing data in Azure and need a secure, efficient way to connect your resources, this guide is for you! 🚀 Introduction to Service Endpoints 🌐 Before we jump into the step-by-step proce...
🧠Azure Databricks Series: A Deep Dive into Reference Architecture🧠
Просмотров 6219 часов назад
Introduction 🎬✨ Welcome to the Azure Databricks Series! In this video, we’re embarking on an in-depth journey through the Reference Architecture of Azure Databricks. Whether you’re a data engineer, architect, or someone eager to learn about data transformations, this video will equip you with the knowledge and best practices to master data pipelines and workflows in the Azure ecosystem. 🌐💡 Azur...
🛣️Azure Data Factory Series: Private Endpoints with Self-Hosted Integration Runtime🛣️
🔔 Introduction Welcome to another exciting episode of our Azure Data Factory Series! In this video, we’re taking a deep dive into the world of Private Endpoints and how you can leverage them with the Self-Hosted Integration Runtime in Azure Data Factory. 🎥 Whether you’re a beginner or an experienced data engineer, this video will guide you step-by-step through the process of creating a secure c...
🔒Azure Data Factory Series: Implementing One-to-One Secure Communication with Private Endpoints🔒
🔒 Welcome to Our Azure Data Factory Series! 🔒 In today's episode, we're focusing on one of the most critical aspects of cloud data management: Securing Your Data with Private Endpoints. Data security is paramount in today's digital landscape, and with the ever-increasing threats, it's essential to ensure that your data remains protected from unauthorized access. In this video, we'll show you ho...
🤔Azure Data Factory Series: Mastering the Self-Hosted Integration Runtime🤔
Introduction 🎥 Welcome to the Azure Data Factory Series! In this episode, we’re diving deep into the world of the Self-Hosted Integration Runtime (SHIR). This powerful tool is essential for connecting your on-premises data to the Azure cloud, enabling seamless data integration across your hybrid environments. Whether you're a seasoned data engineer or just starting with Azure Data Factory (ADF)...
🎥💡Azure Data Factory Series: Mastering Azure Integration Runtime🎥💡
Azure Data Factory Series: Mastering Azure Integration Runtime 🎥💡 Welcome to the latest installment of our Azure Data Factory Series! 🚀 In this video, we’re taking a deep dive into the powerful and versatile Azure Integration Runtime (IR) 🛠️-a core component of Azure Data Factory that is pivotal in orchestrating and executing your data workflows. Introduction: What is Azure Integration Runtime?...
🌟Azure Data Factory Series: Deep Dive into Auto Resolve Integration Runtime🌟
🌟Azure Data Factory Series: Deep Dive into Auto Resolve Integration Runtime🌟
🌠Azure Data Factory Series: Data Lakes, Lakehouses, and Beyond🌠
Просмотров 4514 дней назад
🌠Azure Data Factory Series: Data Lakes, Lakehouses, and Beyond🌠
🎯Azure Data Factory Series: Step-by-Step Guide to Linked Services, SHIR & CSV File Movement🎯
🎯Azure Data Factory Series: Step-by-Step Guide to Linked Services, SHIR & CSV File Movement🎯
🧮Azure Data Factory Series: Introduction to Self Hosted Integration Runtime (SHIR) & Azure IR🧮
Просмотров 4521 день назад
🧮Azure Data Factory Series: Introduction to Self Hosted Integration Runtime (SHIR) & Azure IR🧮
SQL Server Query Tuning Series -Parameter Sniffing Explained: How to Use DISABLE_PARAMETER_SNIFFING
Просмотров 6428 дней назад
SQL Server Query Tuning Series -Parameter Sniffing Explained: How to Use DISABLE_PARAMETER_SNIFFING
🛡️Azure Series: Resolving RBAC Errors When Creating Keys in Azure Key Vault 🛡️
Просмотров 97Месяц назад
🛡️Azure Series: Resolving RBAC Errors When Creating Keys in Azure Key Vault 🛡️
🛡️Azure Databricks Series: Step-by-Step Guide to Setup Databricks Workspace with VNet Injuction🛡️
Просмотров 171Месяц назад
🛡️Azure Databricks Series: Step-by-Step Guide to Setup Databricks Workspace with VNet Injuction🛡️
🧭Azure Databricks Series: Step-by-Step Guide to Setup Databricks Workspace with Default Deployment🧭
Просмотров 101Месяц назад
🧭Azure Databricks Series: Step-by-Step Guide to Setup Databricks Workspace with Default Deployment🧭
SQL Server Query Tuning Series - Advanced Query Tuning with Three Predicates and the AND Operator
Просмотров 75Месяц назад
SQL Server Query Tuning Series - Advanced Query Tuning with Three Predicates and the AND Operator
SQL Server Query Tuning Series - Query Performance Tuning: The Impact of Table Statistics @jbswiki
Просмотров 572 месяца назад
SQL Server Query Tuning Series - Query Performance Tuning: The Impact of Table Statistics @jbswiki
🏎️SQL Server Query Tuning Series: Identifying and Fixing Unmatched Indexes 🏎️ @jbswiki#sqlserverdba
🏎️SQL Server Query Tuning Series: Identifying and Fixing Unmatched Indexes 🏎️ @jbswiki#sqlserverdba
JBSWiki Introduction #jbswiki #sqlserver
Просмотров 2,9 тыс.2 месяца назад
JBSWiki Introduction #jbswiki #sqlserver
SQL Server Query Tuning Series -SQL Statistics based Estimates for Dual Predicates with AND Operator
Просмотров 822 месяца назад
SQL Server Query Tuning Series -SQL Statistics based Estimates for Dual Predicates with AND Operator
🏅SQL Server Query Tuning Series: Optimizing Lazy Spool for Enhanced Performance🏅 @jbswiki #sqltuning
🏅SQL Server Query Tuning Series: Optimizing Lazy Spool for Enhanced Performance🏅 @jbswiki #sqltuning
📚SQL Server Query Tuning Series: Improving Query Performance with Merge Join Optimization📚
📚SQL Server Query Tuning Series: Improving Query Performance with Merge Join Optimization📚
Very useful, thanks a lot!
Thanks for your interest. Glad you liked it.
Helpful 🎉
Nice work! Thank you. Two questions: Do I need to install the Failover Cluster Command Interface before using Get-Clusterlog? Or does this work out of the box? 2. Setting the VerboseLogging higher, will it fill up C: drive as there will be automatically generated logfiles that grow in size? Or is this settings ONLY for the GET-Clusterlog command?
Glad you liked it. below are my response, 1) Yes, you need to install the Failover Clustering feature on your server before you can use the Get-ClusterLog command. The Get-ClusterLog cmdlet is part of the Failover Clustering PowerShell module, which is only available after the Failover Clustering feature has been installed. Once the feature is installed, the command will work out of the box without any additional configuration. 2) Setting VerboseLogging to a higher level will indeed increase the amount of logging generated by the Failover Cluster service. This setting applies to the overall cluster logging, not just the Get-ClusterLog command. As a result, more detailed logs will be recorded, which could potentially lead to larger log files that might fill up the C: drive if not managed properly. However, it’s important to note that the Get-ClusterLog cmdlet itself does not directly cause logs to be written to disk continuously; it merely collects existing logs into a single file for easier analysis. The VerboseLogging setting will influence the amount of detail in the logs that are already being generated by the cluster service, which Get-ClusterLog then aggregates. To avoid filling up your C: drive, you should monitor the available disk space and manage the log files periodically, especially when VerboseLogging is enabled at a higher level.
Need a help about 'Always on Availability Group' (Manual failover) using manual Failover wizard secondary become primary and after this again using manual Failover wizard previous primary become primary, previous secondary become seconday, then it shows the error: "Login failed for user 'domain\SUBSERVER$'. Reason: Could not find a login matching the name provided. [CLIENT: <local machine>]" and stop data synchronization.
I look forward to try this in my environment Thanks for the detailed explanation....
Very well described
Can we do this thoriugh GUI in alwayson ..?
Thank you for the question. Yes you can create read routing from GUI.
could you please ping me your email id
I faced another scenario and resolved related to cluster observed same it is in pending state and fluctuating .....
Thanks for sharing your experience. It’s interesting to hear that you encountered a similar issue with the cluster being in a pending state and fluctuating. Could you share more details on how you resolved it? It might help others facing the same problem.
Awesome nice and simple ..!!
Hi broo , sorry but when I started using DTBRS I can not find an admin account , let me know how can I fix this issue please .
Excellent explanation 😊
Thanks !!!Glad you liked it.
It didn’t work for me, getting error: Database is cannot be opened due to inaccessible files or insufficient, memory or disk space.
Well said
🎉❤ very good Good luck
Nicely explained things in detail related to Azure SQL database auditing...very much informative and thanks once again for sharing everything for free...good work 👍👍👍
Thanks. Glad you find it useful.
So, can we say that the one with the highest selectivity should be written first in the where condition?
Yes, it’s generally a good practice to place the condition with the highest selectivity first in the WHERE clause. This helps the database engine filter out rows more efficiently, potentially improving query performance. Selectivity refers to the ability of a condition to narrow down the number of rows returned by a query. The more selective a condition, the fewer rows it returns.
@@jbswiki Thanks for this. could u please make a video on inequality predicate estimation.
@@abhinavtiwariDBA Thanks for your interest. Will do a video soon.
Please advise a scenario where the communication link between the HQ and DR is broken and you do a forced failover but if the HQ servers comes up and formes a quorom and the DR site doesnt know wont there be a split brain scenario as there are now two writeable primaries one at the hq and one at the Dr.
Good video
Glad you enjoyed
Under availability group there is always 1 primary server and 1 or more secondary. If i have some heavy script to run and want to switch mode to async what is best approach? Should i change it on primary and all secondary servers or only secondary? I mean inside availability group. As shown in your video at 05:30
Hope you are well. Only secondary should fine for the given scenario.
Thank you so much. Keep posting these gems. 🙏
Wow, thanks for your interest.
Please add a conclusion of the video at the end because here I understand what you have explained but didn't understand as why we are looking into those details and what are we driving from these details. Basically, what are we trying to achieve?
Sure will do. Thanks for your interest.
❤
Great explanation hope you will upload more videos
More videos every Tuesday. Thanks for your support.
Thank you. I am watching all your videos
Thank you for your support.
Please make more such videos on internals. Thank you.
Sure, Thanks for your support!!!
Amazing video
Thank you for your support.
Amazing video do you take online classes ?
Glad you liked it. I am doing RUclips videos only.
@@jbswiki Have any plan to start ?you can think of that on weekend
Amazing video..do you take classes ?for HA and performance tunning
Thank you for your support. Glad you liked it. I am doing RUclips videos only.
thx :D
Thank you for your support!!!
Really great presentation, explained very well with everything!!! How we can migrate existing on-prem User and windows logins which are AD accounts to Managed Instance? I can see in my MI database AS login as red cross so wondering need current logins?
Excellent video; clearly explained. Thank you so much
Glad it was helpful!
What is Incorrect PFS Free Space Information" Error and when we can get it and what are causes?
Hi do you take classes ?for SQL DBA
Thanks for your interest. Only youtube videos and blogging.
Prefect Demo! It's very step by step explained!
Thank you for the support.
Thank you for a clear and concise explanation.
Glad it was helpful!
Awesome! thanks for the solution. Jai Hind!
Most welcome!
Hey Vivek, Good Day! Thanks for this video. helps a lot. Thank you for contributing to the community. looking for more videos on SQL server.
More to come! Thanks a ton!
very good explain.
Glad it was helpful!
I think it's taking too much time for execution right
True. Solution on the main video :-)
Best practical knowledge person for sql database.... 👍
Thanks a lot
Great channel. Have an interview in couple of days. "SQL Internal Series" playlist is really useful. Thanks @Jbswiki.
Good luck with your interview. Thanks for your support.
I always love you videos
Glad you liked it. Thank you for the support.
Very helpful session... could you please share script as well
Glad you liked it. Thank you for the support.
Excellent info
Glad you liked it. Thank you for the support.
@@jbswiki I have watched all your videos. It really makes me better knowledge in MSSQL. Very clear explanation in the topics you covered so far. Thank you so much.
Clear and comprehensible presentation. Excellent video quality. Puzzled by the unexpectedly low view count.😇😇😇
Glad you liked it. Thank you for the support.
This video is amazing, I appricated it, thanks very much
Glad you liked it. many thanks for your support.
Thank you.. this helped me resolve my AG issue.
I'm thrilled to hear that the video was helpful in resolving your AG issue! Your success is exactly why I create this content. If you have any more questions or need further assistance, don't hesitate to reach out. Thanks for watching and for your support!
Thumbs up if you've recommended this video to all your social media followers!
Excellent work. the most important point is that all the scripts are provided in the description. Great Work man, keep it up
Thanks a ton