Arun Kumar
Arun Kumar
  • Видео 118
  • Просмотров 47 716
Fundamental API's of PySpark with Mr. Arun Kumar
In PySpark, there are several fundamental APIs that form the core of its functionality. These APIs allow users to work with large datasets, perform data transformations, and execute distributed computations efficiently. Below are the key APIs in PySpark:
### 1. **RDD (Resilient Distributed Dataset) API**
- The RDD API is the fundamental building block of PySpark. RDDs are immutable, fault-tolerant distributed collections of objects that can be processed in parallel.
- **Key Operations**:
- **Transformations**: `map()`, `filter()`, `flatMap()`, `groupBy()`, `join()`, `reduceByKey()`, etc.
- **Actions**: `collect()`, `count()`, `first()`, `take()`, `reduce()`, `saveAsTextFile()`, etc.
### 2. ...
Просмотров: 106

Видео

Databricks Community Edition Environment Set Up to Learn PySpark with Mr. Arun Kumar21:41Databricks Community Edition Environment Set Up to Learn PySpark with Mr. Arun Kumar
Databricks Community Edition Environment Set Up to Learn PySpark with Mr. Arun Kumar
Просмотров 1474 часа назад
Are you eager to dive into the world of Big Data with PySpark but unsure where to start? In this tutorial, we’ll guide you through the step-by-step process of setting up your environment on the Databricks Community Edition. Whether you're a beginner or an experienced data enthusiast, this video is designed to help you get up and running with PySpark in no time. Why Databricks Community Edition?...
Learn Pyspark | Basic to Advance | Mr. Arun Kumar | Free YouTube Series #free #pyspark #learning3:14Learn Pyspark | Basic to Advance | Mr. Arun Kumar | Free YouTube Series #free #pyspark #learning
Learn Pyspark | Basic to Advance | Mr. Arun Kumar | Free YouTube Series #free #pyspark #learning
Просмотров 1009 часов назад
Welcome to our comprehensive PySpark learning series led by Mr. Arun Kumar, a seasoned expert in data engineering with over 9 years of experience. This series is designed for beginners and professionals alike who are eager to master PySpark, one of the most powerful tools in the Big Data ecosystem. 1. What is PySpark? PySpark is the Python API for Apache Spark, an open-source, distributed compu...
Azure Data Engineering | Demo | Mr. Arun Kumar #education #azuredataengineering #azurefundamentals1:35:48Azure Data Engineering | Demo | Mr. Arun Kumar #education #azuredataengineering #azurefundamentals
Azure Data Engineering | Demo | Mr. Arun Kumar #education #azuredataengineering #azurefundamentals
Просмотров 12414 часов назад
Azure Data Engineering Demo by Mr. Arun Kumar. Welcome to the ForumDE official channel! In this special demo session, Mr. Arun Kumar, an industry expert with over 9 years of experience, takes you on a journey through the essentials of Azure Data Engineering. Whether you're a beginner or looking to enhance your data engineering skills, this session is designed to provide you with valuable insigh...
New Batch | Azure Data Engineering | Mr. Arun Kumar4:56New Batch | Azure Data Engineering | Mr. Arun Kumar
New Batch | Azure Data Engineering | Mr. Arun Kumar
Просмотров 8314 часов назад
For Your Next Step in the Azure Data Engineering Career, Are You Ready? Be a part of the Batch 7.0 Launch event with Mr. Arun Kumar at ForumDE tomorrow at 04:00 PM! 📊 With the help of experts and practical courses, become an Azure Data Engineer. In this regard, interested parties may join our WhatsApp group, the link for which is given below, chat.whatsapp.com/CNFRC6wVDYA8HCHMOcy0fb or call/wha...
ForumDE | Azure Data Engineering | Batch 6.0 | Demo | Mr. Arun Kumar | 21.07.2024 #demo #azure1:40:06ForumDE | Azure Data Engineering | Batch 6.0 | Demo | Mr. Arun Kumar | 21.07.2024 #demo #azure
ForumDE | Azure Data Engineering | Batch 6.0 | Demo | Mr. Arun Kumar | 21.07.2024 #demo #azure
Просмотров 296Месяц назад
Welcome everyone to today's Azure demo session! Whether you're new to cloud computing or looking to expand your knowledge, you're in the right place. Azure, Microsoft's powerful cloud platform, offers a vast array of services designed to empower businesses of all sizes. In this video, we'll dive into some of Azure's key features, from deploying virtual machines to leveraging artificial intellig...
Azure Total Cost Of Ownership (TCO) Calculator | AZ-900 Azure Fundamentals Certification | Mr. Kumar15:23Azure Total Cost Of Ownership (TCO) Calculator | AZ-900 Azure Fundamentals Certification | Mr. Kumar
Azure Total Cost Of Ownership (TCO) Calculator | AZ-900 Azure Fundamentals Certification | Mr. Kumar
Просмотров 912 месяца назад
Enrollment form for the latest batch: forms.office.com/r/vX9BsUAazx Welcome to our in-depth tutorial on the Azure Total Cost Of Ownership (TCO) Calculator, presented by Mr. Arun Kumar. This video is an essential guide for anyone preparing for the AZ-900 Azure Fundamentals Certification. In this video, Mr. Arun Kumar will cover: An introduction to the Azure TCO Calculator Step-by-step instructio...
Azure Demo Session 6.0 | Mr. Arun Kumar #azure1:16:41Azure Demo Session 6.0 | Mr. Arun Kumar #azure
Azure Demo Session 6.0 | Mr. Arun Kumar #azure
Просмотров 2192 месяца назад
Welcome everyone to today's Azure demo session! Whether you're new to cloud computing or looking to expand your knowledge, you're in the right place. Azure, Microsoft's powerful cloud platform, offers a vast array of services designed to empower businesses of all sizes. In this video, we'll dive into some of Azure's key features, from deploying virtual machines to leveraging artificial intellig...
Azure Pricing Calculator | AZ 900 Azure Fundamentals Certification | Mr. Arun Kumar #azure28:56Azure Pricing Calculator | AZ 900 Azure Fundamentals Certification | Mr. Arun Kumar #azure
Azure Pricing Calculator | AZ 900 Azure Fundamentals Certification | Mr. Arun Kumar #azure
Просмотров 1152 месяца назад
Enrollment form for the latest batch: forms.office.com/r/vX9BsUAazx Are you preparing for the AZ 900 Azure Fundamentals Certification? Understanding Azure pricing is a crucial part of your journey, and the Azure Pricing Calculator is your best tool for mastering this topic! 🌐 In this video, you'll learn: What is the Azure Pricing Calculator? A comprehensive overview of the tool and its features...
The Evolution of Data Storage Systems | By Mr. Arun Kumar11:29The Evolution of Data Storage Systems | By Mr. Arun Kumar
The Evolution of Data Storage Systems | By Mr. Arun Kumar
Просмотров 1262 месяца назад
Enrollment form for the latest batch: forms.office.com/r/vX9BsUAazx Join us as Mr. Arun Kumar, with over 9 years of industry experience in Azure Data Engineering, takes us on a captivating journey through the evolution of data storage systems. 🌐 In this video, you'll learn about: Punch Cards & Magnetic Tapes: The pioneers of data storage with limited capacity. Hard Disk Drives (HDDs): The game-...
Factors Affecting Costing in Azure AZ 900 Azure Fundamentals Certification with Mr. Arun kumar22:53Factors Affecting Costing in Azure AZ 900 Azure Fundamentals Certification with Mr. Arun kumar
Factors Affecting Costing in Azure AZ 900 Azure Fundamentals Certification with Mr. Arun kumar
Просмотров 1042 месяца назад
Enrollment form for the latest batch: forms.office.com/r/vX9BsUAazx Welcome to our in-depth guide on the factors affecting costing in Azure, tailored for those preparing for the AZ-900 Azure Fundamentals Certification. In this video, we'll break down the key elements that influence Azure pricing, helping you understand how to optimize costs and make informed decisions for your cloud solutions. ...
Master Azure Data Engineering: Free Demo Class by Mr. Arun Kumar! #azure #azuredataengineer1:43:25Master Azure Data Engineering: Free Demo Class by Mr. Arun Kumar! #azure #azuredataengineer
Master Azure Data Engineering: Free Demo Class by Mr. Arun Kumar! #azure #azuredataengineer
Просмотров 7113 месяца назад
#dataengineering #azuredataengineering #azuretutorials #career Welcome to the recording of our insightful demo session on Azure Data Engineering, held on June 1st, 2024, at 01:00 PM. In this session, we delve into the world of Azure Data Engineering, exploring the latest tools, techniques, and best practices for building robust data pipelines and harnessing the power of data in the cloud. Durin...
Unveiling Meta AI: Revolutionizing Data Science with Arun Kumar @ArunKumar_DE #azure #dataengineers4:27Unveiling Meta AI: Revolutionizing Data Science with Arun Kumar @ArunKumar_DE #azure #dataengineers
Unveiling Meta AI: Revolutionizing Data Science with Arun Kumar @ArunKumar_DE #azure #dataengineers
Просмотров 1023 месяца назад
#azure #azuredataengineer #dataengineering #azuredataengineering #azureservices #career #datasolutions #datasolutions #azuread #azuretutorials Get ready to witness the dawn of a new era in data science with the launch of Meta AI! In this groundbreaking video, we explore the latest innovation from Meta (formerly Facebook), as they redefine the boundaries of AI and data analytics. Meta AI represe...
Azure Data Migration Options: Azure Migrate,Azure Data Box|AZ-900 Azure Fundamentals with Arun Kumar11:28Azure Data Migration Options: Azure Migrate,Azure Data Box|AZ-900 Azure Fundamentals with Arun Kumar
Azure Data Migration Options: Azure Migrate,Azure Data Box|AZ-900 Azure Fundamentals with Arun Kumar
Просмотров 1213 месяца назад
Azure Data Migration Options: Azure Migrate,Azure Data Box|AZ-900 Azure Fundamentals with Arun Kumar
Identify Azure file movement options AZ 900 Azure Fundamental Certification | Mr. Arun Kumar |7:36Identify Azure file movement options AZ 900 Azure Fundamental Certification | Mr. Arun Kumar |
Identify Azure file movement options AZ 900 Azure Fundamental Certification | Mr. Arun Kumar |
Просмотров 774 месяца назад
Identify Azure file movement options AZ 900 Azure Fundamental Certification | Mr. Arun Kumar |
Mastering Azure Storage Redundancy:AZ-900 Azure Fundamental Certification with Mr. Arun Kumar #azure18:51Mastering Azure Storage Redundancy:AZ-900 Azure Fundamental Certification with Mr. Arun Kumar #azure
Mastering Azure Storage Redundancy:AZ-900 Azure Fundamental Certification with Mr. Arun Kumar #azure
Просмотров 2014 месяца назад
Mastering Azure Storage Redundancy:AZ-900 Azure Fundamental Certification with Mr. Arun Kumar #azure
Do cast your VOTE: A Mentor's Perspective:- Mr. Arun Kumar #azure #vote #voteforindia #votewisely10:50Do cast your VOTE: A Mentor's Perspective:- Mr. Arun Kumar #azure #vote #voteforindia #votewisely
Do cast your VOTE: A Mentor's Perspective:- Mr. Arun Kumar #azure #vote #voteforindia #votewisely
Просмотров 1374 месяца назад
Do cast your VOTE: A Mentor's Perspective:- Mr. Arun Kumar #azure #vote #voteforindia #votewisely
Exploring the Power of Azure Storage Accounts with Mr. Arun Kumar #azure #azuredataengineer #azuread25:16Exploring the Power of Azure Storage Accounts with Mr. Arun Kumar #azure #azuredataengineer #azuread
Exploring the Power of Azure Storage Accounts with Mr. Arun Kumar #azure #azuredataengineer #azuread
Просмотров 1244 месяца назад
Exploring the Power of Azure Storage Accounts with Mr. Arun Kumar #azure #azuredataengineer #azuread
Azure management infrastructure Management Group, Subscription, Resource Groups, Resources12:43Azure management infrastructure Management Group, Subscription, Resource Groups, Resources
Azure management infrastructure Management Group, Subscription, Resource Groups, Resources
Просмотров 1265 месяцев назад
Azure management infrastructure Management Group, Subscription, Resource Groups, Resources
Azure Physical Infrastructure- Data Centers, Region, Availability Zones, Region Pair, Sovereign Re..15:37Azure Physical Infrastructure- Data Centers, Region, Availability Zones, Region Pair, Sovereign Re..
Azure Physical Infrastructure- Data Centers, Region, Availability Zones, Region Pair, Sovereign Re..
Просмотров 2926 месяцев назад
Azure Physical Infrastructure- Data Centers, Region, Availability Zones, Region Pair, Sovereign Re..
Azure Data Engineering Online Course | Batch 5.0 | Second Class Session #azuredataengineer1:32:10Azure Data Engineering Online Course | Batch 5.0 | Second Class Session #azuredataengineer
Azure Data Engineering Online Course | Batch 5.0 | Second Class Session #azuredataengineer
Просмотров 3206 месяцев назад
Azure Data Engineering Online Course | Batch 5.0 | Second Class Session #azuredataengineer
Azure Data Engineering Online Course | Batch 5.0 | First Class Session1:21:30Azure Data Engineering Online Course | Batch 5.0 | First Class Session
Azure Data Engineering Online Course | Batch 5.0 | First Class Session
Просмотров 1,1 тыс.6 месяцев назад
Azure Data Engineering Online Course | Batch 5.0 | First Class Session
Master Azure Data Engineering: Live Demo Session & Tutorial Learn Data Processing, Analytics & More!1:48:59Master Azure Data Engineering: Live Demo Session & Tutorial Learn Data Processing, Analytics & More!
Master Azure Data Engineering: Live Demo Session & Tutorial Learn Data Processing, Analytics & More!
Просмотров 6876 месяцев назад
Master Azure Data Engineering: Live Demo Session & Tutorial Learn Data Processing, Analytics & More!
Microsoft Azure AZ 900 Certification What is Serverless Computing? |Arun Kumar |11:38Microsoft Azure AZ 900 Certification What is Serverless Computing? |Arun Kumar |
Microsoft Azure AZ 900 Certification What is Serverless Computing? |Arun Kumar |
Просмотров 606 месяцев назад
Microsoft Azure AZ 900 Certification What is Serverless Computing? |Arun Kumar |
Types of cloud computing services:IaaS, PaaS, and SaaS | AZ-900 Certification Guide | Arun Kumar |15:15Types of cloud computing services:IaaS, PaaS, and SaaS | AZ-900 Certification Guide | Arun Kumar |
Types of cloud computing services:IaaS, PaaS, and SaaS | AZ-900 Certification Guide | Arun Kumar |
Просмотров 556 месяцев назад
Types of cloud computing services:IaaS, PaaS, and SaaS | AZ-900 Certification Guide | Arun Kumar |
Serverless Computing | Microsoft Azure AZ 900 Certification | Arun Kumar |11:38Serverless Computing | Microsoft Azure AZ 900 Certification | Arun Kumar |
Serverless Computing | Microsoft Azure AZ 900 Certification | Arun Kumar |
Просмотров 776 месяцев назад
Serverless Computing | Microsoft Azure AZ 900 Certification | Arun Kumar |
Microsoft Azure 900 Describe the Consumption based model CapEx and OpEx | Arun Kumar |6:06Microsoft Azure 900 Describe the Consumption based model CapEx and OpEx | Arun Kumar |
Microsoft Azure 900 Describe the Consumption based model CapEx and OpEx | Arun Kumar |
Просмотров 1156 месяцев назад
Microsoft Azure 900 Describe the Consumption based model CapEx and OpEx | Arun Kumar |
AZ 900 Microsoft Azure Fundamentals What are Cloud Models | Arun Kumar | #clouds #azure #microsoft18:45AZ 900 Microsoft Azure Fundamentals What are Cloud Models | Arun Kumar | #clouds #azure #microsoft
AZ 900 Microsoft Azure Fundamentals What are Cloud Models | Arun Kumar | #clouds #azure #microsoft
Просмотров 777 месяцев назад
AZ 900 Microsoft Azure Fundamentals What are Cloud Models | Arun Kumar | #clouds #azure #microsoft
What is Cloud Computing? | Arun Kumar | #cloudcomputing #clouddata #cloud #clouddataengineering10:01What is Cloud Computing? | Arun Kumar | #cloudcomputing #clouddata #cloud #clouddataengineering
What is Cloud Computing? | Arun Kumar | #cloudcomputing #clouddata #cloud #clouddataengineering
Просмотров 1037 месяцев назад
What is Cloud Computing? | Arun Kumar | #cloudcomputing #clouddata #cloud #clouddataengineering
How to mount Blob storage from Azure Databricks in Azure portal | Arun Kumar | #azure #blobs14:28How to mount Blob storage from Azure Databricks in Azure portal | Arun Kumar | #azure #blobs
How to mount Blob storage from Azure Databricks in Azure portal | Arun Kumar | #azure #blobs
Просмотров 927 месяцев назад
How to mount Blob storage from Azure Databricks in Azure portal | Arun Kumar | #azure #blobs

Комментарии

  • @MuzicMania967
    @MuzicMania967 Месяц назад

    Thanks for sharing

  • @dieharddhonifan2227
    @dieharddhonifan2227 2 месяца назад

    Im currently from infra background can I switch to azure data engineer?? Any suggestions please

    • @ArunKumar_DE
      @ArunKumar_DE 2 месяца назад

      Yes you can.. Transitioning from an infrastructure background to Azure data engineering is definitely possible. Azure data engineering involves managing and processing data using various Azure services like Azure Data Factory, Azure Databricks, Azure Analytics, etc. Infrastructure background can provide a solid foundation, especially in areas like networking, storage, and virtualization, which are also relevant in cloud-based data engineering.

  • @raghunathn8313
    @raghunathn8313 2 месяца назад

    LinkedIn account please

    • @ArunKumar_DE
      @ArunKumar_DE 2 месяца назад

      www.linkedin.com/in/arun-kumar-19283775/

  • @FlightEnroute
    @FlightEnroute 2 месяца назад

    Will get job if learn only Azure data factory

  • @39madhurie
    @39madhurie 3 месяца назад

    Do we need dsa knowledge also for azure data engineer

    • @ArunKumar_DE
      @ArunKumar_DE 3 месяца назад

      Not required.But if a software engineer knows DSA,it will always be beneficial for him.

  • @christiandivaio9303
    @christiandivaio9303 3 месяца назад

    Hello Arun, nice video and communication. However, would you consider teaching in Hindi? I think that’ll be very helpful for the students who doesn’t have a grasp in English.

  • @arefbegh5298
    @arefbegh5298 3 месяца назад

    Thanks for sharing.

  • @jojo_isHere
    @jojo_isHere 4 месяца назад

    Amazing video Bro..keep on posting

  • @shekharchintalwar1272
    @shekharchintalwar1272 5 месяцев назад

    Thank you so muchbsir for important information 🎉❤

  • @user-ts6vr6uk2u
    @user-ts6vr6uk2u 6 месяцев назад

    Very well explained sir👍 . Please continue making more detailed videos.🙏

  • @ArunKumar_DE
    @ArunKumar_DE 6 месяцев назад

    Microsoft form for enrolment- forms.office.com/r/NczbzZTPvM

  • @ramcharanmar112012
    @ramcharanmar112012 6 месяцев назад

    what certification we need to do azure data engineer where we need to start

    • @ArunKumar_DE
      @ArunKumar_DE 6 месяцев назад

      you can start from scratch...

  • @shubhammagar266
    @shubhammagar266 6 месяцев назад

    I just got into Data domain in an organisation and stared learning about Azure and got Az900, currently preparing for DP900 really looking forward to Azure Data Engineering. Can you just give me an idea about what will be the Salary of Azure data engineer..?

    • @ArunKumar_DE
      @ArunKumar_DE 6 месяцев назад

      The salary in Azure Data Engineering really depends on your previous package,years of experience and how you negotiate your salary with HR.If I talk on general,if you have 10 lpa package,you can easily reach 20 lpa.

  • @sreenair2168
    @sreenair2168 6 месяцев назад

    Where is the pdf file

    • @ArunKumar_DE
      @ArunKumar_DE 6 месяцев назад

      t.me/+yvWJpw3nRrNhMmQ9 join our telegram channel to know more!!!

  • @mrinmoypal1374
    @mrinmoypal1374 6 месяцев назад

    how much cost it may incur to use azure portal for data engineering projects which requires adf, adls, databricks, synapse, keyvolt after 1 month of free subscription period is over. Because no ine can utilize and learn all the resources within 1 month

    • @ArunKumar_DE
      @ArunKumar_DE 6 месяцев назад

      It really depends on how much resources you are using.What I suggest,you use Azure and you can continue watching Azure billing everyday in Cost Management so that you can keep track that how much money is being consumed.

  • @marvhan888
    @marvhan888 7 месяцев назад

    do you do mentoring Mr Arun, would love to hear from you

  • @hariikrishnan
    @hariikrishnan 7 месяцев назад

    How to learn cloud when all of the services require credit card information even for the beginner tiers.. any advice?

  • @Shalinisingh-fl9xz
    @Shalinisingh-fl9xz 8 месяцев назад

    Very informative 👍

  • @omkaaaar
    @omkaaaar 8 месяцев назад

    Nice, down to earth guy you are ARUN, very relatable and simple and comfortable to associate with. I have subscribed you and will follow you for Azure related topics. Keep it up 👍

  • @vijaybhaskarkandula
    @vijaybhaskarkandula 8 месяцев назад

    Any good resourse to learn azure data engineer

    • @DevoteeHarsha
      @DevoteeHarsha 7 месяцев назад

      Arun sir have online class of azure

  • @ashokkumarkrishna5186
    @ashokkumarkrishna5186 8 месяцев назад

    Thanks for making the video in English.... please do series in step by step... azure databricks data engineering

  • @sureshrecinp
    @sureshrecinp 9 месяцев назад

    Thank you bro for the info.

  • @mohitbutola1140
    @mohitbutola1140 9 месяцев назад

    nice thankyou for your erfforts sir

  • @sravankotachejerla7564
    @sravankotachejerla7564 10 месяцев назад

    Thanks a lot. I am looking for this. Your video is very helpful.

  • @DevoteeHarsha
    @DevoteeHarsha 10 месяцев назад

    Thank you for such a useful information

  • @mgdesire9255
    @mgdesire9255 10 месяцев назад

    Please create a tutorials on Azure data engineering.

  • @mgdesire9255
    @mgdesire9255 10 месяцев назад

    Hi, Arun could you please upload an Azure Data Engineering End-to-End Project.

    • @ArunKumar_DE
      @ArunKumar_DE 7 месяцев назад

      uploaded please take a look...

  • @gopigrandhe-tu1wz
    @gopigrandhe-tu1wz 10 месяцев назад

    Thanks for sharing, helpful

  • @shibbujoseph
    @shibbujoseph 10 месяцев назад

    pretty good roadmap. Please make an add on to this video of making a project on azure data engineering, whether it should be a live project hosted on a domain or any other alternatives.

  • @shashank2004
    @shashank2004 11 месяцев назад

    I am working as a sql plsql developer along with 10 years exp so to boost the profile which language or tool should be laern?

  • @user-wy4yg2ze3e
    @user-wy4yg2ze3e 11 месяцев назад

    bahut acha tha but it would be much better if you teach it in hindi

  • @SK-wp4tm
    @SK-wp4tm 11 месяцев назад

    Please teach in Hindi as there is plenty of channels in English but not in Hindi 🙏

    • @SKAMRANPASHA
      @SKAMRANPASHA 8 месяцев назад

      Manish kumar

    • @omkaaaar
      @omkaaaar 8 месяцев назад

      In companies you will have to work and speak in English.

    • @SK-wp4tm
      @SK-wp4tm 7 месяцев назад

      @@omkaaaar bro speaking in English and gaining knowledge in Hindi are two different things

  • @user-uz2th9hl9l
    @user-uz2th9hl9l 11 месяцев назад

    Bhai thoda tez aur clear bol bohot dur tak jayega.

  • @Nick-du9ss
    @Nick-du9ss Год назад

    But data engineers has a threat of artificial intelligence i guess So i think in future number of people need in data engineering is also less This is my assumption

  • @PradeepKumar-ig4tc
    @PradeepKumar-ig4tc Год назад

    Excellent Arun Ji

  • @user-uz2th9hl9l
    @user-uz2th9hl9l Год назад

    👍

  • @ChetanMan
    @ChetanMan Год назад

    Very nice

  • @akhileshsharma9040
    @akhileshsharma9040 Год назад

    Sir aapk data engineering ke videos hindi me karsakte hai kyaa toh kyaa hai kee jaldi samjh aajaye.

  • @ArunKumar_DE
    @ArunKumar_DE 2 года назад

    Link to download notepad++ :- notepad-plus-plus.org/downloads/