CK Data Tech
CK Data Tech
  • Видео 91
  • Просмотров 59 270
Create Cloud Composer And Build Your FIRST Airflow DAG - Beginner To PRO
In this tutorial, we'll go through a high level overview of Google Cloud Composer as well as step-by-step guide on how to create Cloud Composer Environment in GCP and deploy Airflow DAG on Cloud Composer.
We will Learn how to create composer environment, define airflow tasks, set dependencies, and trigger Airflow DAGs to run manually and automatically.
Whether you're a data engineer, DevOps, or data scientist, this video is perfect for anyone looking to automate their workflows and pipelines using Airflow on Cloud Composer.
Follow along and build your first Airflow DAG now!
#airflow #gcp #composer #cloudcomputing #dataengineering #etl #googlecloud #workflowautomation
Просмотров: 21

Видео

CREATE Your GCP Project FAST with gcloud CLI!
Просмотров 237 часов назад
Learn how to create a Google Cloud Platform (GCP) project quickly and efficiently using the gcloud command-line interface (CLI). In this tutorial, we'll walk you through the step-by-step process of setting up a new GCP project with gcloud CLI, covering everything from initialization to project creation. Whether you're a developer, engineer, or cloud architect, this video will help you get start...
How To Connect to Snowflake FAST with DBeaver!
Просмотров 6012 часов назад
Learn how to connect to Snowflake fast and efficiently using DBeaver, a popular database management tool. In this tutorial, we'll take you through a step-by-step guide on how to establish a connection to Snowflake using DBeaver, query snowflake data, and explore its features and benefits. Whether you're a data analyst, scientist, or engineer, this video is perfect for anyone looking to streamli...
CREATE Your First BigQuery Dataset TODAY!
Просмотров 2919 часов назад
Want to unlock the power of BigQuery? In this video, we'll take you through a step-by-step guide on how to create a BigQuery dataset from scratch. By the end of this video, you'll have a solid understanding of how to create a dataset, load data, and perform basic queries. So, what are you waiting for? Let's dive in and start creating your first BigQuery dataset today! #bigquery #gcp #sql #datae...
How To Run Ubuntu Desktop On Your Mac WITH VMWare Fusion!
Просмотров 206День назад
In this tutorial, we'll show you step-by-step process on how to install Ubuntu Desktop as a virtual machine on VMWare Fusion in Mac OS. Whether you're a developer, programmer, or just a Linux enthusiast, this video will walk you through the process of getting Ubuntu up and running on your Mac. With VMWare Fusion, you can run Ubuntu alongside macOS, allowing you to take advantage of the best of ...
How To Connect and Query MySQL Database From DBeaver
Просмотров 5314 дней назад
Learn how to connect DBeaver directly to your MySQL database in just a few minutes! In this tutorial, we'll show you a step-by-step guide on how to set up a secure connection between DBeaver and your MySQL database. Whether you're a developer, data analyst, or database administrator, this video is perfect for anyone looking to streamline their database management process. With DBeaver, you can ...
Create GCP Project Without Coding - Step-by-Step Guide for Beginners
Просмотров 2714 дней назад
In this beginner-friendly tutorial, you'll learn how to navigate the GCP console effortlessly and set up your first project in just a few minutes. What you’ll learn in this video: - An overview of Google Cloud Platform Structure - Step-by-step instructions for setting up a new project - Tips for managing your project settings - Best practices for beginners in GCP Referenced Documents: - cloud.g...
How To Install Ubuntu Server On VMware Fusion In Mac OS
Просмотров 13721 день назад
In this quick and easy tutorial, we will show you how to install Ubuntu Server on VMware Fusion! Perfect for beginners, this step-by-step guide will walk you through the entire installation process, ensuring you have a smooth and successful experience. Whether you're looking to set up a home server, test applications, or simply explore Ubuntu Server, this video is designed to help you get start...
Simple Tricks to Instantly Reveal Hidden Files on Mac
Просмотров 12621 день назад
In this tutorial, we’ll guide you through the step-by-step process of revealing hidden files on your Mac, empowering you to access all the files and folders that are usually tucked away from view. Whether you're a beginner or a seasoned Mac user, our easy-to-follow instructions will help you navigate through Finder to uncover those elusive hidden files. Discover tips and tricks for managing you...
How To Connect DBeaver to PostgreSQL: Fast & Easy Setup Tutorial
Просмотров 5721 день назад
In this quick and easy tutorial, learn how to connect DBeaver to PostgreSQL in just minutes! This step-by-step guide will walk you through the entire setup process, ensuring you can start managing your PostgreSQL databases efficiently. 🌟 What You'll Learn: - How to download and install DBeaver - How to Install PostgreSQL - Configuring DBeaver to connect to your PostgreSQL database - Tips for tr...
How To Configure GCP Cloud Workstations in Minutes!
Просмотров 8628 дней назад
Welcome to our comprehensive guide on setting up Google Cloud Platform (GCP) Cloud Workstations in 2024! Whether you're a complete beginner or looking to enhance your cloud computing skills, this video will take you step-by-step through the entire process. In this video, you'll learn: - What GCP Cloud Workstations are and how they work - Setting up your Cloud Workstation environment - Installin...
Save BigQuery Query Results as a New Table
Просмотров 40Месяц назад
In this comprehensive tutorial, we will guide you through the process of saving your BigQuery query results as a new table.This step-by-step guide will help you streamline your data management workflow in Google BigQuery. Learn how to: - Execute SQL queries in BigQuery - Use the BigQuery UI editor to save results as a new table - Optimize your queries for better performance - Manage your new ta...
Install VirtualBox on Mac M3 like a PRO! [2024]
Просмотров 339Месяц назад
Welcome to our channel! In this video, we will guide you through the step-by-step process of installing VirtualBox on your Mac M3 like a pro in 2024. This comprehensive tutorial will help you set up VirtualBox effortlessly. In this video, you will learn: - What VirtualBox is and its benefits for virtualization - System requirements for installing VirtualBox on Mac M3 - How to download the lates...
How To Convert SQL Merge Statements to DBT incremental Models
Просмотров 155Месяц назад
Are you ready to streamline your data transformation process? In this video, we’ll show you how to Migrate DML Merge Statements to DBT in Minutes! Learn the ins and outs of transitioning to DBT for your data workflows, and discover the benefits of using DBT over traditional DML methods. We’ll cover: - Step-by-step DML Merge migration process to DBT - Key advantages of using DBT for data transfo...
Change VS Code Terminal Cursor Style in Seconds!
Просмотров 31Месяц назад
In this quick and easy guide, we’ll walk go through the simple steps to customize your Visual Studio Code terminal cursor, making your coding environment not just more functional but also visually appealing. Whether you prefer a block, line, or underline cursor, we have you covered! In this video, you will learn: - How to access the settings in VS Code - Step-by-step instructions on changing th...
How To Connect DBeaver to BigQuery in Minutes! Easy SQL for Beginners
Просмотров 93Месяц назад
How To Connect DBeaver to BigQuery in Minutes! Easy SQL for Beginners
How To SSH to GCP VM from VS Code! Easy tutorial for beginners!
Просмотров 234Месяц назад
How To SSH to GCP VM from VS Code! Easy tutorial for beginners!
“zsh: Command not Found" - EASY FIX!
Просмотров 366Месяц назад
“zsh: Command not Found" - EASY FIX!
How To Connect DBeaver to Redshift Remotely in Minutes
Просмотров 121Месяц назад
How To Connect DBeaver to Redshift Remotely in Minutes
How To Download VMware Fusion from BroadCom - Easy Steps for Mac
Просмотров 611Месяц назад
How To Download VMware Fusion from BroadCom - Easy Steps for Mac
What is DBT (Data Build Tool) | Beginner to Pro - FREE CRASH Course
Просмотров 307Месяц назад
What is DBT (Data Build Tool) | Beginner to Pro - FREE CRASH Course
Create GCP VM Instance through CLI - gcloud
Просмотров 49Месяц назад
Create GCP VM Instance through CLI - gcloud
DBT Rookie to Guru: End-to-End ELT Pipeline Project with DBT, Snowflake, and Tableau
Просмотров 2,5 тыс.Месяц назад
DBT Rookie to Guru: End-to-End ELT Pipeline Project with DBT, Snowflake, and Tableau
How To Download DBeaver for Mac - EASY Step-by-step Tutorial
Просмотров 636Месяц назад
How To Download DBeaver for Mac - EASY Step-by-step Tutorial
How To Create VM Instance in Google Cloud & Connect Locally | Create Google Compute Engine Console
Просмотров 1592 месяца назад
How To Create VM Instance in Google Cloud & Connect Locally | Create Google Compute Engine Console
How To install Airflow WITHOUT Docker on MacOS - Beginner To Pro Tutorial
Просмотров 3612 месяца назад
How To install Airflow WITHOUT Docker on MacOS - Beginner To Pro Tutorial
Customize Mac Terminal Cursor | Change Cursor from Block to Vertical Bar
Просмотров 542 месяца назад
Customize Mac Terminal Cursor | Change Cursor from Block to Vertical Bar
How To Install Google Cloud CLI on MacOS
Просмотров 7092 месяца назад
How To Install Google Cloud CLI on MacOS
How To Install and Setup DBT Core with Snowflake in 2024
Просмотров 6012 месяца назад
How To Install and Setup DBT Core with Snowflake in 2024
Exclude Files from Git commits - Step by Step Guide!
Просмотров 432 месяца назад
Exclude Files from Git commits - Step by Step Guide!

Комментарии

  • @maulana721
    @maulana721 4 дня назад

    thank you so much!

    • @CleophasKalekem
      @CleophasKalekem 4 дня назад

      You’re welcome and glad you found the video helpful 😊

  • @malaka123456
    @malaka123456 5 дней назад

    Thanks for this video CK Data Tech!

    • @CleophasKalekem
      @CleophasKalekem 4 дня назад

      You’re welcome and glad you found the video helpful 😊

  • @sivaramreddynarreddy4169
    @sivaramreddynarreddy4169 12 дней назад

    ❤❤

  • @gangatharan-x4r
    @gangatharan-x4r 13 дней назад

    Nice video, But if we have your csv file for testing, that good

    • @CleophasKalekem
      @CleophasKalekem 13 дней назад

      Yes CSV file(s) also work the same way. In fact the python code generator I used in the video is just generating csv files. So yes you could modify CSV files and upload and it should work same way.

  • @engahb
    @engahb 13 дней назад

    I cannot find that first option - for personal use it seems to be removed. they might removed it.

    • @CleophasKalekem
      @CleophasKalekem 13 дней назад

      Most likely. Or if you have school email address you can register using that and make your school the company, provide its address and I believe it should work.

    • @Niqu33n
      @Niqu33n 11 дней назад

      Do i need the pro or can i use the regular 13?? I just wanna play steam and pc games 😢 it doesnt show up for me I evem tried chrome and safari

    • @CleophasKalekem
      @CleophasKalekem 11 дней назад

      @ if you mean the VMware version it depends with your OS. If you’re on Windows then can try VMware Pro or Vmware Player. If on Mac then you need to download Vmware Fusion. I don’t believe Vmware Pro or Player work on Mac

    • @Niqu33n
      @Niqu33n 11 дней назад

      @@CleophasKalekem for macOS it doesnt say for personal use.. just 13

  • @mohanprasath1781
    @mohanprasath1781 19 дней назад

    Will the CDC work as same if we have new records in the same file1 and we run the stage ?

    • @CleophasKalekem
      @CleophasKalekem 18 дней назад

      Yes CDC will work same way. Your CDC process might be ingesting files with new records or updates. It could also be a table that stores new or updated records - whichever way, the DBT incremental process should be very similar

  • @saveriovasapollo
    @saveriovasapollo 24 дня назад

    This is NOT running in notepad++, you are using the terminal to run it.

    • @CleophasKalekem
      @CleophasKalekem 22 дня назад

      Yes you’re right, in this video I’m using terminal to run the code. It’s just one of the ways to run a code written on notepad++. I believe you were looking for an option to run within notepad++. Stay tuned I’ll be making a video on that ❤️

  • @deepaksubedi3181
    @deepaksubedi3181 26 дней назад

    Thank you very much for this helpful project and please add airflow for e2e data orchestration within it.

    • @CleophasKalekem
      @CleophasKalekem 25 дней назад

      Thanks for the suggestion, I'll look into adding Airflow to a future project!

  • @WamonoEdward-ii8mc
    @WamonoEdward-ii8mc 29 дней назад

    Good work

  • @beyyugi92
    @beyyugi92 Месяц назад

    Why would we do union distinct? Would there ever be duplications? We took our updates and inserts which are different so why would we do union distinct? 20:10

    • @CleophasKalekem
      @CleophasKalekem 22 дня назад

      I don’t believe there would be duplications. I believe I was just being too cautious but you could just do regular UNION or UNION ALL.

  • @mzimbitingKi
    @mzimbitingKi Месяц назад

    Vipi broo ni Mimi ndio nakusaidia kuboost subscribe

  • @pablourbanohernandezvizcarra
    @pablourbanohernandezvizcarra Месяц назад

    Thank you very much for the tutorial, I have a MacBook Air with 8GB of ram, and running Airflow with Docker is not good for me PC, running locally with this method is a better option.

    • @CleophasKalekem
      @CleophasKalekem 25 дней назад

      Thank you! I’m glad you found it helpful 😊

  • @CleophasKalekem
    @CleophasKalekem Месяц назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem Месяц назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem Месяц назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem Месяц назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem Месяц назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem Месяц назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem Месяц назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem Месяц назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem Месяц назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem Месяц назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem Месяц назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem Месяц назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem Месяц назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @2412_Sujoy_Das
    @2412_Sujoy_Das Месяц назад

    This video helped me set up dbt for MySQL. Thanks a lot CK Data Tech 💌💌💌💌

  • @CleophasKalekem
    @CleophasKalekem Месяц назад

    Quick tip on how to recalibrate Honda CRV TPMS after tire air pressure refill

  • @TommyFink-y6c
    @TommyFink-y6c Месяц назад

    Moore Karen Smith Michelle Miller Anthony

  • @mzimbitingKi
    @mzimbitingKi Месяц назад

    ❤❤

  • @mzimbitingKi
    @mzimbitingKi Месяц назад

    ❤❤❤

  • @mzimbitingKi
    @mzimbitingKi Месяц назад

    ❤❤❤

  • @mzimbitingKi
    @mzimbitingKi Месяц назад

    ❤❤❤❤

  • @mzimbitingKi
    @mzimbitingKi Месяц назад

    ❤❤❤

  • @mzimbitingKi
    @mzimbitingKi Месяц назад

    ❤❤❤. engenear in

  • @CleophasKalekem
    @CleophasKalekem Месяц назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem Месяц назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @nayo7888
    @nayo7888 2 месяца назад

    THANK YOU!!!!! This video has saved me this afternoon 🙏🏽🙏🏽🙏🏽🙏🏽🙏🏽

    • @CleophasKalekem
      @CleophasKalekem 2 месяца назад

      Very glad to hear that 😊. Please give thumbs up to the video and subscribe to the channel if you can 🙏🏾

  • @TheRavensBrew
    @TheRavensBrew 2 месяца назад

    Nice!

  • @pzuazu8636
    @pzuazu8636 2 месяца назад

    Thank you, very helpful video.

    • @CleophasKalekem
      @CleophasKalekem 2 месяца назад

      Thank you. I’m glad you found it helpful. Please like the video and subscribe to the channel so someone else can also find it with ease 😊

  • @adityanjsg99
    @adityanjsg99 2 месяца назад

    It worked for me thanks

    • @CleophasKalekem
      @CleophasKalekem 2 месяца назад

      I’m glad to hear it worked for you. Please like the video and subscribe to the channel to support and stay updated 😊

  • @CleophasKalekem
    @CleophasKalekem 2 месяца назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem 2 месяца назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem 2 месяца назад

    Overall.com - website where you can get cheat sheets for all the major programming languages. Pretty neat!!

  • @CleophasKalekem
    @CleophasKalekem 2 месяца назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem 2 месяца назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem 2 месяца назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem 2 месяца назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem 2 месяца назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem 2 месяца назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)

  • @CleophasKalekem
    @CleophasKalekem 2 месяца назад

    If you found this video helpful, please LIKE and SUBSCRIBE to the channel :)