How to build a pipeline to create table and insert records on snowflake with airflow on AWS EC2

Поделиться
HTML-код
  • Опубликовано: 23 окт 2024

Комментарии • 19

  • @jalisarenee55
    @jalisarenee55 6 месяцев назад +1

    Thank you for this tutorial!

  • @BI-Rahul
    @BI-Rahul Год назад

    Your tutorials are incredible, accelerating my learning journey at an astonishing pace! Keep up the outstanding work, amigos! Adios!

    • @tuplespectra
      @tuplespectra  Год назад

      Thanks so much. I'm glad you are learning a lot from our videos.

  • @gyungyoonpark
    @gyungyoonpark 8 месяцев назад

    thank you for this amazing tutorial. so much to learn.
    one corrrection. when you are creating snowflake connection, in the "region" section, make sure to add .aws
    for example, us-west-2.aws --> this solved my error

  • @sayedsamimahamed5324
    @sayedsamimahamed5324 9 месяцев назад

    Ty for such a nice explanation. This will help a lot.

  • @RobertMorgan-ne4tb
    @RobertMorgan-ne4tb Год назад +1

    Great job

  • @tattarrrrattat
    @tattarrrrattat Год назад +1

    Good man! Love these vids.

  • @vaibhavverma1340
    @vaibhavverma1340 Год назад

    How to share files large files as you used here only 4 rows i.e manually created instead of that I want to share large files how to do in airflow??
    please share your thoughts on this..!!

    • @tuplespectra
      @tuplespectra  Год назад +1

      You can save your large files in s3 bucket and then load it into snowflake. Check out my video where I showed how to load data from s3 bucket into snowflake. ruclips.net/video/Trn8gg9IlRs/видео.html

  • @BI-Rahul
    @BI-Rahul Год назад

    Is it possible to setup alerting system for Airflow in Slack?

    • @tuplespectra
      @tuplespectra  Год назад

      I've not done this before but this link shows there is an apache airflow provider for slack (airflow.apache.org/docs/apache-airflow-providers-slack/stable/index.html) which might mean we might be able to set up an alert system I will think. But this might be a good simple project we can explore in the future.

    • @tuplespectra
      @tuplespectra  Год назад

      @BI-Rahul Check out my new video where I showed an etl pipeline with slack notification. ruclips.net/video/ocFzNmgYW9o/видео.html

  • @josecardons6221
    @josecardons6221 4 месяца назад

    I´m getting this error when execute airflow standalone ModuleNotFoundError: No module named 'tenacity.asyncio'

    • @josecardons6221
      @josecardons6221 4 месяца назад

      I solved this way pip uninstall tenacity
      Found existing installation: tenacity 8.4.0

      pip install tenacity==8.2.1