Snowflake - Data Loading and Transforming while Loading

Поделиться
HTML-код
  • Опубликовано: 24 дек 2024

Комментарии • 69

  • @mohammedvahid5099
    @mohammedvahid5099 11 месяцев назад +8

    🙏ur real man who seen on market and good person sir ❤ ఇంత సబ్జెక్ట్ ఎవరు ఫ్రీ గా చెప్పరు sir meeru always happy ga ఉండాలి ❤ our blessings always with u❤️

    • @mrjana520
      @mrjana520  11 месяцев назад +2

      Thanks brother for wishes, I wish you all the very best.

    • @saicharan8495
      @saicharan8495 4 месяца назад

      ruclips.net/video/zAbPfpqyTVs/видео.html

  • @charlesa9431
    @charlesa9431 10 месяцев назад +2

    You are very good at what you teach please keep it going.

  • @pretty_pets_07
    @pretty_pets_07 6 месяцев назад +1

    Excellent ga explain cheysyaru anna everyone will like your presentation. Keep explaining on more topics. God bless you anna🙏🙏🙏

    • @saicharan8495
      @saicharan8495 4 месяца назад

      ruclips.net/video/zAbPfpqyTVs/видео.html

  • @jagadeeswarareddynetapalli3662
    @jagadeeswarareddynetapalli3662 Год назад +3

    Great Effort.Nice explanation

  • @saereddy
    @saereddy Год назад +2

    Super Anna,,, mind lo dhigindhi.

    • @saicharan8495
      @saicharan8495 4 месяца назад

      ruclips.net/video/zAbPfpqyTVs/видео.html

  • @yamunau.yamuna5189
    @yamunau.yamuna5189 Год назад +1

    Crystal clear explination thanks bro

  • @azada.k958
    @azada.k958 10 месяцев назад +1

    Great Sir,

  • @SudiptaTripathy
    @SudiptaTripathy Год назад +1

    Nicely explained :). Very helpful

  • @ranganatho707
    @ranganatho707 Год назад +1

    Great videos, please share details on snow pro core certification in our country

  • @Jessalsar
    @Jessalsar 3 месяца назад

    can we use put command to load data into tables difference put and copy command..?

    • @mrjana520
      @mrjana520  3 месяца назад

      Put is to push the files from on-premise to internal stages, Copy is to load data from external or internal stages

  • @nagaa225
    @nagaa225 Месяц назад

    Who will takecare of archiving file once it is loaded into snowflake table

    • @mrjana520
      @mrjana520  Месяц назад

      You can set up auto archive mechanism from cloud side or you can manually do it in regular intervals.

  • @UPavan07
    @UPavan07 Год назад

    sir during the time of creation of free trail i have selected Azure instead of AWS is there any way to change it now

    • @mrjana520
      @mrjana520  Год назад

      Not possible, but you can create another account with AWS

    • @UPavan07
      @UPavan07 Год назад

      @@mrjana520 ok sir

  • @ashokrajann9351
    @ashokrajann9351 Год назад

    Hi sir
    My understanding is
    Bulk load can be done using an external stage and we need VW for that
    Continuous load can be done using internal stage by using snowpipe feature
    Snowflake itself offer/support snowpipe
    Please correct me if am wrong

    • @mrjana520
      @mrjana520  Год назад

      That is not correct, watch external stages and internal stages videos as well, you will get answers

    • @ashokrajann9351
      @ashokrajann9351 Год назад +1

      @@mrjana520 sir
      Bulk load can be done either by external or internal stage. Bulk load needs VW and no snowpipe to process huge data
      Continuous load processes small amount of data and does not need VW
      It requires a snowpipe which is a serverless feature (it has a separate cost)
      Now my understanding is correct sir?

    • @mrjana520
      @mrjana520  Год назад

      Yup

  • @atlasrinu2215
    @atlasrinu2215 2 года назад +1

    Nice Video. Please make a demo on how to migrate database/schema/tables from Dev to Test environments.

  • @krishanajangid1763
    @krishanajangid1763 2 месяца назад

    Can you see publicly S3 bucket files ?

  • @sudhakarkunchala7928
    @sudhakarkunchala7928 Год назад

    What is stage? Onve the schema is created again stage created that means stage is like table?

    • @mrjana520
      @mrjana520  Год назад

      No, watch full video of external stages and internal stages video for full details on stages.

    • @sudhakarkunchala7928
      @sudhakarkunchala7928 Год назад

      @@mrjana520 thanks nenu chusathanu,if I want to became the data enginer,what skill need to learn?

  • @Satyanandan_D
    @Satyanandan_D 2 года назад +1

    If I want to load data every day without my intervention, Can I run this copy command everyday using any scheduling tool? or Do we need to keep this command in script?

    • @mrjana520
      @mrjana520  Год назад

      You can use tasks for scheduling queries, tasks is an inbuilt feature of Snowflake

  • @praveen5281
    @praveen5281 Год назад

    in case2 and case3 copy command you used s.$1,s.$2. what 's' refers to. can we use $1,$2 directly

    • @mrjana520
      @mrjana520  Год назад

      You can use directly, s is just alias name

  • @Nenuhappy
    @Nenuhappy Год назад

    Hi sir
    Can we directly load the data from S3 to Snowflake with out creating the External stage and Storage integration?In your example you have directly loaded the data

    • @mrjana520
      @mrjana520  Год назад +1

      Yes, pls watch the video fully, you will get answer for your question..

  • @RK-wf7re
    @RK-wf7re 2 года назад +1

    Nice content. Is Snowflake can be used as a ETL tool also like informatica, abinitio?

    • @mrjana520
      @mrjana520  2 года назад

      Not completely, but supports most of the extract transform and load operations

    • @RK-wf7re
      @RK-wf7re 2 года назад +2

      @@mrjana520 Thank you. So it is mainly used as database only.

  • @ranjith335
    @ranjith335 Год назад

    While creating external storage, facing below error:
    Failure using stage area. Cause: [Access Denied (Status Code: 403; Error Code: AccessDenied)]

    • @mrjana520
      @mrjana520  Год назад

      Send the queries you are using to my mail id - jana.snowflake2@gmail.com

  • @Buddy14143
    @Buddy14143 Год назад

    Bro I have a doubt in this video regarding 5 th case ,in SQL we have set identity insert on/off option .In snowflake also is it working or not?

    • @mrjana520
      @mrjana520  Год назад

      AUTOINCREMENT and IDENTITY are synonyms in Snowflake, you can use either of these.

    • @Buddy14143
      @Buddy14143 Год назад

      @@mrjana520
      Thanks for replying janardhan garu
      Thank you so much

  • @mayanknema3007
    @mayanknema3007 2 года назад

    Can ypu please tell me if there is an issue with data loading because of size & many users? How we can deal with this situation?

    • @mrjana520
      @mrjana520  2 года назад

      There is no limit on file sizes, but Snowflake recommends to split and process the larger files. and coming to many users there will be no issue if you are using a multi clustered warehouse.

    • @mayanknema3007
      @mayanknema3007 2 года назад

      @@mrjana520 ..but what to do when there is a performance issue with Snowflake?

  • @ATIFKHAN-mz4fp
    @ATIFKHAN-mz4fp Год назад

    thanks sir can you able to post snowflake vacancy videos its more help full

    • @mrjana520
      @mrjana520  Год назад

      I am not aware of vacancies

  • @m.s.krishnamurthykitta
    @m.s.krishnamurthykitta 2 года назад +1

    TQ....ANNA

  • @mohammedvahid5099
    @mohammedvahid5099 Год назад

    Bro CSV files ఇవ్వండి practice కోసం మరియు ఎలా s3 bucket లో csv files load చేసి roles మరియు policies create చేసి arn attach చెయ్యాలి చూపించండి 🙏

    • @mrjana520
      @mrjana520  Год назад +1

      That part was explained in AWS-Snowflake integration, please watch that video.
      I have uploaded videos on all concepts, follow snowflake playlist in the order.

    • @mohammedvahid5099
      @mohammedvahid5099 11 месяцев назад

      Thnk u❤ sir

  • @divityvali8454
    @divityvali8454 6 месяцев назад

    Can you paste this workshets in description

    • @mrjana520
      @mrjana520  6 месяцев назад

      there is a limitation on Description, can't paste entire PPT or code.
      You can get all snowflake Videos, PPTs, Queries, Interview questions and Practice files in my Udemy course for 499 rupees.. I will be updating this content and will be uploading all new videos in this course. And you will have lifelong access to these videos and materials.
      My Snowflake Udemy Course:
      www.udemy.com/course/snowflake-complete-course-for-clearing-interviews/?couponCode=0C8E557D4EB94D407F5A
      Use the coupon below to get it for 499 rupees.
      Coupon: 0C8E557D4EB94D407F5A

  • @NitinKumar_up_se
    @NitinKumar_up_se 7 месяцев назад

    how to create url like s3://

    • @mrjana520
      @mrjana520  7 месяцев назад

      Watch AWS integration video for details

  • @skdonsingh
    @skdonsingh Год назад

    Thanks Janardhan for your videos. Its very helpful and your knowlege and teching skill is excellent. I have already subsribed your channel. Apart from subsribed ,there is option of Join . I want to know how can I join and what would be its benefits.

    • @mrjana520
      @mrjana520  Год назад

      Hi currently there are no benefits of joining the channel as I am providing videos publicly, not only to members

  • @mohammedvahid5099
    @mohammedvahid5099 Год назад

    Sir please give me the CSV files to practice 🙏

    • @mrjana520
      @mrjana520  Год назад +1

      I can be reachable on jana.snowflake2@gmail.com

  • @vinodbarma2858
    @vinodbarma2858 Год назад

    please upload videos in sequence, its hard to understand for new learners

    • @mrjana520
      @mrjana520  Год назад +1

      All videos are in order in my Snowflake playlist..