Validate Data Before Loading Into Snowflake | Ch-08 | Snowflake Data Loading Approach

Поделиться
HTML-код
  • Опубликовано: 7 янв 2025

Комментарии •

  • @venkataramanamurthypasumar4542
    @venkataramanamurthypasumar4542 8 месяцев назад

    Wow! Wonderful training video with an excellent explanation.

  • @DineshMe-us9xl
    @DineshMe-us9xl Год назад

    Thank you for providing such an informative video on snowflake.

    • @DataEngineering
      @DataEngineering  Год назад

      Glad it was helpful!
      and yes, I know many of us are not fully aware of snowpark Python API, if you want to manage snowflake more programatically.. you can watch my paid contents (data + code available) .. many folks don't know the power of snowpark... these 2 videos... will help you to broaden your knowledge..
      These contents are available in discounted price for limited time.. (one for JSON and one for CSV).. it can automatically create DDL and DML and also run copy command...
      1. www.udemy.com/course/snowpark-python-ingest-json-data-automatically-in-snowflake/?couponCode=NEWYEAR50
      2. www.udemy.com/course/automatic-data-ingestion-using-snowflake-snowpark-python-api/?couponCode=NEWYEAR35

  • @mechanicalbrand444
    @mechanicalbrand444 8 месяцев назад

    It will be helpful if you provide the data set used in u r videos, so that we can also practice it. Thanks a lot.

  • @ShaikAsethulla
    @ShaikAsethulla Месяц назад

    can you please provide the data source files too @Data Engineering Simplified

  • @shashankm2859
    @shashankm2859 Год назад

    I am getting this error "Invalid argument [Provided job UUID not for a COPY job] for table function. Table function argument is required to be a constant.". Not sure why? I am executing following query:
    select * from table(validate(EMP_VALIDATION, job_id=>'01aa1e26-3200-a39c-0002-3c3e000293ca'));

    • @DataEngineering
      @DataEngineering  Год назад

      You might have copied the incorrect query id, the query id should belong to copy command and it should have executed a real copy not a copy with validation.

  • @dztlqv
    @dztlqv Год назад

    validation mode is not working for parquet file format - any suggestion to handle error records while copying data from parquet file to Snowflake?

    • @vardhanreddy435
      @vardhanreddy435 2 месяца назад

      I'm encountering an error when I try to validate Parquet files using the COPY INTO command with the validation mode. copy into account master from @stg_sav/sav_customer/
      file_format =sav_parquet
      validation_mode =return_errors
      2nd option
      copy into account master from @stg_sav/sav_customer/
      file_format =sav_parquet
      match_by_column_name =case_sensitive
      validation_mode =return_errors
      Please let me how to fix it.

  • @parthibans7596
    @parthibans7596 2 года назад

    thank you bro

  • @debasishghosh3958
    @debasishghosh3958 Год назад

    Your viedows are great and I am learnign a lot from these learning videows. I have having issue while loading "01/01/2020 12:28:15 AM' this data into table, I have declare data type timestamp or Datetime or timextamp_tz nothing is work always getting "Timestamp '01/01/2020 12:28:15 AM' is not recognized" error. Appreciate if you could yuou please help me on this

    • @DataEngineering
      @DataEngineering  Год назад

      while loading raw data.. have it mapped to text.. and then try to convert it.. else use cast with format text to solve the problem..
      and before that.. try to solve the problem with one single value in worksheet..

  • @m.s.krishnamurthykitta
    @m.s.krishnamurthykitta 2 года назад

    INDEED VIDEOS OF EVERY "SNOWFLAKE DEVELOPER"

    • @DataEngineering
      @DataEngineering  2 года назад +1

      thanks dear.. share the videos with other folks who wants to learn and gain knowlege..

    • @m.s.krishnamurthykitta
      @m.s.krishnamurthykitta 2 года назад

      @@DataEngineering definitely i will share. its Our responsibility to publish our hero to viewers

    • @DataEngineering
      @DataEngineering  2 года назад

      @@m.s.krishnamurthykitta thank you so much for you support and love. I really appreciate.