Loading Special Character From CSV Into Snowflake | Ch-06 | Snowflake Data Loading Approach

Поделиться
HTML-код
  • Опубликовано: 23 янв 2025

Комментарии • 18

  • @palaniappanpalani6345
    @palaniappanpalani6345 Год назад

    If the field are enclosed by both single and double quotes ,then what's the way to load such data? In your explanation you have mentioned that, it's possible to only specify one field_optionally_enclosed_by value. It cannot have multiple values. So what's the solution?

    • @saikrishnakodanda
      @saikrishnakodanda 6 месяцев назад

      If your data has fields enclosed by both single and double quotes, you can use the FIELD_OPTIONALLY_ENCLOSED_BY option with the COPY INTO command, but you'll need to specify a special character that is not present in your data as the quote character.
      One common approach is to use the ~ character (tilde) as the quote character, as it is unlikely to appear in your data. Then, you can use the REPLACE function to remove the single and double quotes from the data before loading it into Snowflake.

  • @ash3rr
    @ash3rr Год назад

    Tell me what if you have your field delimiter inside the double quotes, and sf interprets it as a new field instead.

    • @aniknarayan1692
      @aniknarayan1692 9 месяцев назад

      I am facing this issue. Did you find the solution for this?

  • @palaniappanpalani6345
    @palaniappanpalani6345 Год назад

    Can you explain regexp_replace ($6, '\\"|\``,''). I'm not able to understand the parts where replacement happens after you fetch column 6

  • @m.s.krishnamurthykitta
    @m.s.krishnamurthykitta 2 года назад

    ThankQ so much for the videos with patience .. and one more request make a video on the project used in snowflake for experience persons

  • @vamsikrishnakancharla1126
    @vamsikrishnakancharla1126 2 года назад +1

    Hi , can you suggest me to learn snowflake

    • @DataEngineering
      @DataEngineering  2 года назад

      This playlist has every thing .. it has 25+ chapters and if you want to learn everything about snowflake, it will help you.
      ruclips.net/p/PLba2xJ7yxHB7SWc4Sm-Sp3uGN74ulI4pS

  • @reduxCVA
    @reduxCVA 2 года назад +2

    good one

  • @mayanknema3007
    @mayanknema3007 2 года назад

    What do you mean by Line delimeter or Record delimeter - (
    )?

    • @DataEngineering
      @DataEngineering  2 года назад

      Each row in a data file should be separated with new line character and that is represented by
      .. it is not visible.. but some text editor shows it like notepad++

  • @sachinjondhale6480
    @sachinjondhale6480 3 месяца назад

    Thank you so much for this video I am facing one issue while loading special characters but with the help of this video, I can resolve it.
    For one of the columns I have data "\\\"\\\" \\\"\\\" \\\"\\\"" but with option ESCAPE ='\134' I can resolve it.

  • @vinaykumarpatnana
    @vinaykumarpatnana 2 года назад

    escape = '\134' means
    please reply it.

    • @DataEngineering
      @DataEngineering  2 года назад

      ESCAPE_UNENCLOSED_FIELD = '\134' => Means Backslash (equivalent to '\\'

    • @vinaykumarpatnana
      @vinaykumarpatnana 2 года назад

      @@DataEngineering
      Sir, your videos are excellent.
      I want list of all characters
      For eg escape for \ is 134.

  • @palaniappanpalani6345
    @palaniappanpalani6345 Год назад

    1. What if we have data which has fields enclosed by both single quotes and double quotes? How to handle that situation?
    2. Let's consider our data has other special characters like smileys etc in the description column. We want to load them into a table as it is. But when querying, we need to do a filter and comparison between the text in description column(without special characters) and the search string which we are giving.
    Eg. Description is like "I am a dancer 😁" and our search string is "dancer". What's the most efficient way to get the results?