How to use dbt Snapshots to track data history

Поделиться
HTML-код
  • Опубликовано: 29 ноя 2024

Комментарии • 19

  • @KahanDataSolutions
    @KahanDataSolutions  Год назад

    Deliver more impact w/ modern data tools, without getting overwhelmed
    See how in The Starter Guide for Modern Data → www.kahandatasolutions.com/guide

  • @moverecursus1337
    @moverecursus1337 26 дней назад +1

    Would be awesome a pt2 of this video, now with how a BI analyst would use for reporting, like, if we want to get the vision of the data each month, the ways we could use for this

  • @jppbkm
    @jppbkm Год назад

    After going through the first 25% of the playbook and then stopping....here I am again googling answers to a work problem and finding your videos. Appreciate all the info and content.
    (Our issues was an incorrect unique_key setting on a table where the snapshot was created HUGE tables as a result.)

  • @anbarasuramachandran2235
    @anbarasuramachandran2235 Год назад +1

    Awesome. Helped in understanding the concept of Slowly changing dimensions (SCD) !

  • @dominicaleung7329
    @dominicaleung7329 3 месяца назад +1

    thank you so much for your help. You make it very clear. I got mine snapshot working now.

  • @rajasekharreddy113
    @rajasekharreddy113 2 месяца назад

    Thank you for the video. One question,
    Once snapshot is taken, it is best practice to use snapshot tables or source tables for working with other models?
    if snapshot is answer, how frequently, we have to update snapshot tables? or we have to trigger them for every update

  • @rusttaf
    @rusttaf Год назад

    Hi, thanks for explaining this concept. Is there a way to set valid to date of ending record to d-1? This way using between in where condition will return 2 records instead of 1

  • @anushanr1355
    @anushanr1355 Год назад

    Hi, please make a detailed video on dbt analytics certification. As I am preparing for that it would be much helpful.
    Appreciate your works on data engineering

  • @gauravsati1041
    @gauravsati1041 4 месяца назад

    Hi , How we can set DBT_VALID_TO default Null values to something other max number

  • @nainatiwari4543
    @nainatiwari4543 Год назад

    Hey ,What have you mentioned in yml file?
    As I was trying to do this way but the staging model could not refer the snapshot due to some reason.

  • @arbol41
    @arbol41 Год назад +1

    Thank for a very good content, I have a question how we can track deleted raw from the source ?

    • @mrp12-ii
      @mrp12-ii 3 месяца назад

      soft deletes, CDC or snapshots would be the way to go.

  • @dimi727
    @dimi727 10 месяцев назад

    is it possible to partition snapshots (especially for Bigquery?)

  • @BreathOfHopePodcast
    @BreathOfHopePodcast 2 месяца назад

    i ran from data science because of I knew I couldn't keep up with all the statistical readings

  • @100sabh
    @100sabh Год назад +1

    I find snowflake streams to be better than this concept

  • @mallninja9805
    @mallninja9805 Год назад

    You're a "Solutions Architect". Do you really need to nickel and dime your youtube audience to death with "courses" ?? You should feel shame.