I just want to make sure, at 5:36 you said that, without the filter, we would expect the test to error because of all records that are over 40 minutes, but isn't the test suppose to check for the latest/max value, so it doesn't matter if there is a record over 40 minutes old right? The filter is just supposed to help with the performance.
Thanks for Sharing it is really helpful. Can you make a video on how to use/call stored procedures in DBT. Use case: Some time our data source sends duplicate files and both files are snowpiped in snowflake. From STG I need to load it into RAW layer. But before loading into RAW I would like to call a stored procedure which removes duplicates from STG.
Thanks for watching! This sounds like a good use case for a dbt "hook". Check out this video in this playlist - ruclips.net/video/8n-JFq8Uj9c/видео.html
@@KahanDataSolutions Thank you for your response. Yes hooks works if I had only one STG table. But in my case we have 50 STG tables and I want to loop through those tables. My Stored Procedure is basically a create table and alter table statement. I can run all those statement manually in pre hook or macros, but I would like to have a stored procedure in which I pass the table name and Primary key for that table.
Deliver more impact w/ modern data tools, without getting overwhelmed
See how in The Starter Guide for Modern Data → www.kahandatasolutions.com/guide
I think the command is only dbt source freshness now, right?
Thank you for the videos. Amazing!
thx for sharing, qq: why would we leverage snapshot freshness instead of freshness ?
I just want to make sure, at 5:36 you said that, without the filter, we would expect the test to error because of all records that are over 40 minutes, but isn't the test suppose to check for the latest/max value, so it doesn't matter if there is a record over 40 minutes old right?
The filter is just supposed to help with the performance.
Thanks kahan,,it is nice creation
Thanks for Sharing it is really helpful.
Can you make a video on how to use/call stored procedures in DBT.
Use case:
Some time our data source sends duplicate files and both files are snowpiped in snowflake.
From STG I need to load it into RAW layer. But before loading into RAW I would like to call a stored procedure which removes duplicates from STG.
Thanks for watching! This sounds like a good use case for a dbt "hook".
Check out this video in this playlist - ruclips.net/video/8n-JFq8Uj9c/видео.html
@@KahanDataSolutions Thank you for your response. Yes hooks works if I had only one STG table. But in my case we have 50 STG tables and I want to loop through those tables.
My Stored Procedure is basically a create table and alter table statement.
I can run all those statement manually in pre hook or macros, but I would like to have a stored procedure in which I pass the table name and Primary key for that table.
Hi what would the correct timezone for India be?
Tried convert_timezone('UTC', 'x', O_ORDERDATE)
x -> 'India/Kolkata' or 'INDIA' didn't work.