@ Azure Bits and Bytes Hi Sir very useful and excellent, could you please add update logic, so if there is any change in source table records it should update the records in sink table then need to take latest from source to sink table. Thanks in advance
Hi How to Filter multiple values in Parameter like SELECT * FROM DimCustomer WHERE EnglishEducation IN (@'{Education('LookupEducation').Output}') not sure it is correct way to pass multiple values in to parameter in adf paramter. Thank you
It was nice,but one question how can i handle multiple tables passing dynamically to pipe line,right now you are entering table names at pipe line level manually but my requirement is i have to pass table list for both lookups dynamically
i got to know there is another video where we can pass tables dynamically with master pipe line..excellent..its an urgent requirement for me..thanks a lot
Hi, This Really worked and helped me out . Now I need to do CDC based on other column like Id or other unique column so how to implement this as our watermarkcolumn is of datetime type. Please Help me out. Thanks in advance
in your case, you can make use of Id value as the watermark column, and change the logic to extract a id range(from and to) and use that to fetch data from source system. Hope it helps.
@@azurebitsandbytes5804 I need to do Capture Data Change and do the update only on the basis of UpdateTime so how to do that. I really appreciate for your assistance. Thanks.
no this is not useful.The table should be manually enter. This is 200% end developer can end wrong table or misspell or space in table name end or before. The best way to store all the table name in the Table then for each loop process
Tough to achieve in different real time scenarios but still a masterpiece activity explained for new users..tks
Lucid explanation. Good job brother.
Awesome Content.. Great work done Sir....
nice explanation with easily understanding the concept. thank you
Great Explanation Sir with good content
Very good explanation, helped me in getting the job done.
@
Azure Bits and Bytes
Hi Sir very useful and excellent, could you please add update logic, so if there is any change in source table records it should update the records in sink table then need to take latest from source to sink table. Thanks in advance
Am getting an error in pulling the data through ADF for Oracle as a Source . Could you please help me in this
Hi
How to Filter multiple values in Parameter like
SELECT * FROM DimCustomer WHERE EnglishEducation IN (@'{Education('LookupEducation').Output}')
not sure it is correct way to pass multiple values in to parameter in adf paramter.
Thank you
where can we find this dataset of customer orders
It was nice,but one question how can i handle multiple tables passing dynamically to pipe line,right now you are entering table names at pipe line level manually but my requirement is i have to pass table list for both lookups dynamically
i got to know there is another video where we can pass tables dynamically with master pipe line..excellent..its an urgent requirement for me..thanks a lot
Hi, This Really worked and helped me out . Now I need to do CDC based on other column like Id or other unique column so how to implement this as our watermarkcolumn is of datetime type.
Please Help me out.
Thanks in advance
in your case, you can make use of Id value as the watermark column, and change the logic to extract a id range(from and to) and use that to fetch data from source system. Hope it helps.
@@azurebitsandbytes5804 I need to do Capture Data Change and do the update only on the basis of UpdateTime so how to do that. I really appreciate for your assistance. Thanks.
Thanks a lot sir!!! Can I get ddl scripts for practice
@@preetijaiswal9089 @azurebitsandbytes5804
Please help how cdc will work in this case?
why can't we update watermarkDate in a table directly with query instead of Stored procedure which is extra object
The script activity was not present at the time of making this video. You can use this definitely.
How it will handle duplicate data?? If pipeline runs twice at at time the. It will again copy the data??
making use of tumbling window trigger will help avoid overlapping runs.
PLEASE HOW GET FILE SOURCE FOR TRAINING? TKS
How to handle if the table don't have data?
Which table?
no this is not useful.The table should be manually enter. This is 200% end developer can end wrong table or misspell or space in table name end or before. The best way to store all the table name in the Table then for each loop process