@@naziaakhtar8575 Not without changing the data flow (by adding a new column or removing a column) in both the source and the sink code, and then publish it again. That's because the target is Data Warehouse (the sink), where the schema must be defined on the target tables. If the target is schema-less (let's say a parquet file in Data Lake) then it would be possible to construct a data flow that can accommodate the change of source/target structure (new columns/missing columns). I hope it make sense.
Thank you so much for such a clear and informative video. Keep up the good work.
Thank you very much for feedback!
Awesome, this exactly what I wanted to setup, thank you.
Thanks Arvind!
hello , thanks for your video, how can I Run my pipeline automatically when a new line is ad in my Excel file ?
Thank you for this insightful video @Data bites
Thank you very much for your feedback!
would this work if we add additional column and run it?
or if we remove a column?
@@naziaakhtar8575 Not without changing the data flow (by adding a new column or removing a column) in both the source and the sink code, and then publish it again. That's because the target is Data Warehouse (the sink), where the schema must be defined on the target tables. If the target is schema-less (let's say a parquet file in Data Lake) then it would be possible to construct a data flow that can accommodate the change of source/target structure (new columns/missing columns). I hope it make sense.