Hey @vivekpuurkayastha1580, Yes, Savepoints can be used in PostgreSQL ETL pipelines. They help create checkpoints within transactions, allowing for partial rollbacks if errors occur. By defining Savepoints at key stages of the pipeline, you can ensure data consistency and resume processing from a known good state in case of failures, without restarting the entire process. Hope this helps.
Hey @rmathew733, you are right, the default transaction type is the autocommit. Each sql statement will be executed in its own transaction. Some would say, the autocommit is implicit.
all in all good skills and idea
I appreciate the comment! Thanks.
Hi .. Thanks do we use Savepoints in ETL pipeline?
Hey @vivekpuurkayastha1580,
Yes, Savepoints can be used in PostgreSQL ETL pipelines. They help create checkpoints within transactions, allowing for partial rollbacks if errors occur. By defining Savepoints at key stages of the pipeline, you can ensure data consistency and resume processing from a known good state in case of failures, without restarting the entire process.
Hope this helps.
By default Postgres do a AUTO COMMIT right?
Hey @rmathew733, you are right, the default transaction type is the autocommit.
Each sql statement will be executed in its own transaction. Some would say, the autocommit is implicit.