Track and Record Data Changes with Change Data Capture (CDC) in Azure SQL | Data Exposed

Поделиться
HTML-код
  • Опубликовано: 3 дек 2024

Комментарии • 20

  • @MrMonday1000percent
    @MrMonday1000percent Год назад +2

    Excellent demo and presentation. At 12:10 to 12:30 there is a small error in wording, the retention parameter value is actually minutes not seconds. The default being 4320 minutes which is 72 hours which is 3 days. As always check the docs as this may change in future versions (hopefully not though!).

  • @allenbabu4336
    @allenbabu4336 Год назад +1

    I have installed sql server 2019 in Linux with multiple databases created on it. I have multiple tables across different databses with CDC enabled. But the SQL server gets hanged very often due to this cdc. KIndly let us know, if Linux having any issue with cdc enabled.

  • @daniyalahsan6166
    @daniyalahsan6166 Год назад +1

    Is there a way to use CDC to upsert values into a table based on a primary key? if so can someone please advise or share a link if you have one. Thanks

  • @jordannyc2769
    @jordannyc2769 Год назад

    Any way to use elastic/kibana against CDC to monitor stored procedures or any scheduled sql inserts/updates ?

    • @kosmologic6007
      @kosmologic6007 5 месяцев назад

      I did kafka streams & connect cdc on sql monitoring by API using static monitors in New Relic. Works fine on prod.

  • @sintetico82
    @sintetico82 2 года назад +1

    Can you prived more concrete examples about these scenarios "propagate changes to downstream subscriber" and "event-based programming that provides instantaneous responses based on data change".
    I would like to connect SQL Server 2019 CDC events to a message broker like RabbitMQ but look like there isn't anything already developed.

    • @abhimantiwari
      @abhimantiwari 2 года назад

      Multiple other Microsoft technologies such as Azure Data Factory can be used to move CDC change data to other destinations (e.g., other databases, data warehouses). Also, other third-party services also offer streaming capabilities for change data from CDC. For instance, Striim and Qlik offer integration, processing, delivery, analysis, or visualization capabilities for CDC changes.
      Debezium can also be used to process CDC changes in real-time over various binders such as RabbitMQ, Azure Event Hub, Apache Kafka etc.

  • @harry5472
    @harry5472 3 года назад

    When to use CDC vs Database Ledger? If your requirements are just table auditing.

    • @abhimantiwari
      @abhimantiwari 2 года назад

      CDC is a widely used feature by a wide range of customers for a variety of purposes as mentioned below, but not limited to:
      1. Tracking data changes for auditing
      2. Recording data changes on source database and integrating with other services (e.g., Azure Data Factory) to stream these changes to other destinations
      3. Performing analytics on change data  
      Azure SQL DB ledger uses the power of blockchain with the simplicity of SQL.
      It makes data in SQL tamper-evident through cryptography. Provides a historical record of all changes, verified through cryptographic proofs.

  • @paulantohe3783
    @paulantohe3783 Год назад

    Frumoasa Mara :D 😁

  • @walterlonso
    @walterlonso 3 года назад

    Hi, Is this feature delivered in all regions? for example China?

    • @marasteiu6854
      @marasteiu6854 3 года назад +1

      Hi! Yes, it's in public preview worldwide.

    • @DanielWillen
      @DanielWillen 2 года назад

      @@marasteiu6854 When is it leaving preview do you think?

    • @samuelgit
      @samuelgit 2 года назад

      @@marasteiu6854 do you know how to identify which user did the change? do you have some documentation please?

    • @abhimantiwari
      @abhimantiwari 2 года назад

      @Walter Alonso Yes

  • @samuelgit
    @samuelgit 2 года назад

    Hi, How I can identify which user did each change using CDC?

    • @abhimantiwari
      @abhimantiwari 2 года назад

      Hi Sam, CDC doesn't record user identity performing the change. If you wish to store user identity, you will need to handle with custom code logic.

  • @sconnell194
    @sconnell194 3 года назад

    👍

  • @hydtechietalks3607
    @hydtechietalks3607 2 года назад

    why does Microsoft always get a Non Inglis speakers .. all the complexity lies in there 🤣

  • @praveennakka2021
    @praveennakka2021 2 года назад

    Not a good presentation guys sorry.... Step up please