Data Ingestion with Azure Synapse: Real-Life Scenarios & Solutions by Dustin Vannoy

Learn how to use Azure Synapse Analytics for data ingestion workloads from Apache Kafka, SQL Server, Azure Storage, and a variety of Azure Services.
Dustin Vannoy presents Data Ingestion with Azure Synapse: Real-Life Scenarios and Solutions at the Microsoft Data and AI South Florida User Group.
- TOPICS COVERED:
- Azure Synapse Analytics
- Ingesting data from Azure Storage
- Sourcing Data from SQL Server for data ingestion
- Apache Kafka as a data ingestion source
- Using Azure Synapse Pipelines for data ingestion processes
- Processing Data Ingestion with Synapse Serverless SQL
- Using Synapse Spark for data ingestion workloads
- ABSTRACT:
Data ingestion is the process of collecting and organizing the data and it is the foundation of the data lake or data warehouse. Ingestion typically involves a variety of sources each with different security or performance constraints.
In this session we focus in on several common services for data ingestion and real use cases for each. We will walk through ingesting data from Azure Storage, SQL Server, and Apache Kafka. We will use different techniques for each source which includes using Synapse Pipelines, Synapse Serverless SQL, and Synapse Spark.
- BIOGRAPHY:
Dustin Vannoy is a Data Engineering Consultant experienced in solving business problems with analytics and big data solutions.
He is passionate about all aspects of data engineering, especially building data platforms and streaming data pipelines. He currently focuses on building data platforms and pipelines in Azure with Synapse, Databricks, Kafka, Python, and Scala.
He is co-founder of the Data Engineering San Diego meetup and encourages others to grow their data skills by making tutorials, mentoring others, and speaking at events.
***
Contact: Dustin Vannoy
LinkedIn: / dustinvannoy
Twitter: @DustinVannoy / dustinvannoy
Blog: dustinvannoy.com
Website: dustinvannoy.c...
RUclips: / dustinvannoy
***
** Join DataAISF - Microsoft Data and AI South Florida User Group **
RUclips - bit.ly/2RsbCgY - Subscribe Now
Twitter - bit.ly/3crVYKe - Follow Us
MeetUp - bit.ly/2QRjN8Q - Register
***
EVENT DETAILS:
TITLE: Data Ingestion with Azure Synapse: Real-Life Scenarios & Solutions
BY : Dustin Vannoy
DATE : Thursday - August 18th, 2022
TIME : 6:00 pm US Eastern Time
RSVP:
WATCH:
Subscribe to the RUclips channel & Click on the Bell
bit.ly/2RsbCgY
- RSVP and Bring a Friend:
** Join DataAISF - Microsoft Data and AI South Florida User Group **
RUclips - bit.ly/2RsbCgY - Subscribe Now
Twitter - @DataAISF bit.ly/3crVYKe - Follow Us
MeetUp - bit.ly/2QRjN8Q - Register
. .