Constructing Modern Data Engineering Pipelines
Webinar Speaker: Markum Reed, Research Director for Data Management, TDWI
Date: Thursday, August 18, 2022
Time: 9:00 a.m. PT, 12:00 p.m. ET
Data engineering encompasses procedures, tools, and skill sets that govern and facilitate data flow. The data engineering process includes creating data pipelines that automate data transfer from source to destination and transform that data into a specific format for a particular type of analysis.
Data engineers also need to work with different types of data as well as streaming data pipelines to handle events at scale in real time. No wonder data engineering is no trivial task. There are challenges every step of the way, so it is crucial to have an architecture that can handle an organization’s needs and avoid complexity.
In this talk we will focus on:
- Overcoming modern data engineering challenges such as siloed data, reliability and performance degradation, complex pipelines, and architectures
- Building real-time data pipelines that lower data latency
Shiyi Gu
Senior Product Marketing Manager
Snowflake
Shiyi leads the data engineering go-to-market at Snowflake. She is passionate about data and using data to connect people and businesses together, to drive culture and behavior changes. Before Snowflake, she spent many years in the data management industry across the data integration and NoSQL space, where she held various roles at Talend, DataStax, and SAP.