Name: DataBricks: Build and Deploy ETL pipelines with Delta Live Tables
Start: 2022-12-08T00:00:00+00:00
End: 2022-12-08T00:00:00+00:00

Event Concluded

TechDogs-"DataBricks: Build and Deploy ETL pipelines with Delta Live Tables"

Event Type

Virtual

Date

Dec 8, 2022

Time

9:00 AM PT

Event Linkhttps://pages.databricks.com/202212-AMER-VE-DLT-Live-Workshop_DLT-Workshop-128.html?utm_source=databricks&utm_medium=web&utm_campaign=7018y000001ribcqas&_ga=2.64294255.1564805936.1668684276-727731938.1668684276

About Event

As data volumes and their complexity continue to rapidly grow, the tools to process that data have not kept pace. The burden is put primarily on data engineering teams, who need to stitch together and maintain many different elements of code and supporting infrastructure to process data from source to destination, which is repeated across dozens of data sources and multiple stages of data processing. Data engineers develop ETL pipelines as individualized tasks, making it difficult to “stitch” together multiple sequences of the ETL pipeline. With Delta Live Tables (DLT), data teams have an ETL framework that uses a simple declarative approach to building reliable data pipelines. DLT automatically manages your infrastructure at scale so you can spend less time on tooling and focus on getting value from data. In this session, you will learn how to build and deploy a declarative streaming ETL pipeline at scale with DLT, how DTL automates complex and time-consuming tasks like task orchestration, error handling, recovery and auto-scaling with performance optimizations. Finally, we will show you how DLT enables data teams to deliver fresh, up-to-date data with built-in quality controls and monitoring ensuring accurate and useful BI, Data Science and ML.

Tags:

Data Volumes Complexity Tools Supporting Infrastructure Source Data Engineers Develop ETL Pipelines

Join The Discussion

- Promoted By TechDogs -

Data Management