Building Modern Data Applications Using Databricks Lakehouse

With so many tools to choose from in today’s data engineering development stack as well as operational complexity, this often overwhelms data engineers, causing them to spend less time gleaning value from their data and more time maintaining complex data pipelines. Guided by a lead specialist solutions architect at Databricks with 10+ years of experience in data and AI, this book shows you how the Delta Live Tables framework simplifies data pipeline development by allowing you to focus on defining input data sources, transformation logic, and output table destinations.
This book gives you an overview of the Delta Lake format, the Databricks Data Intelligence Platform, and the Delta Live Tables framework. It teaches you how to apply data transformations by implementing the Databricks medallion architecture and continuously monitor the data quality of your pipelines. You’ll learn how to handle incoming data using the Databricks Auto Loader feature and automate real-time data processing using Databricks workflows. You’ll master how to recover from runtime errors automatically.
By the end of this book, you’ll be able to build a real-time data pipeline from scratch using Delta Live Tables, leverage CI/CD tools to deploy data pipeline changes automatically across deployment environments, and monitor, control, and optimize cloud costs.

J-Novel Club is a digital publishing company started by translators and fans like you! Our mission is to translate and release the coolest, funnest, and newest light novels from Japan to the world. By focusing on digital releases, and providing a membership service to let people read the books as soon as they are translated, our goal is to build a community of light novel readers and to grow the market, so that more and more releases can be officially licensed and translated. We won't just publish the big hit light novels that get anime adaptations, but also newer titles or books from small publishers and web novels... as long as it's a blast to read, we'll bring it to you! So pull out your tablet or ereader, sit down in a comfy chair, and join the club! weniger anzeigen expand_less