Spark Data Engineering Patterns – Shortcuts and external tables

About this episode

Text from the YouTube description.

Fabric Espresso Presents: "Spark Data Engineering Patterns – Shortcuts and external tables"

📌 About This Episode:

In today's data-driven world, mastering Spark and Big Data technologies is no longer optional—it's essential. That's why we've invited Daniel Coelho to share his invaluable insights. Daniel is driving Delta Lake at Microsoft Fabric and Azure Synapse Analytics. He's laser-focused on Data Engineering experiences using Spark and Big Data technologies. His work enables BI Analysts, DBAs, Data Engineers, and Data Scientists to shape their data effectively and build incredible solutions.

In this episode, we'll dive deep into:

📊 The Difference Between Managed Tables, External Tables, and Views

📊 Why It's Worth Using Delta Format

🛠️ Shortcuts for Optimizing Your Spark Workflows

🗄️ How to Leverage External Tables for Better Data Management

✅ PS. Demos starts from 08:28! :)

🎙 Meet the Speakers:

👤 Guest from Product Group: Daniel Coelho, Principal Product Manager
Linkedin: https://www.linkedin.com/in/danibunny/

👤 Host: Estera Kot: Senior Product Manager at Microsoft
LinkedIn: https://www.linkedin.com/in/esterakot/
Twitter: https://twitter.com/estera_kot