Dr. Estera Kot

Getting the most out of the Staging Mechanisms in Dataflows Gen2 Fabric Data Factory

Episode 53 of Fabric Espresso, hosted by Dr. Estera Kot.

Video thumbnail for Getting the most out of the Staging Mechanisms in Dataflows Gen2 Fabric Data Factory. Opens the video on YouTube.

Length 10:58. Published Apr 25, 2024 on the Azure Synapse Analytics YouTube channel. Topic: Data Factory and Dataflows.

Watch on YouTube

About this episode

Text from the YouTube description.

After you've cleaned and prepared your data with Dataflow Gen2, you want to land your data in a destination. You can do this using the data destination capabilities in Dataflow Gen2. With this capability, you can pick from different destinations, like Azure SQL, Fabric Lakehouse, and many more. Dataflow Gen2 then writes your data to the destination, and from there you can use your data for further analysis and reporting.

Join us in this Fabric Espresso episode as Miguel and Estera discuss getting the most out of the Staging Mechanisms in Dataflows Gen2 Fabric Data Factory.

🎙 Meet the Speakers:

👤 Guest Expert: Name: Miguel Escobar. Currently a Senior Program Manager at Microsoft for the product that changed his life: Power Query. Born and raised in Panama City, Panama.

Linkedin: https://www.linkedin.com/in/escobarmiguel90/

Twitter: @EscobarMiguel90

👤 Host: Estera Kot, PhD, Principal Product Manager at Microsoft.

LinkedIn: https://www.linkedin.com/in/esterakot/
Twitter: https://twitter.com/estera_kot

👍 Liked this video? Don't forget to hit the 'Like' button and share it with your peers!

Chapters

  1. 0:00 Introduction
  2. 1:09 What is staging
  3. 2:36 Best practices for staging
  4. 4:14 How does the staging mechanism work
  5. 4:59 How does it impact the data processing speed
  6. 5:28 Common challenges with staging
  7. 7:25 How staging works with structured and unstructured data
  8. 8:29 Question

All Fabric Espresso episodes