Dr. Estera Kot

Microsoft Fabric Data Engineering – Apache Spark Jobs Monitoring

Episode 57 of Fabric Espresso, hosted by Dr. Estera Kot.

Video thumbnail for Microsoft Fabric Data Engineering – Apache Spark Jobs Monitoring. Opens the video on YouTube.

Length 11:11. Published Jun 11, 2024 on the Azure Synapse Analytics YouTube channel. Topic: Spark and Data Engineering.

Watch on YouTube

About this episode

Text from the YouTube description.

In this episode of Fabric Data Engineering, host Estera Kot and guest expert Jenny Jiang, Principal Product Manager at Fabric Data Engineering, dive into the world of Spark Monitoring. They explore the ins and outs of monitoring Spark applications, offering valuable insights and practical advice.

🎙 Meet the Speakers:

👤 Guest Expert: Jenny Jiang, Principal Product Manager | Fabric Data Engineering

LinkedIn: https://www.linkedin.com/in/jenny-jiang-8b57036/

👤 Host: Estera Kot, PhD, Principal Product Manager at Microsoft.

LinkedIn: https://www.linkedin.com/in/esterakot/

Twitter: https://twitter.com/estera_kot

👍 Liked this video? Don't forget to hit the 'Like' button and share it with your peers!

Chapters

  1. 0:00 Introduction to spark
  2. 1:04 Monitoring features
  3. 2:10 Why monitoring is needed
  4. 3:33 Demonstration of tools
  5. 6:29 Notebooks vs jobs
  6. 8:03 Snapshots and debugging
  7. 9:53 Future roadmap and closing

All Fabric Espresso episodes