Dr. Estera Kot

Fabric Apache Spark Autotune and Run Series Job Analysis in Monitoring Hub

Episode 60 of Fabric Espresso, hosted by Dr. Estera Kot.

Video thumbnail for Fabric Apache Spark Autotune and Run Series Job Analysis in Monitoring Hub. Opens the video on YouTube.

Length 17:51. Published Jul 2, 2024 on the Azure Synapse Analytics YouTube channel. Topic: Spark and Data Engineering.

Watch on YouTube

About this episode

Text from the YouTube description.

In this episode of Fabric Espresso, we delve into two features: Apache Spark Autotune and Run Series Job Analysis. Estera Kot, along with guest Jenny Jiang, Principal Product Manager at Fabric Data Engineering, unpack the use cases, scenarios, and demos of these features.

Autotune: https://learn.microsoft.com/en-us/fabric/data-engineering/autotune?tabs=sparksql

Blog post: https://blog.fabric.microsoft.com/en-us/blog/fabric-spark-autotune-and-run-series-job-analysis-public-preview?ft=All

🎙 Meet the Speakers:

👤 Guest Expert: Jenny Jiang, Principal Product Manager | Fabric Data Engineering

LinkedIn: https://www.linkedin.com/in/jenny-jiang-8b57036/

👤 Host: Estera Kot, PhD, Principal Product Manager at Microsoft.

LinkedIn: https://www.linkedin.com/in/esterakot/

Twitter: https://twitter.com/estera_kot

👍 Liked this video? Don't forget to hit the 'Like' button and share it with your peers!

Chapters

  1. 0:00 Run series job analysis
  2. 3:34 Understanding autotune
  3. 7:23 Monitoring and demo
  4. 9:12 Autotune in action
  5. 12:38 Machine learning insights
  6. 15:20 Future plans and wrap up

All Fabric Espresso episodes