Native execution engine for Apache Spark in Fabric

About this episode

Text from the YouTube description.

Native execution engine for Apache Spark on Fabric is a vectorized engine that optimizes the performance and efficiency of your Spark queries by running them directly on your lakehouse infrastructure. The engine's seamless integration means it requires no code modifications and avoids vendor lock-in.

In this episode of Fabric Espresso, we delve into the product and technical details about the native execution engine. Estera Kot, along with Ankita Christine Victor from Fabric Engineering Product Group unpack the use cases, scenarios, and technical details about the innovation.

Blog: https://blog.fabric.microsoft.com/en-us/blog/public-preview-of-native-execution-engine-for-apache-spark-on-fabric-data-engineering-and-data-science?ft=All

Docs: https://learn.microsoft.com/en-us/fabric/data-engineering/native-execution-engine-overview?tabs=sparksql

🎙 Meet the Speakers:

👤 Guest Expert: Ankita Christine Victor, Software Engineer at Microsoft.

LinkedIn: https://www.linkedin.com/in/ankita-victor/

👤 Host: Estera Kot, PhD, Principal Product Manager at Microsoft.

LinkedIn: https://www.linkedin.com/in/esterakot/

Twitter: https://twitter.com/estera_kot

👍 Liked this video? Don't forget to hit the 'Like' button and share it with your peers!