Dr. Estera Kot

Apache Airflow Job in Microsoft Fabric

Episode 75 of Fabric Espresso, hosted by Dr. Estera Kot.

Video thumbnail for Apache Airflow Job in Microsoft Fabric. Opens the video on YouTube.

Length 36:33. Published Oct 23, 2024 on the Azure Synapse Analytics YouTube channel. Topic: Data Factory and Dataflows.

Watch on YouTube

About this episode

Text from the YouTube description.

Apache Airflow job in Microsoft Fabric provides an integrated, cloud-based platform for development, scheduling, and monitoring python-based data workflows, articulated as Directed Acyclic Graphs (DAGs). This innovation delivers a Software-as-a-Service (SaaS) experience for data pipeline development and management using Apache Airflow, making Apache Airflow runtime readily accessible for the development and operationalization of your data workflows.

https://blog.fabric.microsoft.com/blog/introducing-data-workflows-in-microsoft-fabric

🎙 Meet the Speakers:

👤 Guest Expert: Abhishek Narain, Principal Program Manager in Microsoft. Abhishek serves as a Product Manager at Microsoft Fabric's Data Factory. His primary area of focus is Data Factory, a tool that empowers data engineers to construct scalable, robust, and reliable ETLs.

LinkedIn: https://www.linkedin.com/in/narain-abhishek/

Twitter: https://x.com/narainabhishek

👤 Host: Estera Kot, Principal Product Manager at Microsoft.

LinkedIn: https://www.linkedin.com/in/esterakot/
Twitter: https://x.com/estera_kot

👍 Liked this video? Don't forget to hit the 'Like' button and share it with your peers!

Chapters

  1. 0:00 Introduction
  2. 0:33 What are you working on
  3. 1:58 Apache Airflow overview
  4. 4:44 Airflow vs Data Pipelines
  5. 7:23 What is Airflow
  6. 9:23 Data Workflows
  7. 17:23 monitoring
  8. 21:53 pain points
  9. 26:53 Git Sync
  10. 30:41 Pricing
  11. 33:29 Customer Feedback
  12. 34:52 Outro

All Fabric Espresso episodes