Talk Python to Me is a weekly podcast hosted by developer and entrepreneur Michael Kennedy. We dive deep into the popular packages and software developers, data scientists, and incredible hobbyists doing amazing things with Python. If you're new to Python, you'll quickly learn the ins and outs of the community by hearing from the leaders. And if you've been Pythoning for years, you'll learn about your favorite packages and the hot new ones coming out of open source.
#330: Apache Airflow Open-Source Workflow with Python
August 20, 2021
01:07:50
38.67 MB
Downloads: 0
If you are working with data pipelines, you definitely need to give Apache Airflow a look. This pure-Python workflow framework is one of the most popular and capable out there. You create your workflows by writing Python code using clever language operators and then you can monitor them and even debug them visually once they get started.
Stop writing manual code or cron-job based code to create data pipelines check out Airflow. We're joined by three excellent guests from the Airflow community: Jarek Potiuk, Kaxil Naik, and Leah Cole.
Links from the show
Jarek Potiuk: linkedin.com
Kaxil Naik: @kaxil
Leah Cole: @leahecole
Airflow site: airflow.apache.org
Airflow on GitHub: github.com
Airflow community: airflow.apache.org
UI: github.com
Helm Chart for Apache Airflow: airflow.apache.org
Airflow Summit: airflowsummit.org
Astronomer: astronomer.io
Astronomer Registry (Easy to search for official and community Providers): registry.astronomer.io
REST API: airflow.apache.org
Contributing: github.com
Airflow Loves Kubernetes talk: airflowsummit.org
Watch this episode on YouTube: youtube.com
Episode transcripts: talkpython.fm
---------- Stay in touch with us ----------
Subscribe on YouTube (for live streams): youtube.com
Follow Talk Python on Twitter: @talkpython
Follow Michael on Twitter: @mkennedy
Sponsors
Talk Python Training
AssemblyAI
Stop writing manual code or cron-job based code to create data pipelines check out Airflow. We're joined by three excellent guests from the Airflow community: Jarek Potiuk, Kaxil Naik, and Leah Cole.
Links from the show
Jarek Potiuk: linkedin.com
Kaxil Naik: @kaxil
Leah Cole: @leahecole
Airflow site: airflow.apache.org
Airflow on GitHub: github.com
Airflow community: airflow.apache.org
UI: github.com
Helm Chart for Apache Airflow: airflow.apache.org
Airflow Summit: airflowsummit.org
Astronomer: astronomer.io
Astronomer Registry (Easy to search for official and community Providers): registry.astronomer.io
REST API: airflow.apache.org
Contributing: github.com
Airflow Loves Kubernetes talk: airflowsummit.org
Watch this episode on YouTube: youtube.com
Episode transcripts: talkpython.fm
---------- Stay in touch with us ----------
Subscribe on YouTube (for live streams): youtube.com
Follow Talk Python on Twitter: @talkpython
Follow Michael on Twitter: @mkennedy
Sponsors
Talk Python Training
AssemblyAI