Remove 06 implementing-python-to-learn-data-engineering-etl-process
article thumbnail

The Full Stack Data Scientist Part 6: Automation with Airflow

Applied Data Science

This is part of the Full Stack Data Scientist blog series. I’ve written an introductory blog here , and I’d also recommend reading the Practical Introduction to Docker before working with this post’s tutorial. Think of DAGs as your jobs or processes to run, such as scraping a website. What’s Airflow, and why’s it so good?