The official release of Apache Airflow 3 represents a turning point in the world of dataflow management. For Astronomer, an American company founded in 2018 and counting over 12M downloads per month, this event goes far beyond a simple software update. It embodies the culmination of several years of community work, active listening to market needs and technological innovation - all of which reinforce its position as the undisputed leader in its field.
Apache Airflow is already regarded as the world's leading data management platform, and is used by the giant Walmart in the USA and SG in France.
Apache Airflow version 3.0 introduces a number of game-changing features for data teams. Among the most striking: native management of DAG versioning (a way of organizing and scheduling tasks to be executed in a precise order), support for multiple languages in tasks (beyond Python), the possibility of secure remote execution, and above all, an overhaul of the security model incorporating improved user isolation and greater compatibility with IAM standards (rules and technologies used to control who can access elements of an IT system). All these new features are designed to meet the needs of companies operating in complex, distributed environments subject to stringent compliance requirements.