How-to Guides¶
Setting up the sandbox in the Quick Start section was easy; building a production-grade environment requires a bit more work!
These how-to guides will step you through common tasks in using and configuring an Airflow environment.
- Using the CLI
- Set Up Bash/Zsh Completion
- Creating a Connection
- Exporting DAG structure as an image
- Display dag structure
- Formatting commands output
- Purge history from metadata database
- Export the purged records from the archive tables
- Dropping the archived tables
- Upgrading Airflow
- Downgrading Airflow
- Exporting Connections
- Testing for DAG Import Errors
- Using the REST API
- Add tags to dags and use it for filtering in the UI
- Creating a notifier
- Setting Configuration Options
- Configuring local settings
- Set up a Database Backend
- Using Operators
- Customizing DAG Scheduling with Timetables
- Customize view of Apache from Airflow web UI
- Support for Airflow 2 plugins
- Listener Plugin of Airflow
- Customizing the UI
- Creating a custom Operator
- Creating Custom
@taskDecorators - (Optional) Adding IDE auto-completion support
- Export dynamic environment variables available for operators to use
- Managing Connections
- Managing Variables
- Setup and Teardown
- Running Airflow behind a reverse proxy
- Running Airflow with systemd
- Define an operator extra link
- Email Configuration
- Dynamic DAG Generation
- Running Airflow in Docker
- Before you begin
- Fetching
docker-compose.yaml - Initializing Environment
- Cleaning-up the environment
- Running Airflow
- Accessing the environment
- Cleaning up
- Using custom images
- Special case - adding dependencies via requirements.txt file
- Special case - Adding a custom config file
- Networking
- Debug Airflow inside docker container using PyCharm
- FAQ: Frequently asked questions
- What’s Next?
- Environment variables supported by Docker Compose
- Running Airflow with a self-signed certificate