Assets and data-driven scheduling

An asset (formerly dataset) represents a logical piece of data, identified by a URI, that a DAG produces or consumes. A DAG can be scheduled on the update of one or more assets rather than on the clock: it triggers as soon as its input data is ready, which explicitly links pipelines together.

Example

Asset('s3://lac/ventes.parquet')  # produced by a DAG, triggers the consumer DAGs

Related concepts

The whole glossary