• Lesson 1: Introduction
  • What's data engineering?
  • What's an orchestrator?
  • Orchestration approaches
  • Why is asset-centric orchestration good for data engineering?
  • Project preview
• Lesson 2: Requirements & installation
  • Requirements
  • Set up local
  • Set up Codespace
  • Project files
• Lesson 3: SDAs
  • Overview
  • What's an asset?
  • Defining your first asset
  • Asset materialization
  • Viewing run details
  • Troubleshooting failed runs
  • Coding practice: Create a taxi_zones_file asset
  • Recap
• Lesson 4: Asset dependencies
  • Overview
  • What's a dependency?
  • Assets and database execution
  • Loading data into a database
  • Practice: Create a taxi_zones asset
  • Assets with in-memory computations
  • Practice: Create a trips_by_week asset
• Lesson 5: Definitions & code locations
  • Overview
  • What's the Definitions object?
  • What's a code location?
  • Code locations in the Dagster UI
• Lesson 6: Resources
  • Overview
  • What's a resource?
  • Setting up a database resource
  • Using resources in assets
  • Practice: Refactoring assets to use resources
  • Analyzing resource usage using the Dagster UI
  • Lesson recap
• Lesson 7: Schedules
  • Overview
  • What are schedules?
  • Practice: Create a weekly_update_job
  • Creating a schedule
  • Practice: Create a weekly_update_schedule
  • Updating the Definitions object
  • Jobs and schedules in the Dagster UI
• Lesson 8: Partitions and backfills
  • Overview
  • What are partitions and backfills?
  • Creating a partition
  • Practice: Create a weekly partition
  • Adding partitions to assets
  • Practice: Partition the taxi_trips asset
  • Creating a schedule with a date-based partition
  • Practice: Partition the trips_by_week asset
  • Partitions and backfills in the Dagster UI
  • Recap
• Lesson 9: Sensors
  • Overview
  • What's a sensor?
  • Configuring asset creation
  • Creating an asset triggered by a sensor
  • Creating a job
  • Building the sensor
  • Updating the Definitions object
  • Sensors in the Dagster UI
  • Enabling the sensor
• Capstone
• Extra credit: Metadata
  • Overview
  • What's metadata?
  • Definition metadata - Asset descriptions
  • Definition metadata - Asset groups
  • Practice: Grouping assets
  • Materialization metadata
  • Practice: Add metadata to taxi_zones_file
  • Asset metadata as Markdown