Skip to content

A curated list of dagster code snippets for data engineers

Notifications You must be signed in to change notification settings

ssp-data/awesome-dagster

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 

Repository files navigation

Awesome Dagster

Please visit the offical awesome-dagster repo by dagster. I moved the relevant content over there.

A curated list of dagster code snippets for data engineers Awesome

List of content

  1. Resources
  2. Solids
  3. Hooks
  4. Types
  5. Docker Images

Resources

  • Data Warehouse
    • Apache Druid Connector resource to send GET/POST REST-Requests
  • Relational
    • MySQL Instantiate a connection to a MySQL database and run queries
  • Monitoring
    • HealthcheckIO Send updates to Cron job monitoring HealthcheckIO

Solids

  • Spark & Delta-Lake
    • Spark and Delta Lake Solids to create Delta-Table create_delta_table, load data from a Delta-Table into a Spark-df create_delta_table
  • Scrapting

Hooks

Types

  • JsonType A valid representation of a JSON, validated with json.loads()

Docker Images

Community

Forums

Podcasts

Slides

Inspired by the Awesome list of Data Engineering by Igor Barinov.

License

CC0

To the extent possible under law, Simon Späti has waived all copyright and related or neighboring rights to this work.

About

A curated list of dagster code snippets for data engineers

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published