awesome/repos

Topics

data-engineering

16 repositories with 10k+ stars are tagged data-engineering.

Open in the explorer to search, filter and sort all of them.

  1. 1

    Apache Superset is a Data Visualization and Data Exploration Platform

    75.2K+98 7d18.5KPythontoday
  2. 2

    Learn how to develop, deploy and iterate on production-grade ML applications.

    49.8K+44 7d7.8KJupyter Notebook7mo ago
  3. 3

    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

    47.2K+67 7d18.1KPythontoday
  4. 4

    Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. Join the course here ๐Ÿ‘‡๐Ÿผ

    46.3K+126 7d9KJupyter Notebook4d ago
  5. 5

    ๐Ÿ“š Papers & tech blogs by companies sharing their work on data science & machine learning in production.

    30.6K+110 7d4K2y ago
  6. 6

    Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

    29.9K+346 7d3.4KJavatoday
  7. 7

    Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

    24K+32 7d2.6KPython1d ago
  8. 8

    Open-source data movement for ELT pipelines and AI agents โ€” from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

    22.2K+30 7d5.4KPythontoday
  9. 9

    Turns Data and AI algorithms into production-ready web applications in no time.

    19.4K+6 7d2KPython2mo ago
  10. 10
    17K+6 7d3.7KGotoday
  11. 11

    An orchestration platform for the development, production, and observation of data assets.

    16.3K+27 7d2.4KPython1d ago
  12. 12
    15.5K+22 7d2.8KPython3d ago
  13. 13

    Graph-Native Infrastructure for Context and Accountable AI Systems

    14.1K+163 7d1.7KPythontoday
  14. 14

    Roadmap to becoming a data engineer in 2021

    12.8K-1 7d1.3K4y ago
  15. 15
    11.9K+15 7d1.9KPython3d ago
  16. 16

    Incremental engine for long horizon agents ๐ŸŒŸ Star if you like it!

    11.7K+42 7d921Rusttoday