Data Engineering Courses

Instructor-led data engineering courses on Apache Airflow, Spark, Kafka, Celery, Snowflake, and Python automation for data pipelines.

These courses are for Python developers and data teams who build and run data pipelines. They cover workflow orchestration, distributed processing, and data pipelines with Apache Airflow, Spark, Kafka, Celery, and Snowflake.

For orchestration, developers take Apache Airflow 3 for Developers, and platform teams take Apache Airflow 3 Operations and Administration. Practical Apache Spark for Data Pipelines covers batch and streaming jobs. Distributed Task Processing with Python covers Celery and Kafka.

Data Engineering: Ansible, Airflow, and Snowflake builds pipelines on Snowflake. Python teams can also take Task Automation with Python, Jupyter Widgets Programming, or Generative AI and LLMs for Python Programmers.

10 courses

Task Automation with Python

Automate everyday work with Python: files, documents, subprocesses, logging, command-line arguments, async I/O, and APIs, with optional AI coding agent modules.

Foundation2-3 days · 14 hrsOnline
New

Distributed Task Processing with Python

Build distributed task pipelines in Python: Celery with RabbitMQ or Redis, Apache Kafka 4 in KRaft mode, Kafka-to-Celery patterns, and stream processing.

Intermediate2-3 days · 14-21 hrsOnline or on-site
New

Apache Airflow 3 for Developers

Build Apache Airflow 3.4 pipelines in Python: the Task SDK, assets, DAG versioning, dynamic and deferrable tasks, and the KubernetesPodOperator.

Foundation3-4 days · 21-28 hrsOnline or on-site

Practical Apache Spark for Data Pipelines

Apache Spark 4 and PySpark course for batch and streaming pipelines: Spark Connect, Declarative Pipelines, Real-Time Mode, and tuning on any platform.

Foundation3-5 days · 21 hrsOnline

Jupyter Widgets Programming

Jupyter widgets course: build custom widgets with ipywidgets 8 and anywidget, using Python classes and ESM front ends for JupyterLab and Notebook 7.

Foundation3 days · 21 hrsOnline

More Data Engineering courses

2 courses

Listed under other topics in the catalog.

AI Application EngineeringNew

AI and Modern Machine Learning for Software Developers

Machine learning in Python for software developers: pandas, scikit-learn, XGBoost, and PyTorch, from messy data to models served with FastAPI and ONNX.

Foundation5 days · 35 hrsOnline or on-site
AI Application EngineeringNew

Advanced Machine Learning and Data Engineering

Run machine learning at production scale on a lakehouse with Spark 4, dbt, Airflow 3, Kafka 4, and MLflow 3, from data pipelines to automated retraining.

Advanced5 days · 35 hrsOnline or on-site

Private team training

Train your team on Data Engineering

Pick one course or combine several. We adjust the outline to your tools, stack, and schedule.

  1. Tell us what you needYour tools, stack, team size, and timeline.
  2. We send a proposalA course or program, an outline adjusted to your team, and possible dates.
  3. Your team trains liveOnline or on-site, with courseware for every student.

Prefer to talk? Call +1 434-509-6890 or email help@cloudcontraptions.com.

We reply within 1 business day.