Task Automation with Python
Automate everyday work with Python: files, documents, subprocesses, logging, command-line arguments, async I/O, and APIs, with optional AI coding agent modules.
Instructor-led data engineering courses on Apache Airflow, Spark, Kafka, Celery, Snowflake, and Python automation for data pipelines.
These courses are for Python developers and data teams who build and run data pipelines. They cover workflow orchestration, distributed processing, and data pipelines with Apache Airflow, Spark, Kafka, Celery, and Snowflake.
For orchestration, developers take Apache Airflow 3 for Developers, and platform teams take Apache Airflow 3 Operations and Administration. Practical Apache Spark for Data Pipelines covers batch and streaming jobs. Distributed Task Processing with Python covers Celery and Kafka.
Data Engineering: Ansible, Airflow, and Snowflake builds pipelines on Snowflake. Python teams can also take Task Automation with Python, Jupyter Widgets Programming, or Generative AI and LLMs for Python Programmers.
10 courses Automate everyday work with Python: files, documents, subprocesses, logging, command-line arguments, async I/O, and APIs, with optional AI coding agent modules. Build distributed task pipelines in Python: Celery with RabbitMQ or Redis, Apache Kafka 4 in KRaft mode, Kafka-to-Celery patterns, and stream processing. Build Apache Airflow 3.4 pipelines in Python: the Task SDK, assets, DAG versioning, dynamic and deferrable tasks, and the KubernetesPodOperator. Run Apache Airflow 3.4 as a platform: executors, Helm on Kubernetes, auth managers, upgrades from Airflow 2, and OpenTelemetry monitoring. Data engineering course on Ansible, Apache Airflow 3, and Snowflake, including Snowpark, Dynamic Tables, dbt Projects on Snowflake, and Cortex AI Functions. Apache Spark 4 and PySpark course for batch and streaming pipelines: Spark Connect, Declarative Pipelines, Real-Time Mode, and tuning on any platform. Jupyter widgets course: build custom widgets with ipywidgets 8 and anywidget, using Python classes and ESM front ends for JupyterLab and Notebook 7. A broad generative AI course for Python developers, from transformer basics and prompting to RAG, fine-tuning, agents, evals, and responsible AI. Listed under other topics in the catalog. Machine learning in Python for software developers: pandas, scikit-learn, XGBoost, and PyTorch, from messy data to models served with FastAPI and ONNX. Run machine learning at production scale on a lakehouse with Spark 4, dbt, Airflow 3, Kafka 4, and MLflow 3, from data pipelines to automated retraining.Task Automation with Python
Distributed Task Processing with Python
Apache Airflow 3 for Developers
Apache Airflow 3 Operations and Administration
Data Engineering: Ansible, Airflow, and Snowflake
Practical Apache Spark for Data Pipelines
Jupyter Widgets Programming
Generative AI and LLMs for Python Programmers
More Data Engineering courses
2 coursesAI and Modern Machine Learning for Software Developers
Advanced Machine Learning and Data Engineering
Try a different word or remove a filter. We also build custom courses from our outlines when nothing fits.
Private team training
Pick one course or combine several. We adjust the outline to your tools, stack, and schedule.
Prefer to talk? Call +1 434-509-6890 or email help@cloudcontraptions.com.