Orchestration Google Professional Data Engineer GCP

Incorporating all of the elements of the data lifecycle into a set of connected and cohesive operations requires some form of orchestration. Orchestration layers are typically used to
It coordinate
- starting tasks
- stopping tasks
- copying files
- providing a dashboard to monitor data processing jobs.
Orchestration workflows can be simple or complex
Supports open-source orchestration tools like Luigi and Airflow
For custom orchestration apps, create an App Engine app.