Vacancy expired!
- Provide expert advice on orchestration technology selection,
- Install/configure prototype environments as needed to support technology selection.
- Develop guidelines for data pipeline operations, including code build/deploy and monitoring/troubleshooting/recovery.
- Install/configure development and production environments after technology selection.
- 3 years of experience installing, configuring, and deploying data pipeline solutions using tools like Airflow, Prefect, and Dagster
- 5 years of experience working with large data sets using SQL, Python, or R, along with Python packages like Pandas, Dask, and PySpark.
- 3 years of experience with code hosting platforms for version control and collaboration such as GitHub.
- 3 years of experience with code hosting platforms for version control and collaboration such as GitHub, CI/CD tools (including Jenkins X), and container tools such as Docker, Docker Compose, Kubernetes, and associated tools.