Data Pipeline Engineer

28 Apr 2024

Vacancy expired!

REMOTE - TX candidates preferred for possible onsite needs

Job Duties/Responsibilities/Functions (including but not limited to)The project involves the ongoing collection of administrative claims and other health-related data from certain payors operating in the state of Texas. Specific deliverables:
  • Provide expert advice on orchestration technology selection,
  • Install/configure prototype environments as needed to support technology selection.
  • Develop guidelines for data pipeline operations, including code build/deploy and monitoring/troubleshooting/recovery.
  • Install/configure development and production environments after technology selection.

MINIMUM EDUCATION:Bachelor's Degree in Statistics, Mathematics, Data Science, Computer Science, Engineering, or a related field preferred; or an equivalent combination of experience and education.

MINIMUM EXPERIENCE:
  • 3 years of experience installing, configuring, and deploying data pipeline solutions using tools like Airflow, Prefect, and Dagster
  • 5 years of experience working with large data sets using SQL, Python, or R, along with Python packages like Pandas, Dask, and PySpark.
  • 3 years of experience with code hosting platforms for version control and collaboration such as GitHub.
  • 3 years of experience with code hosting platforms for version control and collaboration such as GitHub, CI/CD tools (including Jenkins X), and container tools such as Docker, Docker Compose, Kubernetes, and associated tools.

  • ID: #39656710
  • State: Texas Houston 77002 Houston USA
  • City: Houston
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2022-04-28
  • Deadline: 2022-06-26
  • Category: Et cetera