Data Engineer (Python OR Spark)

28 Jul 2024

Vacancy expired!

Job responsibilities include, but not limited to:• Analyze and review Business requirement and Functional requirement documentation. Convert User requirements into formal technical specifications and design documents.• Provide full lifecycle support to projects from initial business interaction and requirements analysis through design, coding, testing, debugging, implementation and provide ongoing application support and troubleshooting.• Design, develop and deploy business rules and requirements using Python, Spark for data analysis.• Develop scripts using Python, Spark and Airflow for data transformation.Preferred qualifications 2+ years of Python or Spark development experiences Good experience with apache airflow Good understanding of relational, multi-dimensional and NoSQL database design Familiar with AWS environment Good understanding of Databricks is a plusRequired skill sets: Strong Python/Spark Apache airflow PL/SQL Databricks SQL

  • ID: #44434555
  • State: Texas Houston 77001 Houston USA
  • City: Houston
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2022-07-28
  • Deadline: 2022-09-23
  • Category: Et cetera