Sr. Data Engineer job vacancy

Vacancy expired!

REMOTE TILL MARCH 2022

Must have exp with - PYSPARK, AIRFLOW AND HIVE STACK Job Summary: Looking for a Sr. Data EngineerResponsibilities:

Experience in programming using Python, Java or Scala.
Experience with data orchestration tools (Airflow, Oozie, Step Functions).
Solid understanding of database technologies including NoSQL and SQL.
Track record of delivering reliable data pipelines with solid test infrastructure, CICD, data quality checks, monitoring, and alerting.
Strong organizational and multitasking skills with ability to balance competing priorities.
Excellent communication (verbal and written) and interpersonal skills and an ability to effectively communicate with both business and technical teams.
An ability to work in a fast-paced environment where continuous innovation is occurring, and ambiguity is the norm.

Experience and Qualification:

DESIGN AND EXECUTE DATA PIPELINES USING PYSPARK, AIRFLOW AND HIVE STACK
EXECUTE SOLUTIONS WITH THE LENS OF HIGH AVAILABILITY AND FAULT TOLERANCE
STRING UNDERSTANDING ON THE FOUNDATIONS OF HIVE 3.0 TO BE ABLE TO LEVERAGE EXTERNAL OR
ACID TABLES THAT BEST FIT THE NEEDS