Vacancy expired!
- Partner with our users and other data product teams to understand their needs and build impactful data/analytics solutions.
- You will design and build data pipelines to support applications and data science projects following software engineering best practices.
- Design and develop data applications using big data technologies (Hadoop, AWS) to ingest, process, and analyse large disparate datasets.
- Build robust data pipelines on Cloud using Airflow, Spark/EMR, Kinesis, Kafka, Lambda, or other technologies.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from various data sources using SQL and AWS 'big data' technologies.
- Experience delivering Data migration projects in AWS (preferably) but other cloud solutions will work too
- SQL / ETL experience and understanding
- Hadoop
- Some ELT tools - Informatica, Airflow, AWS Glue, etc
- Must have experience writing core data transformations in Python.
- ID: #49573051
- State: New York New york city 10008 New york city USA
- City: New york city
- Salary: $200000.00 - $200000 per annum
- Job type: Permanent
- Showed: 2023-03-28
- Deadline: 2023-05-26
- Category: Architect/engineer/CAD