AWS Data Engineer

03 Jul 2024

Vacancy expired!

We are looking for

AWS Data Engineer for our client in

Branchburg, NJ

Job Title: AWS Data Engineer

Job Location: Branchburg, NJ

Job Type: Contract

Job Description:
  • Certified AWS Data Engineer with minimum 5 years’ experience.
  • Experience using StreamSets, s3 data lake processes.
  • Athena queries.
  • SQL & No-SQL queries.
  • Data curation and transformation using collector and transformer processes.
  • Develop and support ETL pipelines using Python & Pyspark with robust monitoring and alarming.
  • Develop data models that are optimized for business understand-ability and usability.
  • Develop and optimize divisional data lake using best practices for partitioning, compression, parallelization, etc.
  • Develop and maintain metadata, data catalog, and documentation for internal business customers.
  • Help internal business customers troubleshoot and optimize SQL and ETL solutions to solve reporting problems.
  • 9+ years of Datawarehouse Experience with Oracle/Teradata /Redshift.
  • Extensive experience working with AWS cloud services like s3,Glue,RDS,Lambda,Redshift,DynamoDB,API gateway, SNS, SQL.
  • Any prior experience on MAtillion Redshift ETL is good to have.
  • Excellent communication must.
  • Extensive hands on experience working on Apache Airflow.

Primary Skills:
  • Big Data.
  • AWS cloud ( StreamSets, S3, Glue, RDS, Lambda, Redshift, DynamoDB, API gateway, SNS, SQL ).
  • ETL.
  • Python.
  • Pyspark.
  • SQL, Oracle, Teradata, Redshift.
  • Jira.
  • DevOps.

  • ID: #43796656
  • State: New Jersey Branchburg 08853 Branchburg USA
  • City: Branchburg
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2022-07-03
  • Deadline: 2022-08-30
  • Category: Et cetera