AWS Data Engineer

09 May 2024

Vacancy expired!

Role and responsibilities
  • The Lead Data Engineer will design and implement data solutions that support the organization's strategic business goals. Focuses on database design, performance optimization, and ETL pipeline.
  • Redshift design review processes and resolved technical problems.
  • Tests, monitors, manage and validate data warehouse activity including data extraction.
  • Hands-on experience in writing

    AWS Glue, EMR, Python, and Spark jobs.
  • Participate in design, code, test plans, and dataset implementation performed by other data engineers in support of maintaining data engineering standards.
  • Implement automated workflows and routines using workflow scheduling tools to ensure compliance with technical processes and standards.
  • Identify, communicate, and mitigate Risks, Assumptions, Issues, and Decisions throughout full lifecycle.

Technical skills requirements
  • The candidate must demonstrate proficiency in,
  • Experience in Design, build and configure

    AWS Redshift DWH to meet business process and application requirements.
  • At least one/two Redshift design end-to-end implementations with long-term project association.
  • Experience in

    Redshift design review processes and resolved technical problems.
  • Experience in query tuning and optimization,

    designing Sort and Distribution keys.
  • Experience in processing design optimal queries to aggregate data and build reports or data feeds for downstream sources.
  • Experience in serving

    Redshift Data to other sources.
  • Having strong

    SQL skills, data types, and AWS ecosystem components.
  • Experience working on large-scale, distributed systems
  • Exposure to various

    ETL and Business Intelligence tools
  • Solid grounding in Agile methodologies
  • Experience with git and other source control systems
  • Strong communication and presentation skills

Nice-to-have skills
  • AWS Cloud certification
  • Python, Scala, Spark scripting
  • Strong delivery background across the delivery of high-value, business-facing technical projects in major organizations

QualificationsB.Tech./M.Tech. or BCA/MCA degree from a reputed university

  • ID: #49893676
  • State: California Sanfrancisco 94101 Sanfrancisco USA
  • City: Sanfrancisco
  • Salary: USD70.0/HOURLY - USD75.0/HOURLY
  • Job type: Contract
  • Showed: 2023-05-09
  • Deadline: 2023-07-07
  • Category: Et cetera