Vacancy expired!
- The Lead Data Engineer will design and implement data solutions that support the organization's strategic business goals. Focuses on database design, performance optimization, and ETL pipeline.
- Redshift design review processes and resolved technical problems.
- Tests, monitors, manage and validate data warehouse activity including data extraction.
- Hands-on experience in writing AWS Glue, EMR, Python, and Spark jobs.
- Participate in design, code, test plans, and dataset implementation performed by other data engineers in support of maintaining data engineering standards.
- Implement automated workflows and routines using workflow scheduling tools to ensure compliance with technical processes and standards.
- Identify, communicate, and mitigate Risks, Assumptions, Issues, and Decisions throughout full lifecycle.
- The candidate must demonstrate proficiency in,
- Experience in Design, build and configure AWS Redshift DWH to meet business process and application requirements.
- At least one/two Redshift design end-to-end implementations with long-term project association.
- Experience in Redshift design review processes and resolved technical problems.
- Experience in query tuning and optimization, designing Sort and Distribution keys.
- Experience in processing design optimal queries to aggregate data and build reports or data feeds for downstream sources.
- Experience in serving Redshift Data to other sources.
- Having strong SQL skills, data types, and AWS ecosystem components.
- Experience working on large-scale, distributed systems
- Exposure to various ETL and Business Intelligence tools
- Solid grounding in Agile methodologies
- Experience with git and other source control systems
- Strong communication and presentation skills
- AWS Cloud certification
- Python, Scala, Spark scripting
- Strong delivery background across the delivery of high-value, business-facing technical projects in major organizations
- ID: #49893676
- State: California Sanfrancisco 94101 Sanfrancisco USA
- City: Sanfrancisco
- Salary: USD70.0/HOURLY - USD75.0/HOURLY
- Job type: Contract
- Showed: 2023-05-09
- Deadline: 2023-07-07
- Category: Et cetera