Vacancy expired!
Job Title : Senior AWS Data EngineerLocation : New York ,NYDuration : 12+ Months
Job Description:-As a key contributor to the data engineering team, the candidate is expected to:Participate in the design and development of ODH’s data platform, which serves several lines of business within the Otsuka enterprise Design and build data ingestion and transformation subsystems, managing technical debt and risk, promoting best practices, and supporting others on the teamCollaborate with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies Work closely with product teams to deliver data products in a collaborative and agile environmentPerform data analysis and onboarding activities as new data sources are added to the platformEvaluate innovative technologies and tools while establishing standard design patterns and best practices for the team Qualifications:Required:Experience in data processing and building Data Lake using AWS technologies such as S3, EKS, ECS, AWS Glue, AWS Firehose, AWS EMR, Lamda, AWS DataBrew, Relational Database Service (RDS), AWS Transfer FamilyExperience in designing and developing Data Pipelines for Data Ingestion or Transformation using AWS technologiesExperience with Python, SQL and Shell ScriptingExperience in Spark programming (Pyspark or Scala)Experience in data modeling and building data pipeline architecturesExperience and knowledge with Master Data Management, Data Quality, Metadata Management, data profiling, micro-batches and streaming data loadsApplied knowledge of working in agile, scrum, or DevOps environments and teamsApplied knowledge of modern software delivery methods like TDD, BDD, CI/CDExperience with development lifecycle (development, testing, documentation and versioning)Preferred:AWS Certified Developer – Associate AWS Certified Big Data – Specialty Gitlab CI/CD- ID: #48964911
- State: New York New york city 10001 New york city USA
- City: New york city
- Salary: Depends on Experience
- Job type: Contract
- Showed: 2023-02-01
- Deadline: 2023-04-01
- Category: Et cetera