Data Engineer

03 Dec 2024

Vacancy expired!

Job Description:Join a diverse team dedicated to providing best in class data services to our customers, stakeholders and partners. You will work with ML Engineers, Data Scientist and various Business units to define solutions for operationalizing data-driven decision making in a cost effective and scalable manner. Qualifications:

  • Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience.
  • Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises.
  • Programming experience with Python, Shell scripting and SQL.
  • Solid experience of AWS services such as CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS and SM etc.
  • Solid experience implementing solutions on AWS based data lakes.
  • Experience in AWS data lake/data warehouse/business analytics.
  • Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS.
  • Knowledge of ETL/ELT.
  • End-to-end data solutions (ingest, storage, integration, processing, access) on AWS.
  • Architect and implement CI/CD strategy for EDP.
  • Implement high velocity streaming solutions using Amazon Kinesis, SQS, and Kafka (preferred).
  • Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift.
  • Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift.
  • Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case.
  • AWS Solutions Architect or AWS Developer Certification preferred.
Requirements:
  • 5+ years of experience as Data engineer
  • Experience developing business applications using SQL databases.
  • Experience working Cloud (AWS preferred)
  • Should have good experience with AWS Services - S3, Athena, Glue, Lambda, Step Functions, SQS and Redshift.
  • Plus to have knowledge on Snowflake.
Responsibilities:
  • Designing, building and maintaining efficient, reusable, and reliable architecture and code.
  • Build reliable and robust Data ingestion pipelines (within AWS, onprem to AWS, etc).
  • Ensure the best possible performance and quality of high scale data engineering project.
  • Participate in the architecture and system design discussions.
  • Independently perform hands on development and unit testing of the applications.
  • Collaborate with the development team and build individual components into complex enterprise web systems.
  • Work in a team environment with product, production operation, QE/QA and cross functional teams to deliver a project throughout the whole software development cycle.
  • Responsible to identify and resolve any performance issues.
  • Keep up to date with new technology development and implementation.
  • Participate in code review to make sure standards and best practices are met.
Please submit your resume for consideration. Once submitted, feel free to contact Henry atfor additional information. Approx. Duration: 12 months About Hired by MatrixHired by Matrix, Inc. founded in 1986, is a certified Woman-Owned Business Enterprise (WBE) dedicated to providing the highest quality of job opportunities to our candidates and staffing services to our clients. We are a full-service staffing firm with experience recruiting and delivering for IT, Accounting & Finance, Administrative & Clerical, Clinical & Scientific, and Marketing disciplines. Our long history in the staffing industry and dedication to excellence are the key differentiators that have fueled our success for over 30 years. Hired by Matrix offers our contract professionals competitive salaries, benefits after 60 days and a 401k option with a company match after one year.Equal Opportunity EmployerWBENC CertifiedWOSB CertifiedWe work hard to match our candidates with the right career opportunities. Let us find you a #MatrixMatch so you can reach your career goals! Connect with us on LinkedIn and see how we can impact your career! Hired by Matrix Career Center: https://www.hiredbymatrix.com/find-work/open-positions/

  • ID: #23782713
  • State: New Jersey Newark 07102 Newark USA
  • City: Newark
  • Salary: BASED ON EXPERIENCE
  • Job type: Contract
  • Showed: 2021-12-03
  • Deadline: 2022-01-31
  • Category: Et cetera