Data Engineer

21 Feb 2025

Vacancy expired!

Job Description:

Primary Duties / Responsibilities:
  • Develop and operate data management tools, monitoring data flows, data quality, data cleansing and data processing
  • Create and document logical data integration (ETL) strategies for data flows between disparate systems and the enterprise data warehouse/data lakes.
  • Collaborate with different stakeholders (engineers, data owners) to collect required data from internal and external systems
  • Work in an Agile environment that focuses on collaboration and teamwork.
  • Improve and extend existing data infrastructure services
  • Monitor production job schedule and correct job failures in a timely manner

Qualifications:

Education / Experience / Background:
  • MS degree in Computer Science or computer related field from an accredited institution.
  • 3+ years hands proven experience as a Data Engineer or similar role.on

Knowledge / Skills / Abilities:
  • More than 2 years of experience developing with Python.
  • 2+ years performing with production environments in a DevOps culture managing code composed of multi-developer teams, following industry best practices.
  • 2+ years SQL development experience.
  • Experience with data modeling
  • 2+ years bash scripting experience.
  • Strong experience with Git, CI/CD (preferably GitLab) and Docker.
  • Experience deploying and running services in Cloud Big Data platforms such as BigQuery and Snowflake.
  • Experience designing and building data pipelines using tools like Apache Beam, CDAP (Data fusion).
  • Knowledge with CDC design patterns and their challenges.
  • Experience with DAG workflows orchestration such as Apache Airflow.
  • Experience with NoSQL databases is a plus (i.e Firestore, MongoDB).
  • Experience designing and developing APIs is a plus (i.e using FastAPI, Flask)
  • Embrace mentorship through design sessions, code reviews, and community building
  • Take ownership and support solutions you develop
  • Value collaboration with other members of the team
  • Have a product mindset
  • Good communication

  • ID: #49330872
  • State: New Jersey Paramus 07652 Paramus USA
  • City: Paramus
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2023-02-21
  • Deadline: 2023-04-02
  • Category: Et cetera