Vacancy expired!
- Develop and operate data management tools, monitoring data flows, data quality, data cleansing and data processing
- Create and document logical data integration (ETL) strategies for data flows between disparate systems and the enterprise data warehouse/data lakes.
- Collaborate with different stakeholders (engineers, data owners) to collect required data from internal and external systems
- Work in an Agile environment that focuses on collaboration and teamwork.
- Improve and extend existing data infrastructure services
- Monitor production job schedule and correct job failures in a timely manner
- MS degree in Computer Science or computer related field from an accredited institution.
- 3+ years hands proven experience as a Data Engineer or similar role.on
- More than 2 years of experience developing with Python.
- 2+ years performing with production environments in a DevOps culture managing code composed of multi-developer teams, following industry best practices.
- 2+ years SQL development experience.
- Experience with data modeling
- 2+ years bash scripting experience.
- Strong experience with Git, CI/CD (preferably GitLab) and Docker.
- Experience deploying and running services in Cloud Big Data platforms such as BigQuery and Snowflake.
- Experience designing and building data pipelines using tools like Apache Beam, CDAP (Data fusion).
- Knowledge with CDC design patterns and their challenges.
- Experience with DAG workflows orchestration such as Apache Airflow.
- Experience with NoSQL databases is a plus (i.e Firestore, MongoDB).
- Experience designing and developing APIs is a plus (i.e using FastAPI, Flask)
- Embrace mentorship through design sessions, code reviews, and community building
- Take ownership and support solutions you develop
- Value collaboration with other members of the team
- Have a product mindset
- Good communication
- ID: #49330872
- State: New Jersey Paramus 07652 Paramus USA
- City: Paramus
- Salary: Depends on Experience
- Job type: Contract
- Showed: 2023-02-21
- Deadline: 2023-04-02
- Category: Et cetera