Data Engineer job vacancy

Vacancy expired!

Job Title:

Data Engineer

Job Location:

Oakland, CA

Job Type:

Full Time / Perm / Direct Hire

Job Description:

Pay Range $

98,000 - $122,000

Responsibilities:

Enhance and maintain our current data pipelines and associated infrastructure.
Assemble large, moderately complex data sets that meet functional / non-functional business requirements.
Engage with different stakeholder teams to troubleshoot various database systems.
Build and maintain tools that monitor data and system health.
Identify, design, and implement internal process improvements to optimize production of results and enable cost savings.
Performance tune and optimize data pipeline on Spark.
Create and maintain documentation describing data catalog and data objects.

Minimum Requirements:

Bachelor’s degree in computer science, an engineering field, or equivalent work experience in an engineering field.
3 years of experience with data engineering/ETL ecosystem, such as Palantir Foundry, Spark, Informatica, SAP BODS, OBIEE.

Required Skills:

Experience with data engineering/ETL ecosystem, such as Palantir Foundry, Spark, Informatica, SAP BODS, OBIEE.
Database design fundamentals.
Experience with Python, Pandas and APIs.
Knowledge of Time Series data set development.
Demonstrated commitment to teamwork and enabling others.
Proven ability to translate business desires into technical requirements.
Ability to communicate with various stakeholders and leadership.
Ability to break down ambiguous problems.

Desired Skills:

Experience with Scikit Learn, PySpark or equivalent big data processing framework, CI/CD tool.
Experience with an infrastructure as code tool, writing production-level code, writing health checks, unit tests, integration tests, schema validations.
Familiarity with cloud computing security fundamentals.
Experience with the Palantir Foundry platform.
Experience working with data scientists and machine learning engineers.
Familiarity with model deployment.
Front end tools: PowerBi, Tableau.