REMOTE Data Engineer

Apex Systems
Indianapolis, IN
09 Aug 2024

Vacancy expired!

Job#: 1283151

Job Description: Role: Remote Data Engineer

Length: 12 months + extension

Location: 100% Remote

Job Description:

Key Responsibilities:
  • Designs and automates deployment of our distributed system for ingesting and transforming data from various types of sources (relational, event-based, unstructured).
  • Designs and implements framework to continuously monitor and troubleshoot data quality and data integrity issues.
  • Implements data governance processes and methods for managing metadata, access, retention to data for internal and external users.
  • Designs and provide guidance on building reliable, efficient, scalable and quality data pipelines with monitoring and alert mechanisms that combine a variety of sources using ETL/ELT tools or scripting languages.
  • Designs and implements physical data models to define the database structure.
  • Optimizing database performance through efficient indexing and table relationships.
  • Participates in optimizing, testing, and troubleshooting of data pipelines.
  • Designs, develops and operates large scale data storage and processing solutions using different distributed and cloud based platforms for storing data (e.g. Data Lakes, Hadoop, Hbase, Cassandra, MongoDB, Accumulo, DynamoDB, others).
  • Uses innovative and modern tools, techniques and architectures to partially or completely automate the most-common, repeatable and tedious data preparation and integration tasks in order to minimize manual and error-prone processes and improve productivity.
  • Assists with renovating the data management infrastructure to drive automation in data integration and management.
  • Ensures the timeliness and success of critical analytics initiatives by using agile development technologies such as DevOps, Scrum, Kanban Coaches and develops less experienced team members
Skillset:
  • Hands-on Azure Data experience
    • Tools to have: Databricks, Synapse, Data Factory, etc.
  • High functional knowledge of Big Data
  • Hands-on experience automating the ETL process
    • No specific tool is required: Jenkins preferred
  • Scala or PySpark knowledge (Scala preferred)
EEO Employer

Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or .
  • ID: #44722210
  • State: Indiana Indianapolis 46201 Indianapolis USA
  • City: Indianapolis
  • Salary: USD TBD TBD
  • Job type: Permanent
  • Showed: 2022-08-09
  • Deadline: 2022-10-07
  • Category: Et cetera