Data Engineer

Estuate Inc.
Allenpark, MI
18 Feb 2025

Vacancy expired!

Estuate is a global Product Engineering and IT Enterprise Services company headquartered in Milpitas, CA, and with offices in New Jersey, Canada, India and the UK. The company specializes in leading edge technology solutions in IOT, AI and Digital Transformation solutions. The focus areas and practices that leverage these technologies are Product Engineering Services, Data & Analytics, Subscription Billing, Revenue Management & Governance, and Risk & ComplianceCurrently, we have an immediate requirement for an

“Junior & Senior Data Engineer ”, per the details given below

Position 1:

Senior Data Engineer (Onsite)

Allen Park, MI

Contract - 12 MonthsThe Senior Data Engineer role is responsible for supporting the Sustainable Finance Disclosure Regulations (SFDR) program, through working with stakeholders including Architects, technical teams, Business and data producers, to understand the target state requirements including upstream and downstream use cases. With the responsibility of building the data platform, be able to conceptualise the design convert the physical architecture. The role is to leverage appropriate industry-reference-architectures and relevant Environmental Social & Governance (ESG) and SFDR assets. As a senior member of the Data Engineer team, be accountable for end-to-end architecture, design and development process, including providing technical and architecture advisory support to the implementation team and the wider client stakeholders.

Key requirements:
  • Strong hands-on experience working in Hadoop Ecosystem, Big data technologies and AWS Cloud and Cloudera
  • Must be hands-on with writing Python or Scala Scripts development
  • Well versed with Spark development (SQL and/or Spark)
  • Hands on experience designing of orchestration using Airflow
  • Hands on experience in AWS Service EC2, S3, SNS, SQS, Lambda, Hue, Presto, Spark , Glue, Kinesis, EMR, ECS, EKS
  • Sound knowledge in Hive, Redshift, AWS RDS, My SQL and in any NoSQL database e.g., Cassandra, MongoDB
  • Experience in architecting and designing batch or real time data streaming
  • Ability to dynamically adapt to conventional big data frameworks and opensource tools if project demands
  • Knowledge of design strategies for developing scalable, resilient, always-on data lake
  • Strong development and automation skills
  • Good understanding in data architecture principles, including data access patterns, data modelling and strong in Data base concepts
  • Previous experience in ESG related reporting in a financial services organization is an advantage

Position 2:

Position: Jr. Data Engineer – (Onsite)

Allen Park, MI

Contract - 12 Months The ‘Jr. Data Engineer’ role is responsible for supporting the Sustainable Financial Disclosure Regulations (SFDR) program, through working with stakeholders including Technical Architects, Senior Data Engineer, business stakeholders, technical teams, and data producers. Working under the direction of Sr. Data Engineer and in reference to the design set forth, focus on development and testing of Data Platform components including data models, pipelines, downstream data consumption integrations and schedule automation.

Key requirements:
  • Strong hands-on experience working in Hadoop Ecosystem , big data technologies and AWS Cloud suit with Cloudera desirable
  • Must be a confident with Python or Scala Scripts development
  • Well versed with Spark development (incl. SQL and Spark)
  • Hands on experience with Airflow for orchestration
  • Hands on experience in AWS Service including EC2, S3, SNS, SQS, Lambda, Hue, Presto, Spark, Glue, Kinesis, EMR, ECS and EKS
  • Sound knowledge in Hive, Redshift, AWS RDS, My SQL and in any NoSQL database e.g. Cassandra, MongoDB
  • Work experience on AWS components
  • Experience in batch or real time data streaming
  • Ability to dynamically adapt to conventional big data frameworks and opensource tools if project demands
  • Knowledge of design strategies for developing scalable, resilient, always-on data lake
  • Strong development/automation skills
  • Good understanding in data architecture principles, including data access patterns, data modelling and strong in Data base concepts
  • Previous experience in Environmental Social & Governance (ESG) related reporting in a financial services organization is an advantage
ThanksPradeep / Estuate Inc
  • ID: #49273168
  • State: Michigan Allenpark 48101 Allenpark USA
  • City: Allenpark
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2023-02-18
  • Deadline: 2023-04-18
  • Category: Et cetera