Data engineer

17 Jun 2024

Vacancy expired!

  • Resolves complex problems spanning across multiple applications to drive improvements across portfolios; projects with significant business implications, participates in planning and priority estimates; executes with limited guidance
  • Reviews the development of integrated business and/or enterprise application solutions to ensure specifications are flexible, scalable, and maintainable and meet architectural standards
  • Drives efficiency when reviewing the design efforts of complex business and enterprise data solutions
  • Supports systems integration testing (SIT) and user acceptance testing (UAT) for large, complex, cross-functional application initiatives by providing insight to testing teams in order to ensure the appropriate depth of test coverage
  • Solves complex cross-functional architecture/design and business problems. Solutions are extensible; works to simplify, optimize, remove bottlenecks, etc.

Data Engineering Responsibilities
  • Contributes and responsible for the designs and development, maintenance, and enhancements of data lake developments / data ingestion solutions across various business domains by working closely with a matrixed data engineering team to deliver data pipelines on on-prem and cloud infrastructure; establishes frameworks and reusable components for repeatable data ingestion processes; proactively identifies opportunities to build data lake ahead of business needs
  • Builds, tests and enhances data curation pipelines integration data from wide variety of sources like DBMS, File systems, APIs and streaming systems for various KPIs and metrics development with high data quality and integrity
  • Supports the development of feature / inputs for the data models in an Agile manner; Hosts Model Via Rest APIs; ensures non-functional requirements such as logging, authentication, error capturing, and concurrency management are accounted for when model hosting
  • Works with Data Science team to understand mathematical models and algorithms; on how Data Engineering can help scale and deploy models; recommends improvements to analytic methods, techniques, standards, policies and procedures; uses expert technical competence to contribute to policy and procedure updates
  • Ensures the definition, design, manipulation and administration of data and systems are secure and in accordance with enterprise governance by staying compliant with industry best practices, enterprise standards, corporate policy and department procedure; ensures compliance with governance and security standards; implements reusable design patterns and processes
  • Maintains the health and monitoring of data engineering capabilities that span analytic functions by accumulating and grouping maintenance issues; ensures high availability of the platform works with Infrastructure Engineering teams to maintain the data platform; works with management to align maintenance issues with program and project work; triage, accept/reject and assign maintenance issues; serves as an SME of one or more application
  • Coordinates with stakeholders and vendors on data engineering data and product roadmaps that align to business roadmaps.

BI Engineering Responsibilities
  • Contributes and responsible for the designs and development, maintenance, and enhancements of BI solutions across various business domains; provides direction to matrixed BI engineering resources to deliver reports on-prem and cloud infrastructure; creates frameworks and reusable BI components
  • Excels in one or more domains and proactively identifies opportunities to build self-service and complex BI solutions ahead of business needs
  • Demonstrates database skill (Teradata/Oracle/Db2/Hadoop) by writing views for business requirements; uses freeform SQLs and pass-through functions; analyzes and finds errors from SQL generation; creates RSD and dashboard
  • Builds, tests and enhances BI solutions from a wide variety of sources like Teradata, Hive, Hbase, Google Big Query and File systems; develops solutions with optimized data performance and data security
  • Works with business analysts to understand requirements and create dashboard/dossiers wireframes; makes use of widgets and Vitara charts to make the dashboard/dossiers visually appealing for both web and mobile
  • Recommends improvements to BI engineering methods, techniques, standards, policies and procedures by identifying gaps in current execution methods, training and continuous improvement activities, coordinating and facilitating training efforts, and using expert technical competence to contribute to policy and procedure updates
Edit ResponsibilitiesQualificationsTechnical Competencies
  • Application Delivery Process
  • Big Data Management and Analytics
  • Capacity Planning & Management
  • Database Design (Physical)
  • Cloud Computing
Minimum Qualifications:
  • Bachelor's Degree in Engineering /Computer Science, CIS, or related field
  • 7 years of experience in Data or BI Engineering, Data Warehousing/ETL, or Software Engineering
  • 6 years of experience working on project(s) involving the implementation of solutions applying development life cycles (SDLC

  • ID: #43166067
  • State: New York New york city 10001 New york city USA
  • City: New york city
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2022-06-17
  • Deadline: 2022-08-13
  • Category: Et cetera