Sr. ETL Developer

22 Oct 2024

Vacancy expired!

Work Schedule:
  • Monday through Friday
  • For assignments based at White Plains Headquarters, the workday consist of 7.5-hour paid workday plus a required 0.5-hour unpaid lunch.
  • Paid for time worked only; there are no paid holidays, vacation or sick days.
  • Overtime is not permitted unless authorized in advanced.
  • Contingent Worker is required to badge in and out of the turnstiles located in the lobby for all daily entrances and exits.

HR Engagement Requirements:Candidate required to be local to Tri-State area and in W2 status as employee of Service Provider and within commuting distance. Please list city and state of candidate's residence. Work assignment will be a hybrid of remote and on-site.Candidate that are foreign nationals or hold visas MUST be disclosed at the time of submission. Be mindful that selected candidates must abide by NYPA's Code of Conduct and identify possible potential conflict of interest in a required disclosure form upon onboarding.

Submission Instructions:
  • Your response must contain:
  • The Job Request position number listed in your (email subject header).
  • The labor and billing rate must be clearly stated in the email. If omitted, candidate will not be considered.
  • If a job request is outside the job classification in your Value Agreement, submit your best competitive rates (labor and billing rates) based on local/state-wide labor rates.
  • The hiring team or Human Resources will contact you directly in the event a phone, WebEx, or in person interview is requested.
  • A phone screen, WebEx, or in-person interview does not indicate an acceptance of the proposed labor rate for the candidate submitted.
  • Questions can be directed to:email or call Christine Prendergast (914) 681-6612

Project Overview:The project will replace these 2 legacy systems which have extensive modifications and multiple ongoing issues requiring manual interventions and support. The solution should integrate with SAP and PowerOptix.

The details of the different data integrations that will be enabled over the duration of the project are outlined below.1) Datasets informationa) Capacity Accounting to SAP ERP and BIb) Capacity LoadShift to SAP ERP and BIc) Capacity TrueUp to SAP ERP and BId) Settlements to SAP ERP and BIe) Enhancements to exisitng ETL interfacs

2) Reviewing and confirming data requirements (schema, format, frequency, etc.) for the different data flows3)Provisioning the project on NYPA Enterprise Data Platform4)Initial one-time data profiling of datasets to provide visibility on Data Quality and help identify required Data Quality rules5) Storing the processed data and merging with historical data set6) Enabling a nightly automated process to ingest the data, refresh the tables and create the required output files7) Setting up monitoring jobs using NYPA's monitoring service to send email alerts on any job / validation failures8) Performing testing and UAT activities to validate input and output tables and columns

Job Functions & Responsibilities:Collaborate with all developers and business users to gather required data and execute all ETL programs and scripts on systems and implement all data warehouse activities.Collaborate and perform tests and provide update to all ETL activities within schedule and provide support to all large data volumes and assist in data processing.Documents all technical and system specifications documents for all ETL processes and perform unit tests on all processes and prepare required programs and scripts.Analyze and interpret all complex data on all target systems and analyze and provide resolutions to all data issues and coordinate with data analyst to validate all requirements.Perform tests and validate all data flows and prepare all ETL processes according to business requirements and incorporate all business requirements into all design specifications.Develop all data warehouse models and prepare reports for all meta data integration into systems and draft all ETL scripts and prepare required reports for all end users.Provide support to all ETL schedule and maintain compliance to same and develop and maintain various standards to perform ETL codes and maintain an effective project life cycle on all ETL processes.Document all test procedures for systems and processes and coordinate with business analysts and users to resolve all requirement issues and maintain quality for same.Monitor all business requirements and validate all designs and schedule all ETL processes and prepare documents for all data flow diagrams.

Skills:Pentaho Data Integrator tool (PDI)Python & Java scriptingWrite SQL complex queries and Store ProceduresPySpark languageAzure Blob Storage

Education & Certifications:Bachelor's degree in computer science or equivalent with around 6+ years of experience in ETL Development, Data transformations using Pentaho - must be excellent Pentaho developerExperience in dealing with Data Quality issues.

  • ID: #21510189
  • State: New York Whiteplains 10601 Whiteplains USA
  • City: Whiteplains
  • Salary: USD TBD TBD
  • Job type: Permanent
  • Showed: 2021-10-22
  • Deadline: 2021-12-19
  • Category: Accounting/finance