Vacancy expired!
Our client, a global financial information and data analytics firm, has an urgent need for a: Data Engineer 100% remote - East Coast Hours Long term contract Job Description: The Data Engineer will be a part of the People Analytics team within the People Organization. The group's mission is to use advanced data analysis techniques to create value across our Global businesses and the People Organization. The Role: The key responsibility of the Data Engineer is to bring structured and unstructured data from across the whole organization within very narrow timeframes for the team of data scientists and analysts to analyze, build models, and design solutions for the different businesses. As such, the Data Engineer will work with Stakeholders, Business Users and Data Scientists to understand the business goals and requirements and translate them into data requirements. They will also work with owners of People technology (e.g. the HR Operations teams, the compensation teams, etc) to understand the current data structures. The engineer will design and build efficient data extraction logic from Operational Data Stores (ODS), Data Warehouse (DWH) systems and unstructured data like employee comments, user comments, etc. Design and build reusable data transformation logic for both structured (RDBMS) and unstructured data like news articles, user comments. They will design, format and store transformed data in a form which is usable by various data science and visualization tools. Experience and Qualifications: • Bachelors degree in engineering or IT • Minimum of 10 years of experience in Data Services, IT or Analysis of large data sets within financial services • Minimum of 5 years of experience in requirements gathering and writing complex SQL, staging tables, ODS, Dimensions, Facts, Star and Snowflake Schemas • At least 3 years of experience in developing Oracle PL/SQL Packages, Stored Procedures and Functions for data manipulation and derivation and in the Implementation of Extraction, Transformation & Loading (ETL) Life Cycle Experience in writing UNIX shell scripts for data file validation, manipulation and scheduling • Ability to design & build S3 buckets, tiers, lifecycle policies, as strategic storage layer; and to setup the Glue crawlers in order to catalog Oracle DB tables and S3 objects • Perform technical assessment across Glue ETL and Lambda functions • Design and Configure the IAM trust policies for interoperability between S3, Redshift , Glue Catalog, Glue ETL, and Lambda functions • Monitor, troubleshoot and debug failures using AWS CloudWatch • Knowledge of Data Profiling and Data Quality concepts and techniques • Ability to work independently and achieve expected results with general level, broad requirements • Strong written & verbal communication The post Data Engineer appeared first on TSR Consulting Services.