Vacancy expired!
Resp & Qualifications
PURPOSE:The Senior Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud OR on-premise infrastructure targeting big data and platform data management (Relational and NoSQL, distributed and converged) with emphasis on reliability, automation and performance. This role will focus on developing solutions uning Ab Initio and helping transform the company's platforms deliver data-driven, meaningful insights and value to company.ESSENTIAL FUNCTIONS:- Develops and maintains infrastructure systems (e.g., data warehouses, data lakes) including batch and real time ETLs. Prepares and manipulates data using Ab Initio.Evaluating alternative methods including planning and execution of ETLs; applying ETLstandards, guidelines, conventions, and procedures.
- Creates data collection frameworks for structured and unstructured data.
- Improves data delivery engineering job knowledge by attending educational workshops; reviewing professional publications; establishing personal networks; benchmarking state-of-the-art practices; participating in professional societies.
- Applies data extraction, transformation and loading techniques in order to connect large data sets from a variety of sources usind Ab Initio.
- Applies and implements best practices for data auditing, scalability, reliability and application performance using Ab Initio in Clouder CDP.
- 5 years Experience with database design and developing modeling tools.
- Experience developing and updating ETL/ELT scripts using Ab Initio in Cloudera CDP.
- Hands-on experience with application development, relational database layout, development, data modeling.
- Knowledge and understanding of Ab Initio and Cloudera CDP.
- Knowledge and understanding of at least one programming language (i.e., SQL, NoSQL, Python).
- Knowledge and understanding of database design and implementation concepts in DB2.
- Knowledge and understanding of data exchange formats XML, Json.
- Knowledge and understanding of data movement concepts.
- Strong technical and analytical and problem solving skills to troubleshoot to solve a variety of problems.
- Requires strong organizational and communication skills, written and verbal, with the ability to handle multiple priorities.
- Must be able to meet established deadlines and handle multiple customer service demands from internal and external customers, within set expectations for service excellence. Must be able to effectively communicate and provide positive customer service to every internal and external customer, including customers who may be demanding or otherwise challenging.