Data platform Cloud Engineer

The Senior Lead Data Platform Engineer - Cloud provides data management and analytics support to the data platform team and organizes data from a variety of internal and external sources. While establishing operational plans, this job ensures the delivery of scalable data services and drives data consumption via cloud-based technology.

• Leads data platform initiatives through the integration of engineering principles and maintenance of cloud services.
• Reviews data platform requirements, builds scalable and efficient processes, and populates platform data in the cloud.
• Curates large amounts of real-time and relational data and disseminates among the data platform team.
• Utilizes data engineering expertise and enhances the data cloud and team processes.
• Drives the data platform roadmap and defines requirements, timelines, and resources.
• Streamlines operations for the data platform and leads complex integrations with the data engineering team.
• Collaborates with data engineers on platform initiatives and cloud management for optimal business operations.
• Reviews data platform requirements, builds scalable processes, and populates platform data in the cloud.

• University (Degree) Preferred

• 5+ Years Required; 7+ Years Preferred

• Physical Requirements: Sedentary Work

• Proficiency in developing and deploying cloud-based applications using AWS native services. Ability to identify key features of AWS services and use the AWS service APIs, AWS CLI, and SDKs to write Infra-as-Code (IaC) modules.
• Code development & maintain AWS cloud-based production systems, to ensure the availability, performance, scalability, and security.
• Expertise with CI/CD delivery frameworks (e.g Jenkins / CloudBees), infrastructure as code software tools (Terraform, Cloud Formation), configuration management/orchestration tools (e.g. Puppet, Chef, Ansible), and version control methodology (e.g. GIT)
• Possess Coding Skills: API Design, Scala, Python, Database procedural languages and scripting (Java Script, Nod.JS and No-SQL)
• Experience with RDS, EMR/Hadoop, MongoDB and legacy RDBMS databases.
• hybrid role - minimum of 3 days onsite

• AWS Security: Compliance, Cloud Security Architecture, third-party security tools/platforms, encryption/KMS/CloudHSM, IAM policies/roles etc. (Implement Encryption at rest)
• Lambda, API Gateway, Lightweight architectures including JavaScript frameworks (AngularJS/React) and single page web applications
• Exposure to ETL tools such as Talend, DataStage, AWS Glue, DataSync, Apache Airflow

• Work as team player, keen on contributions
• Responsible for development of cloud in-house tools & data services to support operations of Cloud infrastructure, provisioning, monitoring with (IaaS) , (PaaS) and (SaaS) models
• Deploy, automate, maintain, and manage AWS cloud-based production system, to ensure the availability, performance, scalability, and security of productions systems