Lead Data Platform Engineer

We are looking for a passionate and highly motivated Lead Data Platform Engineer. The primary responsibility of this role is to future technology strategy and implementation of tools and platforms. The person in this role will combine software engineering, big data technologies, and systems engineering skills and experience to build, optimize and improve our continuously evolving data platforms. As Lead Data Engineer, you will build frameworks to support and enhance our data platforms and data pipelines and workflows. Responsibilities:

• Implementation of holistic measurable solutions to build data systems architectures, data pipelines, applications, and workflows
• Leverage AWS (Amazon Web Services) cloud data services and vendor products to optimize our data pipeline orchestration, data lake security and governance
• Measurable improvement of reliability, quality, process and cost optimization across the data platforms and applications
• Responsible for System Architecture, Release and change management practices, monitoring engineering, tactical practitioner with 50% Ops and 50% engineering

• Experience in Apache Sparks, Python, Databricks, Apache Airflow, and AWS data and compute services.
• UNIX/Linux administration, troubleshooting, performance tuning & security
• Experience and technical knowledge of distributed systems and Big Data Technologies
• Understanding of observability principles (monitoring, logging, tracing, alerting), tools and practices that promote observability
• Ability to program (structured and OO) with one or more high level languages, such as Python, Java, Go, C/C
• Skilled in Cloud/PaaS/SaaS Environments (e.g., AWS, Azure, Google Cloud Compute)
• Experience with continuous integration tools (e.g., GitLab, AWS Code Build, Code Deploy, Code Pipeline, Azure DevOps) (3 years)
• Experience deploying AWS Infrastructure with Cloud Formation and/or Terraform
• Configuration management and orchestration (e.g., Terraform, Cloud Formation, Ansible, Chef)
• Experience with container technologies (i.e., Docker, Kubernetes)
• A proactive approach to spotting problems, areas for improvement, and performance bottlenecks

• 5+ years in data engineering platforms and practices
• 3+ years of experience in designing and implementing highly available distributed systems
• 2+ years in AWS cloud technology and data services with big data platforms
• Familiarity with data security and privacy regulations
• Excellent verbal and written communication. Compelling storytelling and presentation skills
• A team player with vision, passion, discipline and integrity
• Ability to work rapidly and efficiently in a fast paced and changing environment
• 2+ years of experience in Incident Management, Change Management, Problem Management best practices

• Bachelor's degree in computer science or related exp

• Participate in OrangePeople monthly team meetings, and participate in team-building efforts.
• Contribute to OrangePeople technical discussions, peer reviews, etc.
• Contribute content and collaborate via the OP-Wiki/Knowledge Base.
• Provide status reports to OP Account Management as requested.