A senior data engineer for technology media firm

A technology media firm is looking for a senior data engineer. You will work in a technology-driven environment on our data systems. You will use the combination of Java and functional programming. We use Java 8, Scala, and its binded by Akka. We work on a lot of data streaming and with opensource technologies, using Kafka. We use Spark for Big Data, Kubernetes for optimization and automation, do virtualization with Docker, NoSQL for our databases, AWS for cloud services, Azkaban for scheduler, Airflow for data pipelines. All of that experience would be quite helpful for us.We are looking for a strong FDLC technologist, with solid OO skills, passion for learning and technology experimentation, and a data-driven mindset. We have a 24x7 low latency data-heavy wide-ranging distributed systems, utilize containerization, host in the cloud, and are heavy on automation and integration. An aggregation pipelines background is quite valuable for this role. DevOps (CI/CD, etc.) proficiency is also needed. You will analyze and solve complex challenges, work with business and technology goals in mind, and interact with all aspects of our services. From development to maintenance, this role’s responsibilities will always present an interesting encounter. This role will offer a lot of professional growth and opportunities for learning. Full benefits, great comp details, and our industry leader status all will contribute to your well-being here.