Vacancy expired!
We are lookin for a Senior Big Data Engineer with hands on experience in Spark and Kafka, proficiency in Java as well as Spring boot microservices frame work.  Valassis Digital (a division of Vericast) is seeking a highly motivated Engineer to develop services, tools, bots, and workflows for our big data processing infrastructure.The Big Data Platform Team owns and operates the world-class big data processing infrastructure that over a dozen engineering teams use to power their 24/7 technical marketing products. We own and operate a large hadoop+spark processing cloud on which we store 6PB of data, and run 30 thousand jobs every day. We write a fabric of java microservices and bots to manage all those jobs, extend hadoop's functionality, and help us operate and optimize our investment. We write custom data streaming services that ingest and curate 100TB of data each day that drives the entire advertising data ecosystem. We also participate in all our users' groundbreaking workflow projects so that we can constantly stay abreast of our developer's tooling needs.What you're like:This position is perfect for a far-sighted engineer who always wants to be the first to apply cutting-edge technologies to solve complex business and engineering problems. You work throughout the software lifecycle including requirements analysis, development, testing and operations. If you are energized by the thought of developing new system stacks and tools for big data processing and analytics we want to talk to you. If you have worked on big data engineering, cloud migration, or infrastructure tooling projects, we want to talk to you. If you have ever worked on a collection of data workflows and though 'I could make this better' we want to talk to you!What you'll do:Design, develop, and maintain the software and systems that make up the data platform that runs our entire businessParticipate in multi-disciplinary projects with our applications and analytics teamsPartner with the Data Science and Engineering teams who use our platform to by diagnosing, predicting and correcting scaling problemsContribute to our team’s growing set of development platforms, tools, and processes