Senior Big Data Engineer

As a Senior Big Data Engineer, you will be responsible for building new data solutions for our rapidly expanding customer base and working with the top data ingestion technologies, working with a team of amazing, diverse-minded, and bright people who make an impact, generate creative & innovative ideas, and take on new perspectives.ResponsibilitiesBe responsible for Data flow stages from definition to architecture, including Data acquisition, Data set acceptance criteria, and Data Science integration. Architecture designing and customizing technological solutions for large-scale data processing. Develop and deploy real-time and batch data processing infrastructures and pipelines. Take responsibility to explore technologies to scale up the Data ecosystem to handle rapid Big Data growth. Work closely with the Data Science team to embed ML / AI algorithms into the product.Work with cloud, DevOps, application, and client teams to make sure your solution is solving significant business problems in a robust, scalable manner. Use cutting-edge technologies: Python, Airflow, Java, Kubernetes, Spark, Scala, and Kafka.