DevOps and Python Engineer

29 Jul 2022

Location: Jersey City, NJ Description: Responsibilities: •Working with Spark, YARN, Hive, MapReduce, Hbase, Object Stores or equivalent large-scale distributed big data systems like Hadoop, EMR etc

•Working with DevOps, CI/CD in the cloud or on-prem using technologies such as Linux automation, Ansible, Spinnaker, Jules pipeline.

•Designing, developing, debugging, and operating scalable, performant, resilient distributed systems that run across thousands of compute nodes.

•Building End to End automation for Data Migration, Hadoop Clusters orchestration, monitoring and deployment.

Required Skills

•4+ minimum experience with python and DEVOPS tools like Ansible, Terraform, Jules etc.

•3+ years of experience big data technologies from public clouds or open source, such as Spark, YARN, Hive, MapReduce, Presto, Airflow, Object Stores

•3+ years of infrastructure DevOps and CI/CD experience using technologies such Jules pipeline, Ansible and Terraform.

•2+ years of experience with security and network in a cloud environment including VPC network, IAM, authentication, authorization, data governance

•2+ years of experience owning and operating a mission-critical service on a distributed system.

•Experience with agile development methodology, DevOps, monitoring-driven on-call and test-driven development

•Experienced with Python and Scripting Languages and well versed in Linux command line tools. Must be able to code in python.


This job and many more are available through The Judge Group. Find us on the web at

  • ID: #44466719
  • State: New Jersey Jerseycity 07097 Jerseycity USA
  • City: Jerseycity
  • Salary: USD TBD TBD
  • Job type: Permanent
  • Showed: 2022-07-29
  • Deadline: 2022-09-26
  • Category: Et cetera