Hadoop Big Data Lead Engineer [Onsite Work]

06 Aug 2024

Vacancy expired!

My client is looking for Hadoop Big Data Lead Engineer for onsite work in Saint Louis, MO Area. Let us connect and discuss the project details if you are open to new job opportunities. Even if you are not looking out for a new gig, still I will appreciate being in touch with you over LinkedIn or in emails. Here are the job details Job Title Hadoop Big Data Lead Engineer Job Location Saint Louis, MO [Onsite Work] Duration 12 Months [Possible Extensions] Job Description

  • Setup all the configurations- Core-Site, HDFS-Site, YARN-Site and Map Red-Site. However, when working with popular Hadoop distribution like Hortonworks, Cloudera or MapR the configuration files are set up on startup and the Hadoop admin need not configure them manually.
  • Responsible for capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster.
  • Responsible for deciding the size of the Hadoop cluster based on the data to be stored in HDFS.
  • Ensures that the Hadoop cluster is up and running all the time.
  • Monitoring the cluster connectivity and performance.
  • Manage and review Hadoop log files.
  • Backup and recovery tasks
  • Resource and security management
  • Troubleshooting application errors and ensuring that they do not occur again.
  • Deploys Hadoop cluster, maintains clusters and manages to add or remove nodes using cluster monitoring (Cloudera Manager) configuring the Name Node high availability and keeping a track of all the running Hadoop jobs.
  • Implement, manage and administer the overall Hadoop infrastructure.
  • Takes care of the day-to-day running of Hadoop clusters
Thank you, Abhay Saini (he/him) +1 (O) +1 (D) Customer Engagements, Droisys | LinkedIn

  • ID: #44645389
  • State: Missouri Saintlouis 63104 Saintlouis USA
  • City: Saintlouis
  • Salary: $Market Standards
  • Job type: Permanent
  • Showed: 2022-08-06
  • Deadline: 2022-10-04
  • Category: Et cetera