Hadoop Support Engineer

30 Jan 2025

Vacancy expired!

Riviera is a Global Business and Technology Services firm specializing in the areas of Telecom, Information Security, Data Center Virtualization/Consolidation, and Business Intelligence, Data Warehousing & Analytics. Riviera is committed to its client’s sustainable competitive advantage. The people at Riviera will work with you to develop a customized approach in streamlining client’s business needs in a comprehensive and flexible manner. Riviera offers a competitive compensation package with opportunities for growth and professional development.We are an Equal Opportunity Employer.

Hadoop Support Engineer

Alpharetta, GA

Hybrid 3 days a week onsite

Databricks Operations is part of the Hadoop Support team. This team is responsible for managing the Databricks plant. Working within an Agile delivery (Scrum/Kanban/Scrumban)/ DevOps methodology. Support the application development teams and help them in debugging and fixing an issue.

Responsibilities and activities of these team include, but not limited to- Build, Upgrade and maintain Hadoop clusters with several nodes.- Monitoring and troubleshooting of services running on Hadoop clusters.- Performance tuning.- Setup of backup and recovery.- Troubleshooting User issues which include User on boarding, job failures.- Installing and integrating of a new services onto the Hadoop cluster.- Working with Vendor to discuss/apply issue bugs, patches and issues.- Deploy and automate the implementations/fixes using Ansible scripts.- Hands-on experience on the administration side of DataBricks preferably on Azure.- Prior experience in a support role on admin side of Databricks on one of Azure/AWS/Google Cloud Platform cloud- Excellent knowledge of git and Jenkins. Understanding of distributed systems and databases, cloud computing environments - Azure/Linux(mandatory skills)- General familiarity with Docker and Kubernetes concepts- Hands-on experience in Azure stack (Azure Data Lake, Azure Data Factory, Azure Databricks)- Good understanding of other Azure services like Azure Data Lake Analytics & U-SQL, Azure SQL DW- Demonstrated analytical and problem-solving skills, particularly those that apply to a big data environment.- Working within an Agile delivery (Scrum/Kanban/Scrumban)/ DevOps methodology.- Deploy Azure Databricks workspaces using IaC (terraform + azure devops)

Qualification:- Experience in Cloudera Hadoop distribution CDH 6.x and CDP 7 is preferred.- Experience with Cluster maintenance tasks like adding and removing nodes, enabling High availability, installing services, applying patches.- Unix/Linux knowledge including the ability to understand hardware, Operating system and network settings.- Experience with Hadoop Ecosystem components which include HDFS, YARN, Hive, Impala, Spark, Sqoop, Kafka, Flume and Solr.- Unix Shell, perl or python scripting.- Kerberos and LDAP integration experience.- TLS/SSL certificates knowledge to enable encryption cross Hadoop services.- Some development experience in Databricks on Azure/AWS/Google Cloud Platform- Some developer skills in Python- Some experience with Terraform for IaaC

If you feel you match the above skill set then I would appreciate if you can either email me at or call me atlt;/p> Regards,Gaurang PawarAccounts ManagerRiviera Consulting LLC239 Suite B205, New Road,Parsippany, NJ-07054

(C)lt;/p>(F)&nbsplt;/p>

  • ID: #48922080
  • State: Georgia Alpharetta 30004 Alpharetta USA
  • City: Alpharetta
  • Salary: $50 - $55
  • Job type: Permanent
  • Showed: 2023-01-30
  • Deadline: 2023-03-28
  • Category: Et cetera