Senior Big Data Developer

02 Nov 2024

Vacancy expired!

Citizenship Requirement: Yes Work Experience: 10+ years' experience building/operating highly available, distributed systems for data extraction, ingestion, and processing of large data sets using Big Data eco-system technologies including Cloudera (CDP), Hadoop, Hive, Impala, Spark, HBase, pySpark, Solr in agile environments Experience with cloud migration to Amazon Web Services (AWS), Google Cloud Platform (Google Cloud Platform), or Microsoft Azure Experience working with big data workflows and building ETL pipelines (NiFi experience preferred) Providing architectural solution design inputs to support Data and Analytics initiatives Strong experience with at Hadoop databases including Hive, Impala and Relational Databases including SQL Server and PostgreSQL Strong background in SQL, Python, Linux, ETL best practices, strong attention-to-detail, and a "can-do" attitude Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, building processes, testing, security, and DevOps Provide recommendations to improve efficiency of Cloudera tools, hardware allocation, and architecting solutions Demonstrated ability to build processes that support data transformation, structures, metadata, accuracy checking, and workload management Strong communication and interpersonal skills with the ability to work alone or as part of a team; must be self-motivated and detail oriented Technical Skills: Cloudera Certified Professional is a plus Experience with Cloudera Hadoop (CDP), Hive, Impala, Spark, HBase, pySpark, Solr Proficiency with modern programming languages including Java, Python, and Scala. Experience with Java RESTful API services and JDBC Linux, GIT, CI/CD, and Azure DevOps Strong troubleshooting and problem-solving skills BS/MS degree in Computer Science, Software Engineering, or related field preferred