Lead BigData / Java Developer

23 Jun 2024

Vacancy expired!

Lead Big Data Developer

Reston VA

Notes from the Manager: Lead level big data developer, who should be hands on Java @ lead capacity

Required Qualifications• Advanced Level experience (7+ years ) withNotes from the Manager: Lead level big data developer, who should be hands on @ lead capacity

Required Qualifications• Advanced Level experience (7+ years ) with Java , Python/Scala programming languages• Advanced Level experience ( 5+ years ) in Hadoop and other related Big Data technologies( HDFS, Spark, Hive)• Experience tuning Hadoop/Spark parameters for optimal performance• Experience with Big Data querying tools including Impala• Advanced experience with SQL and at least one major RDBMS (Oracle, DB2 etc.)• Advanced experience with shell scripting• at least 3+ years of Solution Design and Team lead experience using various Hadoop components• Rigor in high code quality, automated testing, and other engineering best practices, ability to write reusable code componentsPreferred Qualifications• BS/MS in Mathematics, Engineering, or Computer Science• Experience working with large data environments – petabytes or hundreds/thousands of terabytes• Expertise in Kafka/Hbase/SOLR/Cloudera NiFi will be a plus• Past experience with data warehouse/data analytics solutions and technologies, especially ETL tools

Job Duties:• Work with Data Analysts and other team members to review business requirements and translate into technical requirements• Collaborate with application architects and data solution architects• Design and Build Data Integration pipeline using Cloudera Hadoop platform• Guide other team members , resolve technical impediments and ensure code quality and standards• Transform the data to create a consumable data layer for various application uses• Support Data pipeline with bug fixes, and additional enhancements• Document Technical design , Operational Runbook etc, Python/Scala programming languages• Advanced Level experience ( 5+ years ) in Hadoop and other related Big Data technologies( HDFS, Spark, Hive)• Experience tuning Hadoop/Spark parameters for optimal performance• Experience with Big Data querying tools including Impala• Advanced experience with SQL and at least one major RDBMS (Oracle, DB2 etc.)• Advanced experience with shell scripting• at least 3+ years of Solution Design and Team lead experience using various Hadoop components• Rigor in high code quality, automated testing, and other engineering best practices, ability to write reusable code componentsPreferred Qualifications• BS/MS in Mathematics, Engineering, or Computer Science• Experience working with large data environments – petabytes or hundreds/thousands of terabytes• Expertise in Kafka/Hbase/SOLR/Cloudera NiFi will be a plus• Past experience with data warehouse/data analytics solutions and technologies, especially ETL tools

Job Duties:• Work with Data Analysts and other team members to review business requirements and translate into technical requirements• Collaborate with application architects and data solution architects• Design and Build Data Integration pipeline using Cloudera Hadoop platform• Guide other team members , resolve technical impediments and ensure code quality and standards• Transform the data to create a consumable data layer for various application uses• Support Data pipeline with bug fixes, and additional enhancements• Document Technical design , Operational Runbook etcThank you,

  • ID: #43552908
  • State: Virginia Reston 20190 Reston USA
  • City: Reston
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2022-06-23
  • Deadline: 2022-08-16
  • Category: Et cetera