Bigdata developer

19 Feb 2025

Vacancy expired!

Position: Bigdata developerLocation:

Illinois City, IL or Dallas, TX or Chicago, IL (Onsite)

Duration:

Full Time

Job Qualifications / Requirements:

Roles & Responsibilities

:

Data Lake implementation, off-boarding of data from existing
  • Hands-on experience in Scala/Big Data technologies (Spark/Flink, Hive, Oozie, Hbase/Cassandra/MongoDB, Redis, YARN, Kafka)
  • Experience with Java/Scala programming language
  • Experience with shell scripting
  • Experience with ETL job design using Nifi/Streamsets/Talend/Pentaho/etc.
  • Working experience on multiple Hadoop/Spark based projects which have been deployed on Production.
  • Knowledge of Lambda/Kappa architectures
  • Experience on performance tuning of Hive and Spark jobs
  • Basic experience in data modelling for Hive and NoSQL (partitioning, bucketing, row key design, etc.)
  • Experience in debugging/troubleshooting Hadoop and Spark jobs
  • Maven build
  • Deployment of Hadoop/Spark jobs on production

  • ID: #49296537
  • State: Texas Dallas / fort worth 75202 Dallas / fort worth USA
  • City: Dallas / fort worth
  • Salary: $80,000 - $100,000
  • Job type: Permanent
  • Showed: 2023-02-19
  • Deadline: 2023-04-01
  • Category: Et cetera