Vacancy expired!
Key requirements:• Strong hands-on experience working in Hadoop Ecosystem, Big data technologies AWS Cloud and Cloudera• Must be hands-on with writing Python or Scala Scripts development• Well versed with Spark development (SQL and/or Spark)• Hands on experience designing of orchestration using AirflowHands on experience in AWS Service EC2, S3, SNS, SQS, Lambda, Hue, Presto, Spark , Glue, Kinesis, EMR, ECS, EKS• Sound knowledge in Hive, Redshift, AWS RDS, My SQL and in any NoSQL database e.g., Cassandra, MongoDB• Experience in architecting and designing batch or real time data streaming• Ability to dynamically adapt to conventional big data frameworks and opensource tools if project demands• Knowledge of design strategies for developing scalable, resilient, always-on data lake • Strong development and automation skills• Good understanding in data architecture principles, including data access patterns, data modelling and strong in Data base concepts• Previous experience in ESG related reporting in a financial services organization is an advantage
- ID: #49121258
-
State: Michigan
Allenpark
48101
Allenpark
USA
- City: Allenpark
- Salary: Depends on Experience
- Job type: Contract
- Showed: 2023-02-10
- Deadline: 2023-04-10
- Category: Et cetera