Big Data Engineer/ data engineer

25 Oct 2024

Vacancy expired!

Pyspark + Python + DataMart: 8+ Years of total IT experience with 4-5 years of hands-on experience implementing Python, BigData, Pyspark, Spark SQL and basic knowledge on SparkR. Strong understanding on Bigdata technologies like HIVE, HBASE, HDFS and any cloud storages like Blob storage or S3 or google cloud/Azure cloud storage. Knowledge on any cloud technology like Azure, Google, IaaS and PaaS Components, Docker, Containers, Kubernetes, Storage, Server. Experience on developing products using MapR, HBase, Spark, Kafka, Microservices, Pig, Oozie, Flume, Sqoop, HIVE, HBASE, HDFS and any cloud storages like Blob storage, S3, google/Azure cloud storage. Analysis, Design, Development using Data Warehouse & Business Intelligence solutions, Enterprise Data Warehouse Responsible to analyse big data and provide technical expertise and recommendations to improve current existing systems. Involved in finding, evaluating and deploying new Big Data technologies and tools. Build high-volume real-time data processing applications with understanding on integrations tools to SQL , Big Query, Bigtable, Mongo DB. Designing solutions and architecting applications for the Cloud (High availability, Fault tolerant, Elastic, Secure), Dataflow/Dataproc Experience with CI/CD, Agile tools, DevOps, Splunk, REST API, Source control and versioning tools: Preferred Excellent interpersonal skills; strong desire to move projects forward and be proactive. Seeks opportunities to learn and improve Strong communication skills and Good knowledge on query optimization and performance tuning. Google Cloud Platform or Azure certification will be a plus

  • ID: #21688316
  • State: Kentucky Louisville 40295 Louisville USA
  • City: Louisville
  • Salary: USD TBD TBD
  • Job type: Permanent
  • Showed: 2021-10-25
  • Deadline: 2021-12-19
  • Category: Et cetera