Big Data Engineer

24 Nov 2024

Vacancy expired!

Position:

Big Data engineer (ADS)- with Java and Azure (or) Big Data engineer……… With AWSLocation: Costa Mesa, CA or San Jose, CA or Allen, TXDuration: 6+ MonthsDescription
  • BS degree in computer science, computer engineering or equivalent
  • 5 – 6 years of experience delivering enterprise software solutions
  • Proficient in

    Java, Spark, Scala, Python, Azure/AWS Cloud technologies
  • 3+ years of experience across multiple Hadoop / Spark technologies such as Hadoop, MapReduce, HDFS, HBase,Hive, Flume, Sqoop, Kafka, Scala
  • Flair for data, schema, data model, how to bring efficiency in big data related life cycle
  • Must be able to quickly understand technical and business requirements and can translate them into technical implementations
  • Experience with Agile Development methodologies
  • Experience with data ingestion and transformation
  • Solid understanding of secure application development methodologies
  • Experience with

    Airflow will be preferred
  • Understanding of automated QA needs related to Big data
  • Strong object-oriented design and analysis skills

Responsibilities
  • Utilize your software engineering skills including Java, Spark, Python, Scala to Analyze disparate, complex systems and collaboratively design new products and services
  • Integrate new data sources and tools
  • Implement scalable and reliable distributed data replication strategies
  • Ability to mentor and provide direction in architecture and design to onsite/offshore developers
  • Collaborate with other teams to design and develop and deploy data tools that support both operations and product use cases
  • Perform analysis of large data sets using components from the Hadoop ecosystem
  • Own product features from the development, testing through to production deployment
  • Evaluate big data technologies and prototype solutions to improve our data processing architecture
  • Automate everything

  • ID: #23378915
  • State: California Sanjose 92626 Sanjose USA
  • City: Sanjose
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2021-11-24
  • Deadline: 2022-01-21
  • Category: Et cetera