Big Data Engineer

30 Nov 2024

Vacancy expired!

FLEX IT client has an immediate need for a

Big

Data Engineer for a 12 months contract in Portland, Oregon.

This would initially be remote and eventually onsite.

Key Skills: Python, Spark, Spark Streaming, AWS, SQL

Job Description and Duties:
  • Design and implement distributed data processing pipelines using Spark, Hive, Python, and other tools and languages prevalent in the Hadoop ecosystem.
  • You will be given the opportunity to own the design and implementation.
  • You will collaborate with Product managers, Data Scientists, Engineering folks to accomplish your tasks.
  • Publish RESTful API’s to enable real-time data consumption using OpenAPI specifications.
  • This will enable many teams to consume the data that is being produced.
  • Explore and build proof of concepts using open source NOSQL technologies such as HBase, DynamoDB, Cassandra and Distributed Stream Processing frameworks like ApacheSpark, Flink, Kafka stream.
  • Take part in DevOps by building utilities, user defined functions and frameworks to better enable data flow patterns.
  • Work with architecture/engineering leads and other teammates to ensure high quality solutions through code reviews, engineering best practices documentation.
  • Experience in Business Rule management systems like Drools will also come in handy.

Required Skills:
  • MS/BS degree in a computer science or related discipline
  • 3+ years’ experience in large-scale software development/Big Data technologies
  • Programming skills in Java/Scala, Python, Shell scripting, and SQL
  • Development skills around Spark, MapReduce, and Hive
  • Strong skills around developing RESTful API’s
At Flex IT we believe that diverse teams improve our business. We are an equal opportunity employer and do not discriminate on the basis of race, religion, color, nationality, gender, sexual orientation, age, marital status, veteran status, or disability status.Flex IT is an IT Services Firm dedicated to advancing the careers of IT Professionals. We work with some of the most recognized companies in the country to place IT professionals that stand out amongst their peers. Talented individuals need challenging opportunities. To discover your next great opportunity and begin to build a career path, contact us today.

  • ID: #23663375
  • State: Oregon Portland 97201 Portland USA
  • City: Portland
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2021-11-30
  • Deadline: 2022-01-28
  • Category: Et cetera