Data Engineering Lead

02 Jul 2024

Vacancy expired!

  • 10+ years of practical experience

    designing and building data solutions
  • Enterprise experience with

    Google Cloud Platform Big Data products including

    BigQuery, Pub/Sub, Cloud Composer, Dataflow, Dataproc, Dataprep, Data Studio, Bigtable, Cloud Storage, and more.
  • Understand different types of storage (

    filesystem, relational, NoSQL) and working with various kinds of data (

    structured, unstructured, metrics, log files, etc.)
  • Experience with

    data pipelines (ETL, ELT) and

    data wrangling procedures using Python and SQL.
  • Tune application and query performance using

    performance profiling tools and SQL
  • Experience with batch and stream processing (including

    Google Cloud Platform Dataflow/Kafka Streams/Spark)
  • Familiarity with agile software development practices and drive to ship quickly.
  • Research, analyze, and recommend technical approaches for solving difficult and challenging development and integration problems.
  • Bachelor's degree from four-year College or university in Computer Science or related field.
  • Responsible for maintenance and enhancement of data platform which involves adding various operators for carrying out tasks in

    Apache Airflow
  • Identify, design and implement internal process improvements by automating manual processes and optimizing data delivery
  • Technical certifications such as Google Cloud Data Engineer or advanced certifications in data science a plus.
  • Experience with microservice patterns, API development, RESTful web services.

  • ID: #43775842
  • State: New Jersey Shorthills 07078 Shorthills USA
  • City: Shorthills
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2022-07-02
  • Deadline: 2022-08-29
  • Category: Et cetera