Spark Developer

10 Jun 2024

Vacancy expired!

Role: Software Developer Apache Spark

Location: Charlotte, NC

12 months+ JOB DESCRIPTION:Google Cloud Data EngineerQualifications: 8-10+ years of software backend/data engineering experience, including familiarity with ETL/ELT patterns, system design, roadmap planning, distributed data processing (batch and stream), engineering management, large-scale distributed storage and database systems, sound knowledge about database concepts such as transactions, indexing, concurrency

Familiarity with API integrations and development

Language(s): Python (Advanced), Java (Advanced), SQL(Advanced), OpenAPI v3 (intermediate) Libraries: Apache Beam (Advanced/Strong); both Java and Python SDKs with knowledge of multiple data formats (ORC, Avro, Parquet), Apache Spark (Advanced/Strong), Spring Boot (Intermediate)

Google Cloud Platform Services: Google Data Flow (Advanced), BigQuery (Intermediate), Composer (Intermediate), Data Proc (Advanced), GCS (Intermediate), Pub/Sub (Intermediate) Other Platforms: Hadoop ecosystem w/Spark (advanced), Apache Airflow (intermediate) Experience: Prior experience and enough knowledge of the Beam SDK to build reusable Beam libraries and components in the areas of pipeline observability, alerting, data controls, technical metadata extraction

  • ID: #42735665
  • State: North Carolina Charlotte 28201 Charlotte USA
  • City: Charlotte
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2022-06-10
  • Deadline: 2022-08-08
  • Category: Et cetera