Vacancy expired!
Role: Software Developer Apache SparkLocation: Charlotte, NC 12 months+ JOB DESCRIPTION:Google Cloud Data EngineerQualifications: 8-10+ years of software backend/data engineering experience, including familiarity with ETL/ELT patterns, system design, roadmap planning, distributed data processing (batch and stream), engineering management, large-scale distributed storage and database systems, sound knowledge about database concepts such as transactions, indexing, concurrency Familiarity with API integrations and development Language(s): Python (Advanced), Java (Advanced), SQL(Advanced), OpenAPI v3 (intermediate) Libraries: Apache Beam (Advanced/Strong); both Java and Python SDKs with knowledge of multiple data formats (ORC, Avro, Parquet), Apache Spark (Advanced/Strong), Spring Boot (Intermediate) Google Cloud Platform Services: Google Data Flow (Advanced), BigQuery (Intermediate), Composer (Intermediate), Data Proc (Advanced), GCS (Intermediate), Pub/Sub (Intermediate) Other Platforms: Hadoop ecosystem w/Spark (advanced), Apache Airflow (intermediate) Experience: Prior experience and enough knowledge of the Beam SDK to build reusable Beam libraries and components in the areas of pipeline observability, alerting, data controls, technical metadata extraction
- ID: #42735665
-
State: North Carolina
Charlotte
28201
Charlotte
USA
- City: Charlotte
- Salary: Depends on Experience
- Job type: Contract
- Showed: 2022-06-10
- Deadline: 2022-08-08
- Category: Et cetera