Data Engineer (ETL, Google Cloud Platform) W2 Only

15 Jun 2024

Vacancy expired!

At HTC Global Services our consultants have access to a comprehensive benefits package. Benefits can include Paid-Time-Off, Paid Holidays, 401K matching, Life and Accidental Death Insurance, Short & Long Term Disability Insurance, and a variety of other perks.

Position Description:Data Engineer Design and build production data engineering solutions to deliver data pipeline patterns using following Google Cloud Platform (Google Cloud Platform) services:
  • In-depth understanding of Google's product technology and underlying architectures.
  • BigQuery – Warehouse/ data marts – Through understanding of Big Query internals to write efficient queries for ELT needs, creation of views/materialized views, creation of reusable store procedures etc.
  • DataFlow (Apache Beam) – reusable Flex templates/ data processing frameworks using Java for both batch and stream needs.
  • Pub/Sub, Kafka, Confluent Kafka – Real time streaming of database changes or events.
  • Experience of designing, building, and deploying production-level data pipelines using Kafka; Strong experience working on Event Driven Architecture.
  • Strong knowledge of the Kafka Connect framework, with experience using several connector types HTTP REST proxy, JMS, File, SFTP, JDBC etc.
  • Experience in handling huge volumes of streaming messages from Kafka.
  • Cloud Composer (Apache Airflow) – to build, monitor and orchestrating the pipeline.
  • Knowledge on BigTable.
  • Cloud SQL, Compute Engine, Cloud Function, Cloud Run and App Engine, Cloud Storage.
  • Experience with open-source distributed storage and processing utilities in the Apache Hadoop family.
  • Extensive knowledge on processing various file formats orc, Avro, csv, json, xml etc.
  • Knowledge/experience in any ETL tools like DataStage/Informatica – Ability to understand existing on-premises ETL workflows and redesign them in Google Cloud Platform.
  • Experience and expertise on Terraform to deploy the Google Cloud Platform’s in CI/CD.
  • Knowledge/ Experience on connecting to on-prem API’s from google cloud.

Skills Required:
  • Google Cloud Platform Big Query Terraform Cloud run.

Experience Required:
  • Big Query Terraform.

Education Required:
  • Bachelor's Degree.

Find a purposeHelp clients embrace emerging technologies. Create inventive solutions and meet intriguing client challenges. Solve, fix, design and innovate. Be a part of something bigger by helping clients go digital, create engaging customer experiences and transform their business.

Move aheadOur success as a company is built on practicing inclusion and embracing diversity. HTC Global Services is committed to providing a work environment free from discrimination and harassment, where all employees are treated with respect and dignity. Together we work to create and maintain an environment where everyone feels valued, included, and respected. At HTC Global Services, our differences are embraced and celebrated. HTC is an Equal Opportunity Employer. We respect and seek to empower each individual and support the diverse cultures, perspectives, skills and experiences within our workforce. HTC is proud to be recognized as a National Minority Supplier.

About HTC Global ServicesShaping careers since 1990 - our long tenured employees are a testimony of the work culture. Join our global employee base of 12,000 and help us bring human expertise to tech in order to deliver purposeful solutions that amplify value.

  • ID: #43024548
  • State: Michigan Dearborn 48120 Dearborn USA
  • City: Dearborn
  • Salary: $60 - $70
  • Job type: Permanent
  • Showed: 2022-06-15
  • Deadline: 2022-07-23
  • Category: Et cetera