Senior Big Data Engineer

02 Jul 2024

Vacancy expired!

Title : Senior Big Data Engineer

Location :

Piscataway/ Basking Ridge, NJ - Hybrid

Duration : 6+ Months

Job Description:

AgreeYa is a global Systems Integrator and is seeking a Senior Data Engineer. The Senior Data Engineer will design and implement enterprise infrastructure and platforms required for setting up data engineering pipelines utilizing the tools available on the Google Cloud Platform Platform.

Job Responsibilities
  • Looking for a Senior Big Data Engineer/Architect on Google Cloud Platform to help strategize, architect and implement various solutions to migrate data hosted on our on-prem platform to Google cloud Platform (Google Cloud Platform). The architect will design and implement enterprise infrastructure and platforms required for setting up data engineering pipelines utilizing the tools available on the Google Cloud Platform Platform. As a Google Cloud Platform Platform Architect - You will work on Advanced Data Engineering products using Google Big Data technologies such as GCS, Data Proc, Airflow, Data Store and Big Query.
  • Very strong leadership and communication skills exhibiting right negotiating posture with customer and program teams to make the right decisions.
  • Experience leading one or more of the following areas of a Cloud transformation journey: strategy, design, application migration planning and implementation for any private and public cloud.
  • Cloud foundation design and build/implement
  • Cloud Transformation & Migration
  • Cloud Managed service (IaaS and PaaS)
  • Cloud foundation design and build/implement

Required Skills & Experience
  • Google Cloud Certified Professional Cloud Architect Certification
  • Bachelor's degree with 3-5 years' experience on Google cloud with deep understanding, design and development experience with Google Cloud Platform products on Infrastructure, Data management, Application Development, Smart Analytics, Artificial Intelligence, Security and DevOps
  • Extract, Transform and Load (ETL) & Big Data Tools: BigQuery, Cloud Dataflow, Cloud Proc, Cloud Pub/Sub, Cloud Composer, Google Data Studio, Google Cloud Storage.
  • NoSQL databases: Cloud Bigtable, Cloud Fire store, Firebase Realtime Database, Cloud Memory store. Search Technologies: Lucene and Elasticsearch
  • Relational Databases: Cloud Spanner, Cloud SQL

Preferred Skills & Experience
  • Strong knowledge on Google cloud storage Data lifecycle management
  • Strong knowledge on BIGQuery Slots management
  • Cost optimization for Dataproc workload management
  • Experience of designing, building, and deploying production-level data pipelines using tools from Hadoop stack (HDFS, Hive, Spark, HBase, Kafka, NiFi, Oozie, Splunk etc).
  • Development and deployment technologies (e.g. JIRA, GitHub, Jenkins, Nexus, Artifactory)

Education
  • Bachelor's degree with 3-5 years' experience

About Us:AgreeYa is a global systems integrator delivering competitive advantage for its customers through software, solutions, and services. Established in 1999, AgreeYa is headquartered in Folsom, California, with a global footprint and a team of more than 1,850 staff across offices. AgreeYa works with 500+ organizations ranging from Fortune 100 firms to small and large businesses across industries such as Telecom, Banking, Financial Services & Insurance, Healthcare, Utility & Energy, Technology, Public sector, Pharma & Biotech, and others. Please visit us at www.agreeya.com for more information. AgreeYa is an equal opportunity employer. We evaluate qualified applicants without regard to race, color, religion, gender identity, sexual orientation, national origin, disability, veteran status or other protected characteristics. Visit our website to learn about our Career & Culture.

  • ID: #43768795
  • State: New Jersey Piscataway 08854 Piscataway USA
  • City: Piscataway
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2022-07-02
  • Deadline: 2022-08-12
  • Category: Et cetera