Sr. Azure Data Engineer

25 Jun 2024

Vacancy expired!

Job Description
  • Experience working on major cloud platform ( Azure, AWS, Google Cloud Platform ).
  • Hands on experience preparing notebooks and complex Python, SQL views and stored procedures, stored procs in SQLServer, PostgreSQL , Redshift , Azure SQL DW/Azure Synapse.
  • Experience working with Data bricks, ETL tools Azure Data Factory(preferred) ,AWS Glue/Dataprep.
  • Exceptional data analysis and data profiling skills.
  • In depth understanding of data warehousing and database optimization concepts.
  • Ability to understand the enterprise data domains and translate into a simplified model.
  • Build data ingestion pipelines using ADF/AWS Glue/SSIS to extract data from various sources and load into Azure Data Lake/S3.
  • Experience implementing data quality as part of the ETL infrastructure.
  • Experience using data governance tools such as Collibra/Alation.
  • Experience in implementing modern data architectures that will define and deliver data as an asset.
  • Performance Tuning of Spark SQL running on DELTA LAKE storage and Strong Knowledge on Databricks and Cluster Configurations.
  • Good understanding of AzureBLOB Storage / AWS S3.
  • Knowledge of data modelling to better assist in building up of the current landscape with more data elements.
  • Well versed with working in an agile methodology.
  • Experience working with an on-shore / off-shore model.

Nice to have:
  • Understanding of PBI Data Flows, Data Sets, report and dashboard development
  • Integration between various Power Platform offerings
  • Experience with ETL development (5+ years)
  • Experience with database design (5+ years)
  • Experience with reporting and visual analytics (3+ years)

  • ID: #43619445
  • State: California Irvine 92602 Irvine USA
  • City: Irvine
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2022-06-25
  • Deadline: 2022-08-23
  • Category: Et cetera