Data engineer - python etl and azure

data engineer - python etl and azure.

new york , new york

posted today

job detailssummary

$60 - $65 per hour

contract

bachelor degree

category computer and mathematical occupations

reference1067639

job detailsjob summary:The ideal candidate should have proficiency in Python programming language and experience in Extract, Transform, Load (ETL) processes. They should be able to design and develop efficient ETL workflows to extract data from various sources, transform it as per business requirements, and load it into target systems.The candidate should also have hands-on experience working with Microsoft Azure cloud platform. They should be familiar with Azure services and tools, and have a good understanding of Azure architecture and best practices.The candidate should have practical experience with Azure Data Factory, DataBricks, Azure Storage, and Azure Virtual Machines. They should be able to design and implement data pipelines using Azure Data Factory, perform data transformations and analytics using DataBricks, and manage data storage and virtual machines in Azure.They must also have a good understanding of data governance principles, data quality management, and data controls. Should be able to implement data governance frameworks, establish data quality standards, and ensure compliance with data regulations and policies.location: New York, New Yorkjob type: Contractsalary: $60 - 65 per hourwork hours: 8am to 4pmeducation: Bachelorsresponsibilities:

Design and develop efficient ETL workflows to extract data from various sources, transform it as per business requirements, and load it into target systems.

Design and implement data pipelines using Azure Data Factory, perform data transformations and analytics using DataBricks, and manage data storage and virtual machines in Azure.

Implement data governance frameworks, establish data quality standards, and ensure compliance with data regulations and policies.

Setting up alerts and notifications for batch jobs

qualifications:

Experience level: Experienced

Minimum 8 years of experience

Education: Bachelors

skills:

ETL

Azure

ETL

Python

ETLEqual Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including health, an incentive and recognition program, and 401K contribution (all benefits are based on eligibility).This posting is open for thirty (30) days.