Vacancy expired!
One of our clients is looking
Azure DevOps Engineer on the following skills: DevOps Engineer IV (Sr. Data Engineer)Top Skills and Years of Experience:10 years experience in:- Azure Data Factory
- Creating ELT Pipelines in Azure Synapse Analytics and Data Bricks
- Languages including Python, SQL
- Implement technologies that supports the data strategy (30%) -
- Develop, implement the Data Lake/Lakehouse architecture while providing guidance on best practices.
- Define and implement data pipelines that enable analytics and operational dashboards (30%) -
- Design and develop high quality batch and real time data pipelines at a senior level.
- Define and Implement Data Engineering standards and best practices that improve quality and efficiency (20%) -
- Define and promote data engineer standards, best practices, and design patterns.
- Implement technologies that supports the data strategy (30%) -Develop, implement the Data Lake/Lakehouse architecture while providing guidance on best practices.
- Define and implement data pipelines that enable analytics and operational dashboards (30%) - Design and develop high quality batch and real time data pipelines at a senior level.
- Define and Implement Data Engineering standards and best practices that improve quality and efficiency (20%) - Define and promote data engineer standards, best practices, and design patterns.
- Define and Implement Data Engineering workflows that improve quality and reduce the time to release new features (10%) - Design and implement CI/CD workflows and pipelines.
- Ensure the team can support ongoing development and operations of new technology (10%) - Mentor other members of the team in new technology and skills.
- Azure Data Factory
- Spark Notebook
- Creating ELT Pipelines in Azure Synapse Analytics and Data Bricks
- Languages including Python, SQL
- Lakehouse Architecture using medallion design (bronze, silver, gold)
- CICD pipelines in Azure
- Implementing an environment from ground up
- Setting best practices for data engineering
- Mentorship of team of data engineers
- Clear and proactive communication - verbal/written
- Taking initiative and working autonomously with some direction
- Addressing data quality and profiling.