Vacancy expired!
This is a 100% REMOTE FULL TIME ROLE
Responsibilities:- Work with partners across different practice areas to understand and evaluate business needs.
- Consult with analytics team members to design and develop data engineering pipelines for analytic and dashboard projects.
- Develop streamlined and governed processes for data ingestion into data lake
- Understand and integrate data quality and data governance processes into data engineering pipelines
- Develop data validation process for transforming and curating raw data into business ready datasets
- Optimize query performance of large data sets for ad hoc exploration, analysis, and reporting
- Communicate complex technical information to business customers and project teams in an effective and concise manner
- Participate as a technical resource for a variety of information projects that will be dictated by current business needs and technological developments
- Work with a variety of external IT consulting partners on developing optimal data solutions and provide effective direction to contracted resources
- Bachelor's degree in Computer Science, Information Systems, Engineering or related fields.
- 5+ years of experience working with data, 3+ years' experience working on data projects with a focus on data engineering
- Experience with cloud platforms preferably Microsoft Azure and Databricks
- Experience with large-scale data collection and analysis
- Experience with batch, streaming, or API-based data integration patterns
- Strong knowledge of programming languages, such as SQL and Python
- Strong organizational skills and understanding of agile project management methodology
- Strong written and oral communication skills with demonstrated ability to communicate with technical and non-technical partners
- Documentation of data engineering processes
- Experience optimizing query performance of large data sets
- Developing and maintaining database schemas
- C# programming, object-oriented programming, Python
- PostgreSQL
- Visual studio
- Microsoft Azure
- .Net core
- Entity framework, multi-threading, Azure functions