Vacancy expired!
We are currently seeking an experienced
Data Engineer to join the Big Data and Advanced Analytics department. The Data Engineer will work closely with business domain experts to create an Enterprise Data Lakehouse to support data analytic use cases for the Natural Gas Gathering, Processing, and Transformation business units.- Design and implement reliable data pipelines to integrate disparate data sources into a single data lake
- Design and implement data quality pipelines to ensure data correctness and building trusted data sets
- Design and implement a data lake solution which accurately reflects business operations
- Assist with data platform performance tuning and physical data model support including partitioning and compaction
- Provide guidance in data visualizations and reporting efforts to ensure solutions are aligned to business objectives
- 5+ years of experience as a Data Engineer designing and maintaining data pipeline architectures
- Expert knowledge of ANSI SQL, PL/SQL, TSQL, and Python
- Experience in various data integration patterns including ETL, ELT, Pub/Sub, and Change Data Capture
- Experience in data management practices including data catalog, data lineage, and master data management
- Experience in business analysis and defining business performance metrics
- Experience in software development practices such as Design Principles and Patterns, Testing, CI/CD, and version control
- Experience in implementing a Data Lakehouse using Apache Iceberg or Delta Lake
- Knowledgeable of common data visualization tools such as Power BI and Tibco Spotfire
- Experience with Dremio is preferred