Data Engineer IV

JOB SCOPEResponsible for maintaining scalable, reliable, consistent and repeatable systems that support data operations for Reporting, Analytics, Applications, and Data Science by gathering and processing raw data at scale. Profiles data to measure quality, integrity, accuracy, and completeness and delivers solutions by developing, testing, and implementing code and scripts. Develop data set processes for data modeling, mining, and consumption.DUTIES AND RESPONSIBILITIES

Create and maintain scalable, reliable, consistent and repeatable systems that support data operations for Reporting, Analytics, Applications, and Data Science.

Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).

Use ETL processes in order to maintain, improve, clean, and manipulate data.

Profile data to measure quality, integrity, accuracy, and completeness.

Develop and implement tools, scripts, queries, and applications for ETL/ELT and data operations.

Design, build, and automate Machine Learning Data Pipeline.

Deliver solutions by developing, testing, and implementing code and scripts.

Produce reports and uphold data delivery schedules.

Manage life cycle of multiple data sources.

Work closely with stakeholders on the data demand side (analysts and data scientists).

Increase speed to delivery by implementing workload/workflow automation solutions.

Perform other duties as assigned.

BASIC / MINIMUM QUALIFICATIONS

Bachelor's degree in an engineering discipline or computer science

Minimum five (5) years of Hands-on working experience with AWS, RDBMS, SQL, scripting, and coding experience

Minimum three (3) years of Linux/Unix/CentOS system admin experience.

REQUIRED QUALIFICATIONS

Ability to use a wide variety of open source technologies and cloud services

Extensive coding/scripting experience using Python, R, shell scripts

Extensive experience with SQL, Tableau, ML Pipeline techniques, and ETL techniques

Extensive background in Linux/Unix/CentOS installation and administration; Windows experience preferred

Extensive knowledge in data storage that demonstrates knowledge of when to use a file system, relational database, or NoSQL variant

Extensive experience with Spark, and Hadoop/Hive

Extensive experience with AWS tools and services

Extensive familiarity with JavaScript API, Rest API or Data Extract APIs

Extensive experience receiving, converting, and cleansing big data

Extensive experience with visualization or BI tools, such as Tableau

Extensive experience with data virtualization concepts, and software (Denodo, Teiid, Jboss)

Extensive experience with data workflow/data prep platforms, such as Infomatica, Pentaho, or Talend

Ability to identify and resolve end-to-end performance, network, server, and platform issues

Effective attention to detail with the ability to effectively prioritize and execute multiple tasks

PREFERRED QUALIFICATIONS

Extensive experience with JavaScript API, Rest API or Data Extract APIs

Extensive experience with data workflow/data prep platforms, such as Infomatica, Pentaho, or Talend

Expert knowledge of best practices and IT operations in an always-up, always-available service

Extensive experience with data virtualization concepts, and software (Denodo, Teiid, JBoss)

Extensive experience with AWS tools and services

Extensive experience receiving, converting, and cleansing big data

Extensive experience with visualization or BI tools, such as Tableau

Extensive experience receiving, converting, and cleansing data

Extensive knowledge of best practices and IT operations in an always-up, always-available service

Ability to create proof of concept experiments for analytics, machine learning, or visualization tools that include hypothesis, test plans, and outcome analysis

Leadership experience in advanced operational analytics

EGN319 2024-39292 2024Here, employees don’t just have jobs, they build careers. That’s why we believe in offering a comprehensive pay and benefits (https://jobs.spectrum.com/compensation-and-benefits) package that rewards employees for their contributions to our success, supports all aspects of their well-being, and delivers real value at every stage of life.A qualified applicant’s criminal history, if any, will be considered in a manner consistent with applicable laws, including local ordinances.Get to Know Us Charter Communications is known in the United States by our Spectrum brands, including: Spectrum Internet®, TV, Mobile and Voice, Spectrum Networks, Spectrum Enterprise and Spectrum Reach. When you join us, you’re joining a strong community of more than 100,000 individuals working together to serve more than 32 million customers in 41 states and keep them connected to what matters most. Watch this video to learn more. (https://www.youtube.com/watch?v=N-HEOHIAU7Q)Who You Are Matters Here We’re committed to growing a workforce that reflects our communities, and providing equal opportunities for employment and advancement. EOE, including disability/vets. Learn about our inclusive culture. (https://jobs.spectrum.com/inclusiveworkplace/)