Data Engineer - 1077320

18 Jun 2024

Vacancy expired!

Lighthouse Technology Services is partnering with our client to fill their Data Engineer position! This is a 6 month contract opportunity with likely extensions. This role will be a W2 employee of Lighthouse Technology Services. Charlotte, North Carolina-based candidates preferred.

What You'll Be Doing:

•Provide expertise with development and management of analytical data and reporting platforms.

•Lead design of Power BI Premium operational and analytical reporting strategy and administration

•Collaborate with the data services team and data architect to develop strategy for long term data platform architecture

•Assist application teams with the collection of transactional and master data from source systems

•Design and implement data movement and transformation pipelines (e.g. AWS Glue, Apache AirFlow, dbt, Snowflake)

•Design processes and algorithms to enhance data quality and reliability

•Provide availability and access to consume analytical data through a wide range of Business Intelligence and Reporting toolsets (e.g. Microsoft Power BI, Google Looker)

•Implement proactive monitoring and alerting to ensure operational stability and supportability

•Collaborate with data analysts, data scientists, security engineers, and architects to achieve the best possible technical solutions that address our business needs

•Performs analysis and critical thinking required to troubleshoot data-related issues and assist in the resolution

•Coordinate change and release management across technical teams inside and outside the department

•Minimize operational impact while achieving the best possible performance and system health.

Applicants must have a proven work experience in a data-related role and the following qualifications:

•3+ years in Data Warehousing, Big Data, or ETL development (preferably using AWS S3, Glue, Apache AirFlow)

•3+ years of experience with a programming language (preferably Python)

•Experience designing, building, and maintaining data processing and transformation pipelines (AWS Glue, Apache AirFlow, dbt, Snowflake)

•Experience with Power BI Premium workspace and app management

•Technical expertise with data models, data mining, and data segmentation techniques

•Knowledge of CI/CD deployment practices

•Strong skills with Python and SQL with the ability to write efficient queries

•Excellent analytical and organization skills

•Excellent critical thinking and problem-solving skills

•Good communication skills (presentations, documents, emails)

•The ability to work independently and in a team environment

Special Skills and/or Training Desired:

•Experience working in an Agile / Scrum environment

•Strong experience with AWS data services (e.g. S3, DynamoDB, Glue, Athena, Redshift, Lambda, SQS, SNS, and API Gateway)

•AWS Solutions Architect Associate or AWS Developer Certification (desired)

•Experience with Power BI Premium cloud workspace and app management

•Experience with Snowflake cloud data platform

•Experience utilizing Apache AirFlow to manage data pipelines and workflows

•Experience with dbt data transformation framework

•Experience with Microsoft Azure DevOps for work item management and CI/CD deployment pipelines

Questions about any of our jobs? Email us at

View all of our open jobs here: jobs.lhtservices.com

  • ID: #43221299
  • State: North Carolina Charlotte 28201 Charlotte USA
  • City: Charlotte
  • Salary: USD TBD TBD
  • Job type: Permanent
  • Showed: 2022-06-18
  • Deadline: 2022-08-16
  • Category: Et cetera