Data Engineer

20 Nov 2024

Vacancy expired!

Job Description

Our Advanced Analytics team is looking for a PySpark Data Engineer to design and develop a scalable data processing infrastructure for our client in the utilities industry. You’ll work closely with our team of analysts, TPMs, and data scientists to enable data-driven decision making and build solutions that have a real-world impact on public safety, customer experience, and environmental protection.

At the same time, you’ll be joining a five-time Best Company to Work For, where super-smart, talented people come together to do outstanding work—and have a heck of a lot of fun while they’re at it. Because we’re a consulting shop with a diverse clientele, you can count on a steady stream of opportunities to work with cutting-edge technologies and different types of data on projects that make a real difference.

About you

You’re the perfect person for the job if you’re a big-data engineering ninja with …

  • A nose for uncovering business needs and pain points in partnership with executive management
  • A talent for communicating engineering concepts to non-techy business stakeholders
  • A passion for building large-scale machine learning pipelines
  • A knack for developing and iterating solutions at record speed

What you’ll be doing

  • Joining forces with internal and external teams to understand the client’s business needs
  • Designing and developing a scalable data processing infrastructure
  • Helping the client better understand their core needs, with a keen awareness of technical limitations.

Qualifications

  • Strong understanding of high-performance ETL development with Python
  • 5+ years of data engineering, 3+ years of PySpark
  • Data engineering implementation experience with some of the following technologies:
    • Python
    • Spark and PySpark
    • SparkSQL
  • Advanced engineering skills with Python
  • Comfortable working with very large data
  • Demonstrated ability to identify business and technical impacts of user requirements and incorporate them into the project schedule
  • Strong communication and interpersonal skills
  • Ability to work both independently and as part of a team
  • Work across team to solve technical roadblocks for our customers.
  • An undergraduate degree in technology or business is required

We'd be super impressed if you had

  • Experience building data and computational systems that support machine learning
  • Knowledge of AWS services
  • Experience with modern software delivery practices, including source control, testing, continuous delivery
  • Experience delivering product with Agile methodologies
  • Experience with streaming data in Spark

Additional Information

All your information will be kept confidential according to EEO guidelines.

Core Values

At Logic20/20, weareguidedby three core values: Drive toward Excellence, Act with Integrity & Foster a Culture ofWe.These values were generated and agreed upon by our employees—and they help us pursue our goal of being one of the best companies to work forandto work with.Learn more athttps://www.logic2020.com/company/our-values.

About Logic20/20

To learn more about Logic20/20, please visit:https://www.logic2020.com/careers/life-at-logic

  • ID: #23062006
  • State: Alabama Huntsville / decatur 35801 Huntsville / decatur USA
  • City: Huntsville / decatur
  • Salary: USD TBD TBD
  • Job type: Full-time
  • Showed: 2021-11-20
  • Deadline: 2022-01-19
  • Category: Et cetera