Data Engineer, Central Data

22 Nov 2024
Apply

At Lyft, our purpose is to serve and connect. To do this, we start with our own community by creating an open, inclusive, and diverse organization.At Lyft, data isn't just part of our decision-making process; it's the foundation. It drives our ability to deliver exceptional transportation experiences and offers insights into the impact of our product launches and features.Joining Lyft as a Data Engineer means becoming a pivotal part of a team dedicated to shaping the future of transportation. You'll be tasked with developing robust data pipelines—encompassing data transport, collection, and storage—and providing services that enable our leadership to make informed, risk-reducing decisions. We are in search of a Data Engineer to join the Central Data Engineering Team within Data Platform, responsible for designing and managing the most foundational datasets at Lyft (Rides, Routes, Sessions) . These datasets drive key parts of the Lyft business and support a variety of use cases, including but not limited to Pricing, Mapping, and Marketplace.As a Data Engineer, with your technical expertise you will manage project priorities, deadlines, and deliverables. You will design, develop, test, deploy, maintain, and enhance the data pipelines. Your work will have a major impact on several areas of the business.We are looking for candidates who are self starters and have a proven track record of delivering data solutions that can solve critical business needs. The candidate should be able to dive deep into any problems with lots of ambiguity and build a technical solution to solve it. They should be willing to take ownership of a project or a feature and be able to drive it from design to implementation.Responsibilities:

Owner of the core company data pipeline, responsible for scaling up data processing flow to meet the rapid data growth at Lyft

Evolve data model and data schema based on business and engineering needs

Implement systems tracking data quality and consistency

Develop tools supporting self-service data pipeline management (ETL)

SQL and Spark/Trino job tuning to improve data processing performance

Write well-crafted, well-tested, readable, maintainable code

Participate in code reviews to ensure code quality and distribute knowledge

Unblock, support and communicate with internal & external partners to achieve results

Experience:

3+ years of data engineering industry experience

Experience with Data (or similar) Ecosystem (Spark, Trino, Snowflake, Bigquery, Databricks)

Strong skills in a scripting language (Python, Bash)

Good understanding of SQL Engine and able to conduct advanced performance tuning

1+ years of experience with workflow management tools (Airflow, Dagster, Prefect, Glue)

Experience of working directly with cross-functional data analytics, data scientists, and engineering teams to bridge Lyft’s business goals with data engineering

Benefits:

Great medical, dental, and vision insurance options

Mental health benefits

Family building benefits

In addition to 12 observed holidays, salaried team members have unlimited paid time off, hourly team members have 15 days paid time off

401(k) plan to help save for your future

18 weeks of paid parental leave. Biological, adoptive, and foster parents are all eligible

Pre-tax commuter benefits

Lyft Pink - Lyft team members get an exclusive opportunity to test new benefits of our Ridership Program

Lyft is an equal opportunity/affirmative action employer committed to an inclusive and diverse workplace. All qualified applicants will receive consideration for employment without regards to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status or any other basis prohibited by law. We also consider qualified applicants with criminal histories consistent with applicable federal, state and local law.This role will be in-office on a hybrid schedule — Team Members will be expected to work in the office 3 days per week on Mondays, Thursdays and a team-specific third day. Additionally, hybrid roles have the flexibility to work from anywhere for up to 4 weeks per year. #HybridThe expected base pay range for this position in the San Francisco area is $124,000.00 - $155,000.00. Salary ranges are dependent on a variety of factors, including qualifications, experience and geographic location. Range is not inclusive of potential equity offering, bonus or benefits. Your recruiter can share more information about the salary range specific to your working location and other factors during the hiring process.

Full-time
  • ID: #52939520
  • State: California Sanfrancisco 94102 Sanfrancisco USA
  • City: Sanfrancisco
  • Salary: USD TBD TBD
  • Showed: 2024-11-22
  • Deadline: 2025-01-22
  • Category: Et cetera
Apply