Lead Data Engineer

21 Nov 2024

Vacancy expired!

SUMMARY:We're seeking a talented Senior Data Engineer specializing in building and maintaining production machine learning software platforms to join our team. Our machine learning platform helps manage the various components of the ML application development life cycle, starting from data ingestion, annotation, exploration to model training, deployment and monitoring. All of these components are interdisciplinary, so you will be working closely with roboticists and ML researchers in both defining interfaces and optimizing implementations to meet the final product specifications.A well qualified candidate for this position will love prototyping and have the ability to turn that prototype into a high quality production feature. Implementing complex distributed systems will excite you and you'll have an insatiable appetite for new information such as new ML frameworks or new database technologies.

ROLE RESPONSIBILITIES:
  • Build solutions to satisfy the data management, search, and data versioning needs of Blue River
  • Connect our ecosystem by building integrations across multiple existing and new tools
  • Implement and optimize data model, queries, and ETLs for complicated text, image, and sensor data
  • Design service level interfaces for our ML and Data Platform
  • Work with product, data scientists, and roboticists to build visualization tools and dashboards

REQUIRED SKILLS & QUALIFICATIONS:
  • Expert Python developer
  • Bachelor's Degree in Computer Science, Math, Physics or other quantitative field
  • 5+ years professional software development experience
  • Adept query optimization in NoSQL and SQL databases such as Postgres, Mongo, Athena, and InfluxDB
  • Experience developing microservices and cloud native applications
  • Familiarity with common data visualization tools: e.g, Apache Superset, Tableau, Looker
  • Self motivated, independent thinker, and excellent communicator

PREFERRED QUALIFICATIONS:
  • Experience with Data Lake and Petabytes of Data
  • Experience developing within the Jupyter ecosystem is a plus
  • Experience with production ML platform
  • Experience with Kubeflow or TFX
  • Familiarity with ML Frameworks: TensorFlow, PyTorch.

  • ID: #23199833
  • State: California Sunnyvale 94085 Sunnyvale USA
  • City: Sunnyvale
  • Salary: USD180000.0/ANNUAL - USD200000.0/ANNUAL
  • Job type: Permanent
  • Showed: 2021-11-21
  • Deadline: 2022-01-18
  • Category: Et cetera