Data Engineer

27 Mar 2024

Vacancy expired!

Data Engineer

Sunnyvale, CA

LongtermDescriptionYou will architect, develop, and test large scale data solutions, to provide efficient analytical and reporting capabilities across clients global and regional sales and finance teams. You will develop highly scalable data pipelines to load data from various source systems, use Apache Airflow to orchestrate, schedule and monitor the workflows. Build generic and reusable solutions that can scale and utilize various technologies and frameworks to solve our complex business requirements. You will be required to understand existing solutions, fine-tune them and support them as needed. Data quality is our goal and we expect you to meet our high standards on data and software quality. We are a rapidly growing team with plenty of interesting technical and business challenges to solve. We seek a self-starter, who is willing to learn fast, adapt well to changing requirements and work with cross functional teams.KeyQualifications6+ years of hands-on data modeling and data engineering experienceStrong expertise in dimensional modeling and data warehousingDatabase design and development experience with relational or MPP databases such as Postgres/ Oracle/ Teradata/ VerticaExperience in design and development of custom ETL pipelines using SQL and scripting languages (Python/ Shell/ Golang)Proficiency in advanced SQL, performance tuningHands on experience with Big-Data platforms like Spark, Dremio, Hadoop, MapReduce, Hive etcExperience with Java, Scala and PythonExperience with cloud computing platforms like AWS, Google CloudFamiliarity with version control systems, CI/CD practices, testing, and migration tools for database and softwareExperience working with APIsExperience with real time data processing using Apache Kafka or Spark Streaming is a big plusAbility to learn and adapt to new tools and technologiesAnalytical and mathematical mind, capable of evaluating and solving various complex problemsAbility to work individually or as part of a teamAbility to learn quickly in a fast paced environmentExcellent oral and written communication skillsEducation&Experience BS or MS in Engineering/ Computer Science

  • ID: #49560001
  • State: California Sunnyvale 94085 Sunnyvale USA
  • City: Sunnyvale
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2023-03-27
  • Deadline: 2023-05-21
  • Category: Et cetera