Sr. Data Engineer (AWS, Flask, kafka, Python)

29 Nov 2024

Vacancy expired!

PETADATA is looking for

a Senior Data Engineer (AWS, Databricks Airflow, EKS, Python) to work with one of our Clients in

San Francisco, FL.

Roles & Responsibilities:
  • 8 + years of experience in cloud computing, big data, and microservices development.
  • 8+ years of experience in Cloud-Native Data technologies, preferably in certifications in AWS.
  • 5+ years of hands-on coding experience in Java, Python, R, and Scala and Machine Learning libraries like Scikit-Learn, Pytorch, and TensorFlow
  • 5+ years of experience in Spark & Spark SQL and Databricks.
  • 5+ years of experience in Apache Kafka & Flask SQL and Databricks.
  • 5+ years of experience in Casandra.
  • 4+ years of experience with the end-to-end DevOps CI/CD pipelines
  • 3+ years of experience in machine learning and analytical techniques to create scalable solutions for business problems.
  • Ability to make architectural decisions that enable scalability of data platforms and create intuitive, testable, maintainable, secure, and efficient code.
  • Should Be able to establish scalable, efficient, automated processes for large dataset analysis, model development, and validation.
  • Expertise in data noise removal, augmentation, and visualization using statistical methods, experience in ensuring data quality via cleaning techniques, and tuning models and hyperparameters.
  • Strong mathematical background including linear algebra, probability theory, and statistics.
  • You must have 8+years of experience in data visualization tools like Tableau and Power BI and work with data storage formats like Parquet.
  • HealthCare services industry experience preferred.
  • Experience in the day-to-day practicalities of Agile software Product Development Lifecycles such as Scrum, SAFe, DAD, Lean-Agile, Kanban, etc.
  • Must have Project Management skills to lead and guide the project teams.

Note Remote until Covid -19 until December 2021 If you are interested and meet the above job requirements, please submit your resume. After carefully reviewing your experience and skills, one of our Hiring team members will contact you on the next steps.

  • ID: #23621098
  • State: California Sanfrancisco 33601 Sanfrancisco USA
  • City: Sanfrancisco
  • Salary: Depends on Experience
  • Job type: Permanent
  • Showed: 2021-11-29
  • Deadline: 2022-01-25
  • Category: Software/QA/DBA/etc