Senior Cloud Data Engineer

KORE1
Thousandoaks, CA
28 Apr 2024

Vacancy expired!

KORE1, a nationwide provider of staffing and recruiting solutions, has an immediate opening for "Senior Cloud Data Engineer".

PURPOSE OF THE JOB This role is a highly visible and value driven individual contributor role, providing data infrastructural help for fellow analysts and data scientists as well as operationalizing ML models at scale integrated to customer facing applications. Chosen candidate will be hands on developing Deep learning models, Holtz Winters anomaly detection models, Classification and Regression models as well as operationalizing them as unsupervised continuous learning models. Model outcomes will be pushed into Timeseries data stores like Apache Pinot for quick rendering and REST API end points. Candidate should be SQL savvy, self-sufficient in handling large volumes of data as well as excellent data visualization capabilities using Tableau or like solutions. RESPONSIBILITIES/DUTIESDesign and build reliable, scalable data infrastructure with leading privacy and security techniques to safeguard data using AWS technologies.Design and build scalable, secure, low latency, resilient and cost-effective solutions for enabling predictive and prescriptive analytics across the organization.Design/ Architect frameworks to Operationalize ML models through serverless architecture and support unsupervised continuous training models.Take over and scale our data models (Tableau, Dynamo DB, Kibana)Experience in shipping low-latency massive scale systems to productionCommunicate data-backed findings to a diverse constituency of internal and external stakeholders.Build frameworks for data ingestion pipeline both real time and batch using best practices in data modeling, ETL/ELT processes and hand off to data engineers.Participate in technical decisions and collaborate with talented peers.Review code, implementations and give meaningful feedback that helps others build better solutions.Helps drive technology direction and choices of technologies by making recommendations based on experience and research.

MINIMUM REQUIREMENTS & SPECIAL ATTRIBUTES5 or more years of experience working directly with enterprise data solutions.Hands on experience working in a public cloud environment and on-prem infrastructure.Specialty on Columnar Databases like Redshift Spectrum, Time Series data stores like Apache Pinot and the AWS cloud infrastructureExperience with in-memory, serverless, streaming technologies and orchestration tools such as Docker, Spark, Kafka, Airflow, Kubernetes is needed.Excellent SQL skills and Python coding are a must.Current hands-on implementation experience required, possessing 5or more years of IT platform implementation experience.AWS Certified Big Data - Specialty desirable.Experience designing and implementing AWS big data and analytics solutions in large digital and retail environments is desirable.Advanced knowledge and experience in online transactional (OLTP) processing and analytical processing (OLAP) databases, data lakes, and schemas.Experience with AWS Cloud Data Lake Technologies and operational experience of Kinesis/Kafka, S3, Glue and Athena.Experience with any of the message / file formats: Parquet, Avro, ORCDesign and development experience on subscribing to a Streaming Service, EMS, MQ, Java, XSD, File Adapter, and ESB based applications.Experience in distributed architectures such as Microservices, SOA, RESTful APIs and data integration architectures is a plus.Hands on experience migrating On-Prem Data solutions to cloud.Prior experience managing On-prem Enterprise Data Warehouse solutions like Netezza is a plus.Experience with a wide variety of modern data processing technologies, including.Big Data Stack (Spark, spectrum, Flume, Kafka, Kinesis etc.)Data streaming (Kafka, SQS/SNS queuing, etc.)Expert in Columnar databases primarily, Redshift or like technologies like Snowflake, FireboltExpert in Commonly used AWS services (S3, Lambda, Redshift, Glue, EC2, etc.)Expertise in Python, spark or similar programming languages is a must haveBI tools (Tableau, Domo, MicroStrategy) are a plus.Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECSSkilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems ManagerSkilled in Amazon Web Services (AWS) offerings, development, and networking platformsSkilled in AWS Analytics such as Athena, EMR, or GlueProficiency in Oracle, MYSQL and Microsoft SQL Server Databases is a plus. ABOUT KORE1 Specializing in professional and technical recruiting, KORE1 is committed to supporting top IT, Engineering, Creative, Scientific, Accounting and Finance professionals in their career paths. We build deep relationships with leading companies, connecting them to exceptional talent every day. With extensive industry expertise and unmatched opportunities, our goal is to provide a unique experience for our contractors and consultants as they prepare for their next role. We are passionate about matching the right people with the right companies. Kore1 provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, Kore1 complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training. Kore1 expressly prohibits any form of workplace harassment based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. Improper interference with the ability of Kore1's employees to perform their job duties may result in discipline up to and including discharge.

  • ID: #49817529
  • State: California Thousandoaks 91362 Thousandoaks USA
  • City: Thousandoaks
  • Salary: $135,000 - $150,000 /yr
  • Job type: Contract
  • Showed: 2023-04-28
  • Deadline: 2023-06-26
  • Category: Et cetera