Lead Data Engineer

28 Apr 2024

Vacancy expired!

KORE1, a nationwide provider of staffing and recruiting solutions, has an immediate opening for "Lead Data Engineer".

PURPOSE OF THE JOB This role will provide strong leadership in developing the Enterprise data architecture of Digital and Retail businesses across different guitar Center brands, providing technical guidance, architecture and enforcing technical standards. Provides assessments and prototyping of new concepts and technologies and often develop capabilities to be handed off to operational development teams. Provides analysis on complex problems as well as be an active member of enterprise technology design decisions. RESPONSIBILITIES/DUTIESAccountable for modernization, migration/transformation to a cloud data platformDesign and build reliable, scalable data infrastructure with leading privacy and security techniques to safeguard data using AWS technologies.Architect scalable, secure, low latency, resilient and cost-effective solutions for enabling predictive and prescriptive analytics across the organization.Design/ Architect frameworks to Operationalize ML models through serverless architecture and support unsupervised continuous training models.Take over and scale our data models (Tableau, Dynamo DB, Kibana)Communicate data-backed findings to a diverse constituency of internal and external stakeholders.Build frameworks for data ingestion pipeline both real time and batch using best practices in data modeling, ETL/ELT processes and hand off to data engineers.Participate in technical decisions and collaborate with talented peers.Review code, implementations and give meaningful feedback that helps others build better solutions.Helps drive technology direction and choices of technologies by making recommendations based on experience and research.

MINIMUM REQUIREMENTS & SPECIAL ATTRIBUTES10 or more years of experience working directly with enterprise data solutions.Hands on experience working in a public cloud environment and on-prem infrastructure.Hands on experience with Sage Maker, Jupiter Notebook, Tensor flow, Kubeflow, Airflow like platforms is requiredExperience with NLP models, Churn, Retention and Anomaly detection models is required.Specialty on Columnar Databases like Redshift Spectrum, Time Series data stores like Apache Pinot and the AWS cloud infrastructureExperience with in-memory, serverless, streaming technologies and orchestration tools such as Spark, Kafka, Airflow, KubernetesCurrent hands-on implementation experience required, possessing 7or more years of IT platform implementation experience.AWS Certified Big Data - Specialty desirable.Experience designing and implementing AWS big data and analytics solutions in large digital and retail environments is desirable.Advanced knowledge and experience in online transactional (OLTP) processing and analytical processing (OLAP) databases, data lakes, and schemas.Experience with AWS Cloud Data Lake Technologies and operational experience of Kinesis/Kafka, S3, Glue and Athena.Experience with any of the message / file formats: Parquet, Avro, ORCDesign and development experience on a Streaming Service, EMS, MQ, Java, XSD, File Adapter, and ESB based applications.Experience in distributed architectures such as Microservices, SOA, RESTful APIs and data integration architectures.Hands on experience migrating On-Prem Data solutions to cloud.Prior experience managing On-prem Enterprise Data Warehouse solutions like Netezza is a plus.Experience with a wide variety of modern data processing technologies, including.Big Data Stack (Spark, spectrum, Flume, Kafka, Kinesis etc.)Data streaming (Kafka, SQS/SNS queuing, etc.)Expert in Columnar databases primarily, Redshift or like technologies lile Snowflake, FireboltExpert in Commonly used AWS services (S3, Lambda, Redshift, Glue, EC2, etc)Expertise in Python, pySpark or similar programming languages is a must have.BI tools (Tableau, Domo, MicroStrategy) are a plus.Skilled in AWS Compute such as EC2, Lambda, Beanstalk, or ECSSkilled in AWS Management and Governance suite of products such as CloudTrail, CloudWatch, or Systems ManagerSkilled in Amazon Web Services (AWS) offerings, development, and networking platformsSkilled in AWS Analytics such as Athena, EMR, or GlueProficiency in Oracle, MYSQL and Microsoft SQL Server Databases is a plus.Understanding Continuous Integration / Continuous Delivery with experience in Jenkins ABOUT KORE1 Specializing in professional and technical recruiting, KORE1 is committed to supporting top IT, Engineering, Creative, Scientific, Accounting and Finance professionals in their career paths. We build deep relationships with leading companies, connecting them to exceptional talent every day. With extensive industry expertise and unmatched opportunities, our goal is to provide a unique experience for our contractors and consultants as they prepare for their next role. We are passionate about matching the right people with the right companies. Kore1 provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, Kore1 complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training. Kore1 expressly prohibits any form of workplace harassment based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status. Improper interference with the ability of Kore1's employees to perform their job duties may result in discipline up to and including discharge.

  • ID: #49817590
  • State: California Westlakevillage 91362 Westlakevillage USA
  • City: Westlakevillage
  • Salary: Market
  • Job type: Contract
  • Showed: 2023-04-28
  • Deadline: 2023-06-26
  • Category: Et cetera