Principal Big Data Engineer - Azure Databricks (REMOTE)

Randstad Technologies
Lakeland, FL
04 Jul 2024

Vacancy expired!

job summary:

Responsibilities:

  • Analyzing and translating business requirements into technology solutions, performing data analysis by creating and executing complex queries, interpreting results, and communicating findings to both technical and non-technical audiences.
Required Qualifications

  • Bachelor's degree in Computer Science or other analytical discipline or equivalent experience
  • Minimum 9 years' experience with Data Engineering background with deep understanding of Databricks architecture and Data Lake Architecture
  • Minimum 9 years' experience in designing, developing, and supporting enterprise analytical applications in the cloud, preferably Azure
  • Minimum 9 years' experience with big data technologies IE Hadoop, Apache Spark, and/or Databricks
  • Minimum 3 years' experience developing distributed system in languages like Python, Scala, or PySpark
  • Minimum 3 years' experience with transporting data from enterprise systems to Azure using Azure Data Factory or Azure Databricks
  • Experience creating end to end data pipelines in Databricks using Databricks Notebooks, Databricks Jobs, Auto Loader, and Databricks Structured Streaming
Additional Required Qualifications

Preferred Qualifications

  • Apache Spark Certification
  • Azure Certification(s)
  • 7+ years' experience working with an enterprise database management system (e.g., SQL Server, Oracle
  • Experience deploying and automating data pipelines using Azure Databricks and Azure DevOps
  • Experience with web development in the .NET Framework

location: LAKELAND, Florida

job type: Permanent

salary: $150,000 - 190,000 per year

work hours: 8am to 4pm

education: Bachelors

responsibilities:

Required Qualifications

  • Bachelor's degree in Computer Science or other analytical discipline or equivalent experience
  • Minimum 9 years' experience with Data Engineering background with deep understanding of Databricks architecture and Data Lake Architecture
  • Minimum 9 years' experience in designing, developing, and supporting enterprise analytical applications in the cloud, preferably Azure
  • Minimum 9 years' experience with big data technologies IE Hadoop, Apache Spark, and/or Databricks
  • Minimum 3 years' experience developing distributed system in languages like Python, Scala, or PySpark
  • Minimum 3 years' experience with transporting data from enterprise systems to Azure using Azure Data Factory or Azure Databricks
  • Experience creating end to end data pipelines in Databricks using Databricks Notebooks, Databricks Jobs, Auto Loader, and Databricks Structured Streaming
Additional Required Qualifications

Preferred Qualifications

  • Apache Spark Certification
  • Azure Certification(s)
  • 7+ years' experience working with an enterprise database management system (e.g., SQL Server, Oracle
  • Experience deploying and automating data pipelines using Azure Databricks and Azure DevOps
  • Experience with web development in the .NET Framework

qualifications:

  • Experience level: Experienced
  • Minimum 8 years of experience
  • Education: Bachelors

skills:
  • Data Analysis
  • Hadoop (8 years of experience is required)
  • Azure Databricks (9 years of experience is required)
  • Python (3 years of experience is preferred)
  • SQL Server (7 years of experience is preferred)
  • Oracle (7 years of experience is preferred)
  • DevOps (3 years of experience is preferred)
  • Apache (9 years of experience is preferred)

    • Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

    At Randstad, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact HRsupport@randstadusa.com.

    For certain assignments, Covid-19 vaccination and/or testing may be required by Randstad's client or applicable federal mandate, subject to approved medical or religious accommodations. Carefully review the job posting for details on vaccine/testing requirements or ask your Randstad representative for more information
    • ID: #43827147
    • State: Florida Lakeland 33811 Lakeland USA
    • City: Lakeland
    • Salary: USD150,000 - USD190,000
    • Job type: Permanent
    • Showed: 2022-07-04
    • Deadline: 2022-09-01
    • Category: Et cetera