Data Engineer

13 May 2024

Vacancy expired!

Atyeti Recognition: Inc. 500 & 5000 Honoree Company for 2012,2013,2014,2015, 2016 and 2017Atyeti Ranks No. 270 on the 2012 Inc. 500 List2012, 2016 and 2017 NJ 50 Fastest Growing Companies

Global Investment Bank is looking to hire a Data Engineer for its team in

Newyork, NY location. This is a long term contract role.

Email:

Please contact:

REQUIRED SKILLS• Demonstrable experience designing and developing big data applications using Apache Spark and Airflow• Experience leveraging Databricks to develop Spark based applications along with very good understanding about data engineering capabilities provided by the service• Excellent Python programming skills and experience delivering projects using PySpark is a must. Scala programming experience is nice to have.• Experience designing and developing Airflow DAGs, Operators etc…• Experience leveraging Azure Storage and Data Lake Store Gen 2 in Azure based big data projects along with integration to other Azure Data services• Experience designing and developing real time data processing applications using Spark streaming, Kafka, Event Hub etc• Experience using Cloud data warehouse technologies such as Snowflake is highly desired• Must have expertise on RDBMS solutions such as Oracle, SQL Server, Azure SQL DB etc

  • ID: #40802108
  • State: New York New york city 10001 New york city USA
  • City: New york city
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2022-05-13
  • Deadline: 2022-07-11
  • Category: Et cetera