Sr. Data Engineer

Keanesoft
New york city, NY
10 Jun 2024

Vacancy expired!

Client: Morgan Stanley

Position: Sr. Data Engineer

Location: Lower Manhattan, NY (Must be at onsite starting from July first week)

Duration: 12+ Months

Job Description aria-hidden="true" We are looking for a Senior data engineer. Role requires taking ownership for end-to-end delivery in an Agile team setting. He/she will interact directly with the users and with other technologists across the firm to build requisite framework and application development for the strategic Settlement platform renovation multi-year initiative. If you have a track record of data modelling, implementing high volume data pipelines and building business intelligence, we would like to meet you.

Skills

Required:
  • 5-14 years of experience in ADF, Azure SQL, Azure Databricks , Python, any one of Teradata/Redshit/Greenplum/Snowflake , Spark/Kafka
  • The candidate will be working in the team as a data engineer building data pipeline solutions along with Enterprise Data Warehouse and Azure Data Lake solutions in cloud with the above skill set.
  • He should have good experience with relational SQL including Postgres/DB2/Azure SQL/Snowflake/SparkSQL etc.
  • Experience building and optimizing ‘big data’ data pipelines, architectures and data sets using big data tools: ADF, Spark, Kafka, Azure Databricks etc is a big plus.
  • Experience with data modelling of relational and dimensional data models
  • Experience in Multi-Parallel Processing (MPP) database or Teradata/Redshift/Greenplum/Azure Synapse/Snowflake is a big plus.
  • Good analytical, problem solving, communication and interpersonal skills.
  • Self-motivated and ability to work consistently and efficiently to achieve end goals.
  • Interest in learning the business functionality
  • Experience supporting and working with cross-functional teams in a dynamic environment
  • Skilled in identifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Experience in building processes supporting data transformation, data structures, metadata, dependency and workload management.
  • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.

Skills Desired:
  • ADF, Azure SQL, Python, Any one of Teradata/Redshit/Greenplum/Snowflake , Data Engineering, Either of Spark/Kafka”, Azure Databricks
  • ID: #42733207
  • State: New York New york city 10001 New york city USA
  • City: New york city
  • Salary: $60 - $65
  • Job type: Contract
  • Showed: 2022-06-10
  • Deadline: 2022-08-06
  • Category: Et cetera