Vacancy expired!
- 6-8 years of financial solutions architecture, software development, data engineering, data science or business intelligence engineering experience with minimum 3 Years recent hands-on experience in PySpark
- 3+ year of experience with Machine Learning code development
- Deep knowledge of Hadoop ecosystem and Big Data technologies such as Spark, Hive, HBase, Oozie, Kafka, YARN, SLURM
- Spark query tuning and performance optimization
- Experience and good understanding of Apache Spark Data sources API
- Advanced experience in Python and common python libraries/ Scala/ Java
- Strong analytical experience with database in writing complex queries, query optimization, debugging, user-defined functions, views, indexes, etc.
- Strong working experience with source control systems such as Git, Bitbucket, and Jenkins build and continuous integration tools.
- Experience working with Microservices, Rest API and Oauth
- Experience working with one or more Agile development methods
- proven consulting and delivery leadership in data transformation, data modeling, data analytics, data visualization and/or data science
- 2+ years of experience with a public cloud (AWS, Microsoft Azure)
- 4+ years of experience with NoSQL implementation (Mongo, Cassandra)
- 1+ year of experience with process orchestration including AirFlow, KubeFlow
- Databricks Experience.
- Data lake and Delta lake experience
- Familiarity with Metadata Management, Data Quality frameworks and Data as a Service concepts a big plus
- Banking or financial services experience is a big plus
- Bachelor's degree in Computer Science, Engineering, Statistics or other quantitative subject
- Demonstrated leadership abilities with track record of driving results through cross-functional organization
- Ability to manage multiple projects with tight timelines
- Highly motivated, self-directed
- Strong analytical and problem-solving skills, written and verbal communication skills, and project management skills
- ID: #49440708
- State: Pennsylvania Pittsburgh 15206 Pittsburgh USA
- City: Pittsburgh
- Salary: USD TBD TBD
- Job type: Permanent
- Showed: 2023-03-10
- Deadline: 2023-05-07
- Category: Et cetera