Senior Data Engineer - Hadoop / ETL / Python - Commercial Domain

20 Feb 2025

Vacancy expired!

This role follows a hybrid work schedule; offering the flexibility to work remotely two days a week, while providing the opportunity for onsite and in person collaboration the other three days.

This position is available in either Buffalo, NY or Wilmington, DE

About the Team

Our team is on a mission of unleashing the power of data to support decision making. Our team builds enduring data products, provides platforms to access & derive insights from data, enables confidence in decision making with appropriate data governance, delivers actionable insights through use of data science and activates value for the business by innovatively solving problems with data. We love translating data, insights, and anecdotes into action, we operate with a sense of urgency, have a startup mentality, build data analytic products at scale, and innovate solutions on behalf of our customers. We work hard but value the need for downtime to unplug and recharge. We embrace our differences and view them as a key driver of innovation. We are Data@M&T

Role Overview:

This team transforms data assets into business insights by delivering information for consumption thru the building of data pipelines that contain Data processing, Data Enrichment, Data Storage, Data Provisioning/Consumption, Data Archival, Data Quality, Data Lineage, Data Security, and other related capabilities.

Area(s) of Focus: All Success with Rely on Cross Group Communication and Planning
  • Improve Cross Domain Solutions: Reduce duplicated solutions and cost while improving cross domain communication and collaboration.
  • Realize Business Needs: Assess future Domain needs and work closely with other groups to bring those needs to realization.
  • Development Efficiency: Provide business with a competitive edge by improving our speed to market and cost to deliver.
  • Domain Migration to Cloud: Working with the Cloud & Modernization group the Domains will need to Scope, Size and Plan their Migration to Cloud.
  • Modernizing Code and Designs: Fully Automated Deployments for ALL changes, Improved Defensive Coding, Automated Testing, Automated Code Scanning, and More.
  • Enable Business Agility: Designs and Solutions focusing on enabling the business for rapid change, enabling agility while operating in control.

The successful candidate will have:
  • Minimum of an Associate degree and 6 years' systems analysis/application development experience, or in lieu of a degree, a combined minimum of 8 years' higher education and/or work experience
  • Experience with Agile Methodology
  • An ability to build out data products & product enhancements from idea through to launch
  • Strong collaboration with technology partners and customers on feature requirements and prioritization
  • A team player mindset with an ability to thrive and effectively communicate in a fast-paced, constantly evolving environment

Tech Stack:
  • Hadoop
  • ETL
  • Python
  • Strong SQL knowledge
  • Informatica
  • SSIS
  • Azure

Required Technology skills
  • In-Depth Knowledge of SQL and Other Database Solutions - preferable in Hadoop
  • Experience in big-data technologies, such as: Hive, Impala, Kudu
  • Informatica (or equivalent) tools: PowerCenter, BDM, Big Data Manager, Data Quality
  • Experience in Unix/Linux operating systems, with scripting expertise
  • Programming skillsets in at least one of these languages: Java, Scala, Python
  • CA atomic or equivalent job scheduling tool experience

Preferred Technology skills
  • Cloud computing (Azure, AWS)
  • Hadoop SQL Tuning and Partitioning Strategies
  • Experience working with multiple file structures - Mainframe, Flat files, Json, XML's

Preferred Other skills:
  • Agile (such as JIRA), Source code repository (Git, Bitbucket, etc.) CI/CD tools (Jenkins, Teamcity, etc.)

Company:

At M&T Tech, we're a team of makers, doers, and builders, working to create the most advanced technology solutions in banking. We're not your stereotypical suit and tie bankers: We're an innovative team of leading tech experts, pushing boundaries, and taking risks. We're building an agile team of the most skilled and creative, workers to solve complex problems, architecting solutions, writing high-performance software, and charting our new path, all to make the lives of our customers, and the communities that we serve, better. Join us and be part of something new as we build tomorrow's bank, today.

M&T Bank is a Top 20 US bank holding company and one of the best performing and financial stable regional banks in the country, we offer our technology employees a wide range of performance-based career development opportunities. We have a strong commitment to our customers and the communities we serve, and we continue to grow with a focus on the future. So, when looking to advance your career, look to M&T. Grow with us.

Hiring Immediately.

We support our team members with generous benefits.
  • Competitive compensation
  • Health, welfare, and retirement benefits
  • 401(k) match at 5%
  • Work-life balance and flexible work arrangements
  • Start with 25 days PTO plus 12 paid holidays

#DataEngineer #EDS #EnterpriseDataServices #Engineer #Data #Bigdata #SoftwareEngineer #hadoop #etl #python #azure #LI-KB1 #Dice

Location Buffalo, New York, United States of America

  • ID: #49313175
  • State: New York Buffalo 14201 Buffalo USA
  • City: Buffalo
  • Salary: USD TBD TBD
  • Job type: Permanent
  • Showed: 2023-02-20
  • Deadline: 2023-04-20
  • Category: Et cetera