Data Engineer III

17 Jul 2024
Apply

The Data Engineer III plays a pivotal role within Dataworks, focused on driving engineering innovation within Dataworks, helping define and build the Dataworks organization and leading the delivery of key business initiatives. S/he acts as a “universal translator” between IT, business, software engineers and data scientists, collaborating with these multi-disciplinary teams. The Data Engineer III will contribute to the adherence of technical standards for data engineering, including the selection and refinements of foundational technical components. S/he will work on those aspects of the Dataworks platform that govern the ingestion, transformation, and pipelining of data assets, both to end users within FedEx and into data products and services that may be externally facing. Day-to-day, s/he will be deeply involved in code reviews and large-scale deployments. S/he will also provide mentorship and guidance to junior engineers to support the continued training and up-skilling of the Data Engineering team.Under limited supervision, supports the design, build, test and maintenance of data pipelines at big data scale. Assists with updating data from multiple data sources. Other functionalities under limited supervision include working on batch processing of collected data and matching its format to the stored data, making sure that the data is ready to be processed and analyzed. Assists with keeping the ecosystem and the pipeline optimized and efficient, troubleshooting standard performance, data related problems and providing L3 support. Implements ETL transformers to reformat and enhance the data. Provides recommendations to complex problems. Provides guidance to those in less senior positions.Understanding in depth both the business and technical problems Dataworks aims to solveBuilding tools, platforms and pipelines to enable teams to clearly and cleanly analyze data, build models and drive decisionsScaling up from “laptop-scale” to “cluster scale” problems, in terms of both infrastructure and problem structure and techniqueDelivering tangible value very rapidly, collaborating with diverse teams of varying backgrounds and disciplinesChampioning the adherence to best practices for future reuse in the form of accessible, reusable patterns, templates, and code basesInteracting with senior technologists from the broader enterprise and outside of FedEx (partner ecosystems and customers) to create synergies and ensure smooth deployments to downstream operational systemsDesign, implement and optimize ETL processes, data ingestion, and integration workflows on cloud environments Implement best practices for data management, including data quality and security.Implement cloud-based data storage solutions, leveraging technologies for performance and cost efficiency Identify opportunities for automation and process improvement within the data engineering workflow.Stay updated with emerging technologies and trends in data engineering to enhance our systems and processes.Minimum EducationBachelor’s Degree in Information Systems, Computer Science or a quantitative discipline such as Mathematics or Engineering and/or equivalent formal training or work experience.Minimum ExperienceThree to Four (3 - 4) years equivalent work experience in measurement and analysis, quantitative business problem solving, simulation development and/or predictive analytics. Extensive knowledge in data engineering and machine learning frameworks including design, development and implementation of highly complex systems and data pipelines. Extensive knowledge in Information Systems including design, development and implementation of large batch or online transaction-based systems. Strong understanding of the transportation industry, competitors, and evolving technologies. Experience providing leadership in a general planning or consulting setting. Experience as a senior member of multi-functional project teams. Strong oral and written communication skills. A related advanced degree may offset the related experience requirements.Knolwedge, Skills and AbilitiesTechnical background in computer science, software engineering, database systems, distributed systemsFluency with distributed and cloud environments and a strong understanding of how to balance computational considerations with theoretical propertiesDetailed knowledge of the Microsoft Azure tooling for large-scale data engineering efforts and deployments is highly preferredA track record of designing and deploying large scale technical solutions, which deliver tangible, ongoing valueDirect experience having built and deployed robust, complex production systems that implement modern, data scientific methods at scaleAbility to context-switch, to provide support to dispersed teams which may need an “expert hacker” to unblock an especially challenging technical obstacle, and to work through problems as they are still being definedDemonstrated ability to deliver technical projects with a team, often working under tight time constraints to deliver valueAn ‘engineering’ mindset, willing to make rapid, pragmatic decisions to improve performance, accelerate progress or magnify impactComfort with working with distributed teams on code-based deliverables, using version control systems and code reviewsAbility to conduct data analysis, investigation, and lineage studies to document and enhance data quality and access quickly while adopting new and evolving technologies and apply to projects.Use of agile and devops practices for project and software management including continuous integration and continuous deliveryDemonstrated expertise working with some of the following common languages and tools:Spark (Scala and PySpark), HDFS, Kafka and other high volume data toolsSQL and NoSQL storage tools, such as MySQL, Postgres, Cassandra, MongoDB and ElasticSearchPandas, Scikit-Learn, Matplotlib, TensorFlow, Jupyter and other Python data toolsSolid understanding of data modeling, data architecture, and data management principles.Proven track record of solving complex problems and delivering high-quality, scalable solutions.Excellent communication and collaboration skills to work effectively in a team environment.Preferred Qualifications:Pay Transparency:Pay:Additional Details:Born out of FedEx, a pioneer that ships nearly 20 million packages a day and manages endless threads of information, FedEx Dataworks is an organization rooted in connecting the physical and digital sides of our network to meet today's needs and address tomorrow's challenges.We are creating opportunities for FedEx, our customers, and the world at large by:

Exploring and harnessing data to define and solve true problems

Removing barriers between data sets to create new avenues of insight

Building and iterating on solutions that generate value

Acting as a change agent to advance curiosity and performance

At FedEx Dataworks, we are making supply chains work smarter for everyone.Dataworks does not discriminate against qualified individuals with disabilities in regard to job application procedures, hiring, and other terms and conditions of employment. Further, Dataworks is prepared to make reasonable accommodations for the known physical or mental limitations of an otherwise qualified applicant or employee to enable the applicant or employee to be considered for the desired position, to perform the essential functions of the position in question, or to enjoy equal benefits and privileges of employment as are enjoyed by other similarly situated employees without disabilities, unless the accommodation will impose an undue hardship. If a reasonable accommodation is needed, please contact DataworksTalentAcquisition@corp.ds.fedex.com .

Full-time
  • ID: #52118835
  • State: Pennsylvania Kingofprussia 19406 Kingofprussia USA
  • City: Kingofprussia
  • Salary: USD TBD TBD
  • Showed: 2024-07-17
  • Deadline: 2024-09-16
  • Category: Et cetera
Apply