Vacancy expired!
Please note this is a 12 month contract position. Telework for this position will be available, but this individual will need to live within the greater DC area as they will be required to come into the office at least 2 days every 2 weeks. We are seeking a Data Engineer to provide expert level advice in the application of a wide set of statistical, programming, and/or engineering disciplines for planning, design, analysis, and specification development for systems and databases, and data models and pipelines to support the end-user analysis process. Position Description• The employee provides expert level advice in the application of a wide set of statistical, programming, and/or engineering disciplines for planning, design, analysis, and specification development for systems and databases, and data models and pipelines to support the end-user analysis process• Makes recommendations of data storage and retrieval, data workflow automation processes, end-user Business Intelligence tools, design, quality assurance standards, and performance standards, as well as determining the benefit of tradeoffs in the recommended options• Identifies and documents customer requirements when on-boarding new data assets for data analysis and data science work• Works with RISC and CIO to build and maintain data infrastructure for the optimal extraction, transformation, and loading of data• Defines and communicates data architecture requirements, keeping current with data management best practices• Maintains data management systems and participates in the design and development of new data pipelines• Researches internal and external data sources for new data and improved sources of data feeds• Researches key technologies and platforms, integration best practices and incorporation of third-party APIs and open source/reusable components• Provides recommendations and guidance related to data integration strategy to meet future reporting and analytic needs• Collaborates with data owners to establish data quality rules and definitions and implements the data quality rules in data management system• Makes recommendations for process improvements to support data integrity efforts• Supports the development of automated solutions which enhance the quality of enterprise data• Monitors jobs for failure and performance bottlenecks and resolves issues as needed• Utilizes lean and agile software development practices such as test-driven development, refactoring, continuous integration, and simple design to create quality, reusable codePosition Requirements• MUST have a Bachelor's Degree from an accredited college or university• Must have at least 3 years of specialized experience in building and maintaining data pipelines in cloud-based tools such as Azure Databricks, Azure Data Lake, or similar platforms• Expert technical knowledge of database structure systems, data models and performance tuning, data mining, data warehousing, and segmentation techniques• Expert level skill in application/data development including Python, SQL, Java, etc.• Ability to work with a variety of data sources including flat files, relational databases, Software-as-a-Service (SaaS) applications and web sites using techniques including direct connections (JDBC/ODBC), REST APIs and web scraping• Ability to work collaboratively across teams• Skill applying agile engineering practices• Ability to manipulate both structured and unstructured data in a data analytics environment using tools such as SQL and related technologies (SSRS/SSIS), Python, Databricks or Apache Spark, Azure data storage and data movement/transformation technologies (Azure Data Lake)• Experience with automation and DevOps practices• Ability to use open-source tools, cloud computing, machine learning, and data visualization• Ability to communicate effectively verbally and in written form, with both technical and non-technical staff• Ability to work in an organized fashion, completing tasks timely while paying attention to details• Skill configuring and using a metadata management tool (e.g., Collibra, Informatica, etc.)• Skill creating presentations using PowerPoint and data visualization software (e.g., Power BI, Tableau, Excel, i2, etc.)• Skill applying numerical and analytical analysis to solve problems Applicants must include their telephone number. Reference job number A1865.