Data Engineer

08 Mar 2025

Vacancy expired!

Title: Sr. Data Engineer

Location: McLean, VA (Hybrid) - 3 days onsite

Duration: 6 months (Possible extension)

Position Overview:Our client is currently seeking a Senior Data Engineer to implement data processing and ingestion of structured and semi-structured data as a member of the Innovation in Data Engineering and Analytics (IDEA) team.

Responsibilities include:Cleanse, manipulate and analyze large datasets (Semi-Structured and Unstructured data XMLs, JSONs, CSVs, PDFs) using python and Snowflake database.Develop Python scripts to filter/cleanse/map/aggregate data.Manage and implement data processes (Data Quality reports).Develop data profiling, deduping logic, matching logic for analysis.Programming Languages experience in Python, PySpark and SQL for data ingestion.Present ideas and recommendations on data handling and data parsing technologies to management.

Required Skills5+ years of experience in processing large volumes and variety of data (Structured and semi-structured data, writing code for parallel processing, shredding XMLS, JSONs and reading PDFs).3+ years of programming experience in Python for data processing and analysis.Strong SQL experience is a must.2+ years of programming experience in PySpark for data processing and analysis.2+ years of experience with Snowflake, preferable parsing JSON and XML filesDetail oriented. Excellent communication skills (verbal and written).Must be able to manage multiple priorities and meet deadlines.

“Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of – Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.”

  • ID: #49430610
  • State: Virginia Mclean 22102 Mclean USA
  • City: Mclean
  • Salary: $70 - $75
  • Job type: Contract
  • Showed: 2023-03-08
  • Deadline: 2023-05-02
  • Category: Et cetera