Data Engineer

14 Mar 2025

Vacancy expired!

Data Engineer

Owings Mills, MD 21117: Locals Only!

6 + Months

Onsite Day 1: Hybrid Role: 2-3 Days Onsite Per Week!

Top Skillsets/Job Description:This position will focus on developing various database and data loading/transformation efforts.Initiatives could include multiple source files and/or files sourced both internally and externally.Candidate is required to interact with databases using AWS Lambda, AWS Glue (for transformations) Python and Spark.Possible work leveraging SnapLogic for ETL, depending upon use case. Work will be applicable to multiple applications.Knowledge of automated testing of data a plus.

Responsibilities:Design and built systems for analytical reporting.Analyze data and design ETL frameworks using Python and Spark technologies.Collaborate with business partners to gather requirements and translate that to technical specifications.Adhere to lean agile methodologies.Production Support including trouble shooting and problem-solving capabilities.Implement data pipelines to meet business requirements and adhere to best practices.

Required Skills:Proficient in Python, Spark, and database technologiesExperience with various AWS services like AWS Glue, IAM, RDS, S3, SQS, SNS, Lambdas, Cloud Formation, Cloud Watch, Event Bridge, CLIExperience with Unix/LinuxExperience with SQLExperience with source code control, preferably Git.Experience in CI (Continuous Integration)/ CD (Continuous Delivery) software development pipeline stages like Commit, Build, Automated Tests, and Deploy

Desired Skills: Experience in creating AWS Glue components - Jobs, Triggers, WorkflowsExperience with AWS CLIExperience working with databases such as Snowflake and/or Aurora.Experience with Hashicorp tool suite - Terraform, VaultExperience with soap and rest services.Experience working with XML, JSON, YAMLExperience with logging tools such as CloudWatch and Splunk.

Digital Intelligence Systems, LLC (DISYS) is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.

  • ID: #49471621
  • State: Maryland Owingsmills 21117 Owingsmills USA
  • City: Owingsmills
  • Salary: USD TBD TBD
  • Job type: Contract
  • Showed: 2023-03-14
  • Deadline: 2023-05-11
  • Category: Et cetera