JAVA / Spark Engineer

Digipulse Technologies, Inc
Durham, NC
10 Feb 2025

Vacancy expired!

.) Java/Spark Engineer2.) Location: NC and WLK3.) What does team do: UAP would be the next generation platform to manage acquisition as a service through low code and config driven architecture.

UAP will also provide

• Configuration driven feed acquisition

• Configuration driven transformation of vendor data into canonical format

• Capability to compare data across vendors and generate gap reports

• Registry to maintain feed metadata

• Lineage to track usage

• Configuration driven distribution

As part of UAP (Unified Acquisition Platform) team you will be working on enhancing the next generation in-house acquisition platform using cloud technologies. UAP will be built using Java Spark and Python programming language and use AWS EMR as the infrastructure for execution. You would be developing lambda, Spark, Python utilities for managing end to end feed flow.

As part of UAP we will focus on building tools and capabilities to accelerate acquisition, compare data across vendors, externalize rules for data conversion, build inventory/registry of feeds and track lineage.

4.) Top Skills: 6+ years of Java Spark development experienceExperience in config driven codingExperience in developing generic framework/utilitiesMaven, Stash, Artifactory, CICD

5.) Nice to Haves: AWS LambdaSparkSQL knowledgeJenkins, ConcourseEKS

6.) Interview: 1 round
  • ID: #49126785
  • State: North Carolina Durham 27701 Durham USA
  • City: Durham
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2023-02-10
  • Deadline: 2023-04-10
  • Category: Et cetera