Pyspark Developer

11 Feb 2025

Vacancy expired!

InfoTech Spectrum - A trusted partner (;/u>

At InfoTech Spectrum, we connect top talent and leadership across North America with top-performing Fortune 500 and global corporations. As a leading provider of IT & Professional Staffing, Executive Search and Contingent Workforce Solutions since 2003, it is our passion to dig deep into your business goals and connect you with the best people to make those goals reality. Consistently recognized as a top talent acquisition solutions company, we thrive on supporting our partners with their own business growth.We have an Immediate Need of

Pyspark Developer with one of our Direct

Alpharetta, GA(Initial Remote) the details for the position are as follows:

Job Description:
  • Databricks, Pyspark and Python project development work experience is a must
  • Expertise in Bigdata Eco systems like HDFS and Spark
  • Experience in GitHuB repository
  • Data Warehouse/Data Marts/Data Modeling/Analytics experience is a must
  • Able to convert the SQL stored procedures to Python code in Pyspark frame work using Dataframes.
  • Develop, design, tune and maintain SSIS packages to perform the ETL process.
  • Design and develop SQL Server stored procedures, functions, views and triggers to be used during the ETL process.
  • SQL SERVER development work experience with relational databases and knowledge is a must
  • Development of Stored Procedures for transformations in ETL pipeline
  • Worked with large datasets in T-SQL batch processing
  • Should have work experience in Agile projects
  • Write scripts for automated testing of data in the target facts and dimensions.
  • Capture audit information during all phases of the ETL process.
  • Write and maintain documentation of the ETL processes via process flow diagrams.
  • Collaborate with business users, support team members, and other developers throughout the organization to help everyone understand issues that affect the data warehouse
  • Good experience on customer interaction is required.
  • Possesses good interpersonal and communication skills.
(Please revert with your updated profile to (

shalini@infotechspectrum. com) or please refer someone if is not of your interest. )

Regards,

Shalini Singh/p>

  • ID: #49149399
  • State: Georgia Alpharetta 30004 Alpharetta USA
  • City: Alpharetta
  • Salary: $0 - $0
  • Job type: Contract
  • Showed: 2023-02-11
  • Deadline: 2023-03-21
  • Category: Et cetera