Etl Developer

Job Title: ETL Developer Location: 100% Remote Duration: 6 months Type: W2 (Full-time) Job Description Apache Spark, Java, Spring Boot, SQL, UNIX Client is looking for a highly skilled Apache Spark ETL Developer who has a proven track record delivering ETL solutions in the modern data lake environment. Developing ETL solutions in test driven development, continuous integration and continuous delivery. This role will be primarily responsible for developing application code to ingest, transform, and surface business data for analytical users that is optimal, efficient, performant, and maintainable. Developer will be required to: Build ETL pipes using Apache Spark Acquire data from primary or secondary data sources and maintain databases/data systems in the Data Bricks Delta Lake environment Utilize rules-based engine to process data as the result of business functions Filter and clean data by reviewing reports and performance indicators to locate and correct problems Work with management to prioritize business and information needs Document design and data flow for existing and new applications being built. Technical Skills: At least 4+ years of experience implementing complex ETL pipelines preferably with Spark toolset At least 4+ years of experience with Java particularly within the data space 4+ years of hands on experience with SQL/NoSQL databases -MongoDB, PostgeSQL Good experience writing complex SQL and ETL processes Technical expertise regarding data models, database design development, data mining and segmentation techniques Good understanding & usage of algorithms and data structures Good Experience building reusable frameworks Knowledge of UNIX shell scripting Strong written and verbal communication skills in English.