SV IT is looking for Big Data Developers to work in Plainview, NY and various unanticipated locations throughout the U.S. Must possess Master's degree in Applied Computer Science or related field and exp. in designing, coding, testing and debugging Big Data Applications; Building and providing SQL scripts, Designing and scheduling custom Talend jobs in Hadoop Ecosystem; Use of Hive and Pig. Send resumes to info@svitinc.net, REF# 1984.055.Job Duties:Designing, coding, testing and debugging different types of Big Data applications; Designing and building data flows using to capture data from different sources in accordance with business requirements and direction; Designing and scheduling data jobs to acquire, ingest, enrich and distribute the data in datalake or data warehouse environments; Creating internal/external tables, dynamic partitions, compressions for increasing the efficiency of data retrieval; Developing Big Data solutions on clouds such as Azure and Amazon AWS by building pipelines for data retrieval from sources into cloud environments; Setting data engineering best practices for ingesting, enriching and provisioning of new data sets; Contribute towards Schema Design and Implementation by building and providing SQL scripts and maintaining the data pipelines to deliver data to the business partners at right times; Analyzing new sources of data to ensure completeness and ability to map them to existing data warehouse structures; Developing error handling frameworks to handle system/data level failures and storing the logs; Designed and developed batch-level/streaming jobs handling TB’s of data and fine-tuning the flows for optimal performance; Facilitate information gathering and structured documentation for all the defined use cases within the project; Fine tuning existing structures/designs to improve the overall performance and attain more efficient data solutions; designing, coding, testing and debugging Big Data Applications; Building and providing SQL scripts, Designing and scheduling custom Talend jobs in Hadoop Ecosystem; Use of Hive and Pig. Position may require travel.Minimum Requirements:Education:Master's Degree in Applied Computer Science or related field.Experience:6 months experience in the position offered or related position.Special Requirements:Aforementioned 6 months of experience must include the following skills:designing, coding, testing and debugging Big Data Applications; Building and providing SQL scripts, Designing and scheduling custom Talend jobs in Hadoop Ecosystem; Use of Hive and Pig.
Full-time