BigData Developer

09 Jun 2024

Vacancy expired!

Role :- BigData Pyspark Developer

Location- Tampa, FL / Irving, TX Job Description :-

Between 5-10 years of IT experience

Have experience for Big Data technologies like PySpark, Hadoop, MongoDB, etc

Have worked on multiple Databases and have knowledge regarding capacity and performance management

Have good knowledge of data quality process and worked on data quality product like Informatica DQ

Experience in Java programming and API programming Competencies:

Ability to take end to end ownership and be multi tasker

Ability to work effectively within cross functional teams

Strong understanding of technology concepts and best practices

An innovative frame of mind - open to learning new technologies and techniques

Verbal and Written communication skills - primarily the ability to communicate ideas, standards and technical details to the development partnersStrong exposure in below areas Hadoop core ,Linix commands Name nodes, Secondary NEM nodes Hive Joining PySprak - Data sets ,Data formats, Data Python - Language

Complete Understanding of PYspark architecture, Good in Python Should have experience in Spark lineage creation and error handling.Must have hands on Experience in Spark performance tuning and optimization techniques. Must have hands on experience in Object and functional programming in Scala Should have worked on Parallel processing, Tasks, Stages. Leading the charge on a data lake store strategy, while ensuring rapid delivery while taking responsibility for applying standards, principles, theories, and concepts. Designing and delivering of data models, which power BI initiatives, dashboards, syndicated reporting, and ad-hoc data exploratory canvases for client solutions. Working with data architects on the logical data models and physical database designs optimized for performance, availability and reliability. Responsible for tuning and optimization of backend and frontend data operations. Designing and developing ETL and master data management processes. Scripting and automation to support development, QA and production database environments and deployments to production. Maturing the continuous integration and continuous deployment methodologies. Mentoring development team members. Keeping management informed of work activities and schedules. Assessing new initiatives to determine the work effort and estimating the necessary time to completion.

  • ID: #42664417
  • State: Texas Irving 75014 Irving USA
  • City: Irving
  • Salary: Depends on Experience
  • Job type: Permanent
  • Showed: 2022-06-09
  • Deadline: 2022-07-26
  • Category: Et cetera