Spark Data Engineer

Arthur Lawrence
Philadelphia, PA
06 Aug 2024

Vacancy expired!

Arthur Lawrence is looking to hire a Spark Data Engineer for one of our clients in Philadelphia, PA. Please review the job description below for your understanding and if found suitable, then please send us your updated resume. As of now, it is remote until covid subsides.

Core Requirements:
  • 8+ years of experience in Data Engineering with development in Spark, Scala & Kubernetes
  • Strong experience with Spark batch and streaming with Kubernetes
  • Prior experience with networking on AWS with VPC, Subnets, ACLs, Routing
  • Experience with AWS Compute Services like Glue, EMR & Data Bricks, and big data tools like Hortonworks / Cloudera.
  • Experience in application deployment by using CI/CD
  • Experience with Jira (Scrum/Kanban board/Ticketing), Scheduling tools/UC4, Python, SQL, and RDMS
  • Working knowledge of Spark/Spark SQL - Spark Core, Spark SQL, Data Frames, Spark Streaming, Driver Node, Worker Node, Stages, Executors, and Tasks in Data bricks for ETL.

Qualification:
  • Relevant educational background & professional certifications would highly be appreciated.

About Us: Arthur Lawrence is a management and technology consulting firm providing enterprise-wide business transformation and business applications implementation services. Our in-depth technical knowledge and broad experience of working with world-class companies enable organizations to leverage our capabilities in developing winning strategies and cost-effective solutions. We are a UN Women Empowerment Principal Signatory and are certified by National Minority Supplier Development Council.

Acknowledgements from Industry Peers:
  • Winner of Entrepreneur 360 Award (2019).
  • IAOP Award; Ranked in top 100 internationally.
  • Arthur Lawrence ranked within the Inc 5000 twice in 2016 and 2017 as one of the fastest. Growing companies of America.
  • Named one of the top ten fastest growing businesses in Houston in 2016.
  • Ranked 25th in the HBJ s Fast 100 Private Companies Award in 2017.

Our Seven Pillars: We rely on the seven core values that we believe enable us to deliver quality for our consultants and clients: Education, Integrity, Value Creation, Collaboration, Best Client, Best People and Stewardship. Through strict adherence to these core values, we have achieved success beyond all documented forecasts and anticipation.