Vacancy expired!
Big Data Engineer (Big Data, Spark, Python, AWS, Nifi, Airflow) Location - Beaverton OR, ok with remote for now Need 8+ years experience Profiles without these skills will not be considered: Big Data, Spark, Python, AWS, Nifi, Airflow
- Good knowledge in Python/Apache Spark/Data Management Experience with relational SQL (Snowflake or Teradata or Oracle)
- Strong problem solving and analytical mindset
- Experience building scalable real time and high-performance cloud data lake solutions
- Hands on coder who understands the concepts behind distributed databases batch and stream processing
- Experience building and shipping data production pipelines sourcing data from a diverse array of sources
- Experience with Nifi and Airflow Experience working on NoSQL databases such as Hbase and DynamoDB
- Understanding on Rest API Ability to influence and communicate effectively with team members and business partners
- Experience with source control tools such as GitHub and related dev process
- Experience with workflow scheduling orchestration tools
- Hands-on experience of cleaning preparing and optimizing data for ingestion and consumption