Vacancy expired!
AWS Big Data Engineer with a strong knowledge of HadoopIntegrating multiple systems in the OSSPulling data from one system and pushing data to another systemBuilding connections between systemsWork with multiple applicationsManage the integration framework /Data pipelines for OSSSystems, APIs 5-7 years with Hadoop, Apache, KafkaOne of these is ok: Nifi, Kylo, Luigi (see Job description)Exp NoSQL DB, Postgres, Cassandra, snowflakeAWSOne of these is ok: EC2, EMR, VPC (see Job description)ScriptingLinux, TCP/IP, Agile NICE TO HAVECertification AWSBig data certificationWill build Big data pipelinePhilly preferred or same time zone /Good candidate is ok 100% remote
Qualifications: Minimum qualifications:• BS degree in Computer Science or related technical field• 5-7 year of experience working as data engineer/architect or similar role• Demonstrable experience with big data tools: Hadoop, Apache Spark, Kafka• Demonstrable experience with data pipeline and workflow management tools: NiFi, Kylo, Luigi, Airflow, Azkaban etc.• Exp with relational SQL, Snowflake and NoSQL databases, including Postgres and Cassandra• Exp with Amazon Web Services (AWS) (VPC, EC2, EMR, RDS, DynamoDB, Route 53, ELB, VPN, Direct Connect, CloudTrail, CloudWatch, S3, IAM, WAF, Lambda scripting with Python/Node.JS, Messaging, Kinesis, Glue, Redshift, etc.)• Experience with network monitoring and packet analysis tools• Experience working with Unix/Linux systems from kernel to shell and beyond, with experience working with system libraries, file systems, and client-server protocols.• Experience with network protocols e.g. TCP/IP, UDP, ICMP, etc., MAC addresses, IP packets, DNS, OSI layers, and load balancing.• Work in an agile environment, ability to write epics and stories and familiar with tools such as Confluence and Jira Preferred qualifications:• AWS certified Architect and Developer• Big Data certification• Exp with object-oriented/object function scripting languages: Python, Java, C,• Expertise in designing, build, monitor and troubleshooting large-scale distributed systems• Systematic problem-solving approach, coupled with a strong sense of ownership and drive• Experience with monitoring applications such as Zabbix- ID: #23941779
- State: Pennsylvania Philadelphia 19019 Philadelphia USA
- City: Philadelphia
- Salary: Depends on Experience
- Job type: Contract
- Showed: 2021-12-06
- Deadline: 2022-01-30
- Category: Et cetera