Data Engineer 3

For a financial client we need Data Engineer 3. This position is based in Westlake, TX or Boston, MA or Merrimack, NH or Raleigh, NC . We are Primarily looking for W2 Candidates and not looking for Third Party Candidates. The Expertise and Skills You Bring Expertise in SQL, identifying patterns and trends in data, recommend and define data requirements, mastery in implementing data quality checks to ensure accuracy and completeness. You enjoy learning new technologies, data analysis, identifying data patterns and trends and you can independently resolve technical challenges. Experience in processing and exposing data using AWS technologies like ec2, s3, Lambda, API Gateway, Load Balancers, Auto scaling etc. Expertise in building data ingestion tools using technologies like Python to extract data from Relational Databases/Web Scraping/External API's Experience in Snowflake or any MPP and columnar database on the Cloud. Experience in CI/CD release automation and deployment (Jenkins, Concourse, CloudFormation etc.) Experience and good understating of databases (Oracle, Netezza) and ETL tools Experience in scheduling tools like Autosys, Control-M, Airflow etc. Excellent programming skills in SQL, PL/SQL, Python, shell etc. Exposure to Big Data technologies (Hadoop, Spark, Hive, presto etc.) Exposure to streaming services like Kafka will be an advantage Good understanding of overall AWS security services like KMS, IAM, Security groups etc. At least 6 years of software development experience with at least 3 years working on Cloud/Big Data technologies BS in Computer Science or related degree, or equivalent experience