Vacancy expired!
Position : Data Engineer (Python & SQL)Location: Dallas, TX( Onsite from day 1 and this is NOT a remote job).Duration : Long term contract Note: Only resources who are local to Dallas, TX or willing to relocate to Dallas, TX and comfortable working from office from day 1 would be taken into consideration.Summary:Data Engineer will work on implementing data pipelines to make data available in Snowflake Cloud DW from systems of records and operational data stores. The Data Engineer will get to work on best-in class cloud technologies (Nexla, Snowflake, Azure, Airflow, Python etc.)Along with making data available in the DW, the DE will work with Business and Data Analysts to implement data models and calculate key business KPIs for the use of the wider business for reporting and analytics.The DE will have the opportunity to learn and develop their skills by working on assignments as part of an Agile Team guided by more senior developers and Architects. They should be delivery focused and driven to problem solution. Essential Job Functions:Developer Data pipelines from various sources using Nexla, Python and AirflowLarge scale file processing (csv,xml,json,pdf etc) experienceEnterprise Data Lake/ Warehouse DevelopmentSchedule and Monitor Batch and near Realtime data pipelinesUnit testing and troubleshootingUnderstanding technical design and executing technical requirementsTeam player, Work in a fast-paced agile environment Required skills.- 5+ Years’ experience in Data Engineering
- 1 year experience with Nexla or similar data ingestion & engineering tools
- 4+ years’ experience in SQL/SnowSQL
- 2+ Years’ thorough experience in Python coding and packages
- 4+ years of overall Data Integration experience with 2+ experience in Data Engineering.
- 2+ years’ experience in large volume File processing with different types and formats
- Experience in Orchestration Tools - Airflow
- Understanding of dimensional and relational data modeling.
- Understanding of BI/DW development methodologies.
Preferred Skills:Insurance Industry work experienceUnderstanding of Azure cloud services (Blob Storage, ADLS, Azure Functions, Key Vault etc)Experience in a SaaS environments – Snowflake Ecosystem Tools, Technology Partner OfferingsKnowledge of BI tools - Power BI, TableauKnowledge of DevOps tools - Github, Atlassian Tools(JIRA, Confluence), VS CodeGood documentation skills
- ID: #49353702
-
State: Texas
Dallas / fort worth
75202
Dallas / fort worth
USA
- City: Dallas / fort worth
- Salary: Depends on Experience
- Job type: Contract
- Showed: 2023-02-26
- Deadline: 2023-04-25
- Category: Et cetera