Data Engineer

24 Nov 2024

Vacancy expired!

ClifyX group is an award winning IT Consultancy formed in 1998. Our Mission is to provide our clients with Optimal Technology solutions that are effective and within budgets. We specialize in helping Organizations to review their strategic SOW Projects/Talent needs and implement high value and cost effective solutions to increase profitability and efficiency. Our consulting capabilities include expertise in Cloud, Artificial Intelligence, Data Analytics and compliance aspects of Cyber Security development.

Work With Us : What makes working at ClifyX so great? We give tons of flexibilty, listen to you, give opportunity to work in different technologies, give feedback on your profile and present you to global fortune companies.

Job Title: Data Engineer : with Python and SQL Experience.Location: All Across USA

Job Description: Partner with leadership, engineers, program managers and data analyst to understand data needs. • Design, build and launch efficient and reliable data pipelines transforming data into useful report ready datasets. • Broad range of partners equates to a broad range of projects and deliverables including data pipeline frameworks, datasets, measurements, services, tools and process. • Use your data and analytics experience to ‘see what’s missing’ identifying and address data gaps, build monitor to detect data quality issues and partner to establish a self-serve environment. • Leverage data and business principles to automate data flow, detect business exceptions, build diagnostic capabilities, improve both business and data knowledge base. • Build data expertise and own data quality for your areas.Minimum Qualification
  • 5+ years of SQL experience.
  • 4+ years of Python development experience.
  • 3+ years of experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, digdag.io, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M).
  • 3+ years experience with Data Modeling.
  • Experience analyzing data to discover opportunities and address gaps.
  • 5+ years experience in custom ETL design, implementation and maintenance.
  • Experience working with cloud or on-prem Big Data/MPP analytics platform (i.e. Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar). Preferred Qualification • Experience with more than one coding language.
  • Experience in designing and implementing real-time pipelines. • Experience with data quality and validation. • Experience with SQL performance tuning and e2e process optimization.
  • Experience with anomaly/outlier detection. • Experience with notebook-based Data Science workflow. • Experience querying massive datasets using Spark, Presto, Hive, Impala, etc. • Experience working with Supply Chain or Data Center Operation team.
We are an Equal Opportunity/Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, gender identity, sexual orientation, disability status, protected veteran status, or any other characteristic protected by law.

  • ID: #23383079
  • State: California Los angeles 90001 Los angeles USA
  • City: Los angeles
  • Salary: Depends on Experience
  • Job type: Contract
  • Showed: 2021-11-24
  • Deadline: 2022-01-18
  • Category: Et cetera