Business Intelligence Engineer

MATRIX Resources, Inc.
Raleigh / durham / CH, NC
28 Jun 2024

Vacancy expired!

Our client, a leading software company headquartered in Raleigh, NC is in search of an experienced Business Intelligence Engineer to join their growing team. If you have experience with big data processing in a cloud based environment and data lake like what exists in AWS, this is the job for you. Details: Duration- 6 months Location- 100% remote, eastern US time zone hours Key Skills- Big Data Processing, Cloud Based Environment, AWS, Python, SQL, Informatica (must have). Description: Our clients' team is seeking a Senior Data Engineer. In this role, you will design, develop and test solutions for relevant business needs in an open and collaborative environment. You'll collaborate with our clients' internal business stakeholders to enable data-driven decisions for managing the end-to-end product life cycle. The ideal candidate would be well-versed in data analysis, design, and development concepts for a large data warehouse and should have experience supporting critical production applications. Requirements: Bachelor's or Master's degree in Computer Science, Information Systems, Engineering or equivalent. 5+ years of relevant experience with detailed knowledge of data warehouse technical architectures, infrastructure components, ETL/ ELT, and reporting/analytic tools. 3+ years of experience with Cloud-based DW such as Redshift, Snowflake etc. 2+ years experience in Big Data Distributed ecosystems such as AWS, Delta Lake, Hadoop, SPARK, Hive etc. 3+ years experience in Workflow orchestration tools such as Airflow etc. 2+ years experience in Big Data Distributed systems such as Databricks, AWS EMR, AWS Glue, etc. Leverage monitoring like Splunk, Grafana, CloudWatch, etc. Experience with container management frameworks such as Docker, Kubernetes, ECR, etc. Strong experience in coding languages like Python 3+ years working with multiple Big Data file formats (Parquet, Avro, Delta Lake) Experience working in an Agile environment Knowledge and Skills Fluent in relational-based systems and writing complex SQL. Fluent in complex, distributed, and massively parallel systems. Strong analytical and problem-solving skills with the ability to represent complex algorithms in software. Strong understanding of database technologies and management systems. Strong understanding of data structures and algorithms Database architecture testing methodology, including the execution of test plans, debugging, and testing scripts and tools. Strong analytical and problem-solving skills. Experience: Spark, Python, and SQL: 5 years ELT, ETL, AWS, Scala: 5 years AWS Glue, Docker, and Kubernetes: 2 years Data Engineer: 5 years Over All IT: 8 years Nice to Have: Experience working on CI/CD processes such as Jenkins, Tekton/ArgoCD, etc., and source control tools such as GitHub, etc. Experience with Red Hat Openshift is a big plus. Have experience in building real-time or near real-time streaming data pipelines Experience in pub/sub streaming technologies like Kafka, Kinesis, Spark Streaming, etc.

Equal Employment Opportunity

MATRIX is committed to providing a work environment that values diversity, equity, inclusion and respect. We do not discriminate based upon race, religious creed, color, national origin, ancestry, physical or mental disability, medical condition, genetic information, marital status (including registered domestic partnership status), sex (including pregnancy, childbirth, lactation and related medical conditions), gender (including gender identity and expression), age (40 and over), sexual orientation, military and veteran status and/or any other characteristic protected by federal, state or local law.

MATRIX is committed to providing access and reasonable accommodations for qualified individuals with disabilities. Supporting medical or religious documentation will be required where applicable. If you are a qualified individual with a disability, you may request a reasonable accommodation under the American Disability Act (ADA) by emailing MATRIXHR@MatrixRes.com. To ensure a quick response to your request, please use the words "Accommodation request" as the subject line of your email.

For hourly W2 contract roles MATRIX offers a highly competitive benefit package including Medical, Dental, Vision, Life, Disability, HSA, and 401(k) with pre and post-tax options. Please see MatrixRes.com/Benefits for more information. For direct hire placement with our clients, benefits will be offered in accordance with that particular client's offerings. This may include PTO, Medical, Dental, Vision, 401K and other pre and post-tax options.