Vacancy expired!
Develop the end-to-end automation of data pipelines, making datasets readily-consumable by visualization tools and notification systems.
Create automated alarming and dash boarding to monitor data integrity. Act as the subject matter expert for the data structure and usage Basic Qualifications: 5+ years of overall work experience in including Data Engineering, Database Engineering, Business Intelligence Experience with Oracle, Redshift, Teradata, PostgreSQL, Hadoop, Hive, Hbase, Pig, Spark Experience with AWS services including Redshift, RDS, S3, and Kinesis Coding proficiency in at least one modern programming language (Python, Ruby, JavaScript, Java, etc.) Experienced in handling large data sets using SQL/Python in a business environment.Data Engineer with the following Skills - Python/Scala/Java
- SQL
- Spark / PySpark
- AWS S3
- RDS ( MYSQL/PostGres/MS SQL/Oracle)
- Excel
BASIC QUALIFICATIONS 3+ years of experience as a Data Engineer or in a similar role Experience with data modeling, data warehousing, and building ETL pipelines Experience in SQL Bachelor's degree in computer science, engineering, mathematics, or a related technical discipline 4+ years of industry experience in software development, data engineering, business intelligence, data science, or related field with a track record of manipulating, processing, and extracting value from large datasets Experience using big data technologies (Hadoop, Hive, Hbase, Spark, EMR, etc.) Knowledge of data management fundamentals and data storage principles Knowledge of distributed systems as it pertains to data storage and computing PREFERRED QUALIFICATIONS Experience as a Data Engineer, BI Engineer, Business/Financial Analyst or Systems Analyst in a company with large, complex data sources. Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets Experience working with AWS big data technologies (EMR, Redshift, S3) Demonstrated strength in data modeling, ETL development, and data warehousing Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and data engineering strategy style=""
- ID: #40665328
-
State: Pennsylvania
Exton
19341
Exton
USA
- City: Exton
- Salary:
USD
TBD
TBD
- Job type: Permanent
- Showed: 2022-05-11
- Deadline: 2022-07-09
- Category: Et cetera