Vacancy expired!
- The Senior Data Architect will manage and provide expertise in data ingestion, wrangling, cleansing, technologies. In this role they will work with relational and unstructured data formats to create analytics-ready datasets for analytic solutions.
- These projects will include designing and developing data ingestion and processing/transformation frameworks leveraging open-source tools such as Python, Spark, pySpark, etc.
- Translating data and technology requirements into our ETL / ELT architecture.
- Develop real-time and batch data ingestion and stream-analytic solutions leveraging technologies such as Kafka, Apache Spark, Java, NoSQL DBs, AWS EMR.
- Strong experience in data ingestion, gathering, wrangling and cleansing tools such as Apache NiFI, Kylo, Scripting, Power BI, Tableau and/or Qlik
- Experience with data modelling, data architecture design and leveraging large-scale data ingest from complex data sources
- Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
- Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Strong knowledge of analysis tools such as Python, R, Spark or SAS, Shell scripting, R/Spark on Hadoop or Cassandra preferred.
- Strong knowledge of data pipelining software e.g., Talend, Informatica.
- ID: #23785788
- State: Connecticut Hartford 06101 Hartford USA
- City: Hartford
- Salary: Depends on Experience
- Job type: Contract
- Showed: 2021-12-03
- Deadline: 2022-01-31
- Category: Et cetera