Key ResponsibilitiesPipeline Architecture & Development: Design, build, and maintain scalable, reliable batch and streaming data pipelines using modern distributed frameworks (e.g., Spark, Flink, Kafka, Airflow).Data Modeling & Storage: Architect robust data models and storage strategies optimized for analytical query performance in cloud data warehouses and data lakes (e.g., Snowflake, BigQuery, AWS S3/Redshift).System Quality & Reliability: Monitor data pipeline health, establish automated testing and data validation frameworks, and optimize pipeline throughput, latency, and query performance.Security & Compliance: Ensure all data management practices strictly comply with security protocols, privacy standards, and regulatory frameworks required for financial infrastructure.Cross-Functional Collaboration: Partner with Analytics, Data Science, Product, and Infrastructure teams to translate raw protocol and product telemetry into canonical, reliable data platforms.
- ID: #55398305
- State: Massachusetts Springfield 01101 Springfield USA
- City: Springfield
- Salary: USD TBD TBD
- Job type: Full-time
- Showed: 2026-11-11
- Deadline: 2027-01-10
- Category: Et cetera