Vacancy expired!
- AWS Data Architect who can demonstrate following skills:
- Design a data storage structure
- design an AWS Data Lake solution recommend file types for storage recommend file types for analytical queries design for efficient querying design for data pruning | design a folder structure that represents the levels of data transformation design a distribution strategy
- Design a partition strategy: design a partition strategy for files
- design a partition strategy for analytical workloads
- Implement physical data storage structures: compression partitioning sharding data redundancy implement distributions implement data archiving
- Implement the serving layer: deliver data in a relational star schema deliver data in Parquet files maintain metadata implement a dimensional hierarch
- Design and Develop Data Processing Ingest and transform data using Spark, EMR, Redshift Spectrum or Athena
- Implement stream and batch pipelines Design and Implement Data Security
- Data policies and standards: masking, encryption, row level and column level security, RBAC,
- Data retention, auditing, Manage sensitive information