Description

You will operate and optimize the core data warehousing and analytics infrastructure.

Responsibilities

• Optimize Amazon Redshift performance, focusing on distribution keys, sort keys, WLM, and query tuning.
• Design, build, and operate scalable ETL/ELT pipelines utilizing AWS Glue (Spark).
• Orchestrate data workflows using Apache Airflow and Step Functions, integrating event-driven services.
• Enforce data security and governance using Lake Formation, IAM, and implementing row- and column-level security.
• Monitor and troubleshoot data workflows, implementing observability via CloudWatch and CloudTrail.

Required Skills

• 5+ years of experience in data engineering or related field.
• Deep expertise in Amazon Redshift performance tuning and Athena optimization.
• Strong proficiency in Advanced SQL (joins, window functions, aggregation).
• Hands-on experience with AWS services: S3, KMS, Lambda, Glue (Spark), SQS, EventBridge, Step Functions.
• Expertise in infrastructure as code using Terraform.
• Proficiency with IAM roles, policies, assume-role, and cross-account access patterns.
• Experience building serverless and event-driven data pipelines.
• Familiarity with distributed data systems and Spark architecture.
• Knowledge of AWS networking fundamentals (VPC, security groups).

Key Skills

Education

Bachelor's degree