Description

You will own the design and implementation of scalable data mesh architectures and ETL/ELT pipelines on AWS.

This role is on-site.

Responsibilities

• Develop end-to-end data ingestion and transformation pipelines using AWS Glue, EMR, Lambda, Kinesis, and Step Functions.
• Architect and implement Data Mesh principles with federated governance, domain boundaries, and self-serve infrastructure across Databricks, Starburst, Collibra, and Immuta.
• Build and maintain CI/CD pipelines, infrastructure as code (Terraform/CloudFormation), and automated security scanning for AWS GovCloud compliance.
• Design agentic AI solutions and RAG pipelines using LLMs and orchestration frameworks to accelerate SDLC.
• Provide L3 technical support, mentor engineering teams, and lead architecture design reviews.

Required Skills

• 5+ years of experience designing distributed data architectures on AWS (S3, Glue, Lake Formation, EMR, Redshift).
• Hands-on implementation of Data Mesh principles including domain-oriented data ownership and federated computational governance.
• Proficiency with Databricks (Unity Catalog, Delta Lake), Starburst/Trino, Collibra, or Immuta.
• Strong experience with CI/CD tools (GitLab, GitHub Actions, Jenkins) and containerization (Docker/ECS).
• Infrastructure automation expertise using Terraform and CloudFormation.
• Knowledge of security compliance frameworks for AWS GovCloud environments.

Preferred Skills

• Experience with agentic AI and intelligent automation using Copilot or Claude Code.
• Background in implementing automated data quality frameworks with anomaly detection.

Key Skills

Education

Bachelor's degree