Description

You will lead data initiatives by designing, building, and maintaining data-driven solutions on AWS.

Responsibilities

• Orchestrate data ingestion, transformation, and integrity tasks using Amazon MWAA (Apache Airflow).
• Implement ELT approaches using metadata-driven integration design to enable rapid system onboarding.
• Build data pipelines and CI/CD workflows using a DataOps approach with Informatica, pySpark, and Terraform.
• Deploy event-driven architectures with AWS EventBridge to monitor environments and respond to operational changes.

Required Skills

• 8-10 years of professional experience in data engineering.
• Expertise in Amazon MWAA for Apache Airflow orchestration.
• Proficiency in pySpark, Python shell, and SQL for pipeline development.
• Hands-on experience with Informatica and GitHub Actions for CI/CD.
• Experience with Terraform for Infrastructure as Code (IaC).
• Practical knowledge of AWS services including S3, Amazon Redshift, and EventBridge.
• Experience implementing Data Lake house architectures and Snowflake integration.

Preferred Skills

• Understanding of Role-Based Access Control (RBAC) and observability via AWS CloudWatch.

Key Skills

Education

Any Graduate