Description

Lead the design and architecture of enterprise data processing and application platforms on AWS.

This role is on-site.

Responsibilities

• Design and document secure, scalable technical solutions on AWS using PySpark, Flink, EMR, and DynamoDB.
• Oversee the design and development of performant Python APIs to expose system functionalities.
• Lead the architecture of complex batch and real-time data pipelines using big data processing frameworks.
• Implement workflow orchestration using Apache Airflow (MWAA) for complex data workflows.
• Drive infrastructure deployment automation using IaC tools and implement CI/CD pipelines.

Required Skills

• 10+ years of experience with AWS services.
• Expertise in PySpark for data processing.
• Strong hands-on experience with Python for API development.
• Experience designing solutions using NoSQL databases like DynamoDB and DocumentDB.
• Proficiency in workflow orchestration tools, specifically Apache Airflow.
• Familiarity with CI/CD Pipelines and DevOps practices.
• Experience with core AWS services (EC2, EMR, etc.).

Key Skills

Education

Any Graduate