Description

Architect and implement scalable batch and real-time data pipelines on AWS.

This role is on-site.

Responsibilities

• Design and build data lakes and warehouses using S3, Glue, Redshift, and Athena.
• Develop and optimize ETL/ELT workflows using Python and PySpark.
• Implement CI/CD pipelines, automation frameworks, and infrastructure-as-code solutions.
• Ensure data quality, security, governance, and monitoring using CloudWatch.
• Lead technical design reviews and mentor engineering teams.

Required Skills

• 15+ years of software engineering experience.
• Deep expertise in AWS services and event-driven architecture.
• Strong proficiency in Python and PySpark for large-scale data processing.
• Experience with S3, Glue, Redshift, and Athena.
• Knowledge of distributed systems and data security best practices.
• Ability to lead architecture design and enforce coding standards.

Preferred Skills

• Bachelor’s degree in computer science, Engineering, or related field.

Key Skills

Education

Any Graduate