Description

Design, build, and maintain scalable data pipelines and distributed systems on AWS.

This role is on-site.

Responsibilities

• Design and support scalable data pipelines using Big Data and AWS technologies.
• Lead data platform migration initiatives from on-premise environments (Netezza) to AWS Cloud.
• Develop and manage ETL/ELT processes using SSIS, Pentaho, or similar tools.
• Implement and manage AWS services including EMR, S3, EC2, Redshift, Glue, and Airflow.
• Optimize SQL queries and monitor system performance to ensure reliability and scalability.

Required Skills

• 6-8+ years of experience in Data Engineering, Big Data, or Platform Engineering.
• Strong expertise in AWS services: EMR, EC2, S3, VPC, RDS, Redshift, Glue, IAM, CloudWatch, CloudFormation.
• Mandatory experience with Netezza and SQL-based systems (SQL Server, PostgreSQL).
• Hands-on experience with data warehouses: Teradata, Redshift, Netezza.
• Proficiency in Airflow for workflow orchestration and AWS Managed Workflows.
• Experience with real-time streaming technologies such as Kafka and Spark Streaming.
• Strong SQL skills and shell scripting proficiency; Python is good to have.
• Strong experience in Unix/Linux environments.

Preferred Skills

• Experience with data lake architecture, governance, and DevOps tools (CI/CD).
• Background in Banking or Financial Services domain.

Key Skills

Education

Any Graduate