Description

You will design, build, and maintain scalable ETL pipelines and data infrastructure on AWS.

This role is on-site.

Responsibilities

• Design and implement ETL pipelines using AWS Glue, Python, and SQL for data ingestion and transformation.
• Develop and maintain data lakes and warehouses on Amazon S3 and Redshift, optimizing performance and cost via Redshift Spectrum.
• Build reusable, scalable data frameworks adhering to security and governance standards.
• Troubleshoot performance bottlenecks to ensure high availability and reliability of data pipelines.

Required Skills

• 8+ years of hands-on experience with AWS services: Glue, S3, EC2, VPC, IAM, CloudWatch.
• Proficiency in ETL development using AWS Glue, Python, and SQL.
• Experience with data warehousing solutions, specifically Amazon Redshift and Redshift Spectrum.
• Knowledge of big data and workflow orchestration tools such as EMR and Apache Airflow.
• Experience with infrastructure-as-code tools including Terraform, Ansible, Chef, or Puppet.
• Proficiency with CI/CD tools and build systems: Octopus, ANT, Maven, Git, GitHub, TFS, or Tortoise SVN.
• Working knowledge of Java and Agile development methodologies.
• Experience with Azure cloud services and hybrid cloud environments.

Preferred Skills

• Experience with containerization and orchestration tools such as Docker and Kubernetes.

Key Skills

Education

Any Graduate