Description

You will build and manage big data solutions and ETL pipelines within an AWS environment.

This role is hybrid.

Responsibilities

• Design and implement ETL pipelines using AWS Glue and AWS Data Pipeline.
• Manage data lake architectures and schema-on-read approaches.
• Develop and maintain big data processing workflows using Spark and Flink.
• Build scalable data solutions utilizing Amazon S3, Redshift, and EMR.
• Deploy infrastructure using CloudFormation or Terraform.

Required Skills

• 5+ years of experience building big data solutions on AWS.
• Hands-on experience with Amazon S3, AWS Glue, Amazon Redshift, Amazon EMR, AWS Lambda, Amazon Kinesis, and AWS Data Pipeline.
• Proficiency in Apache Hadoop, Spark, Flink, and Kafka.
• Strong proficiency in SQL and NoSQL databases.
• Experience with Python, Scala, or Shell scripting.
• Knowledge of data warehousing concepts.
• Experience with containerization using Docker and Kubernetes.
• Practical use of Infrastructure as Code (IaC) tools like CloudFormation or Terraform.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate