Description

You will design, build, and maintain scalable data pipelines, architectures, and solutions on AWS.

Responsibilities

• Design and develop end-to-end enterprise big data solutions.
• Build and maintain ETL/ELT processes using AWS Glue and other services.
• Model data structures and ensure data quality and security across pipelines.
• Develop applications using Scala or Python for data engineering tasks.

Required Skills

• 6+ years of experience in designing and developing big data solutions.
• Strong experience with AWS services: Lambda, Glue, S3, EMR, SNS, SQS, CloudWatch, Redshift.
• Proficiency in Python for data engineering and automation.
• Expertise in SQL and relational databases (Oracle, MySQL, PostgreSQL).
• Strong application development experience in Scala or Python.
• Experience with Apache Spark and distributed systems.
• Familiarity with ETL/ELT process frameworks.
• Experience with shell scripting in Linux/Unix environments.
• Background in Big Data technologies like Hadoop or Spark.

Key Skills

Education

Any Graduate