Description

You will design, build, and maintain scalable data pipelines and solutions on the AWS cloud platform.

This role is on-site.

Responsibilities

• Design and maintain scalable ETL/ELT pipelines using PySpark, SQL, and AWS Glue.
• Optimize data models, implement partitioning strategies, and tune performance for large datasets.
• Manage and deploy data solutions using AWS Glue, EMR, S3, Lambda, Redshift, and Athena.
• Develop and manage infrastructure-as-code using Terraform, CloudFormation, or CDK.
• Provide technical leadership and mentorship to junior engineers.

Required Skills

• 6+ years of experience in data engineering.
• Proficiency in PySpark and Apache Spark for distributed computing.
• Strong expertise in SQL and Python.
• Hands-on experience with Terraform or CloudFormation.
• Ability to write clean, maintainable code in Shell Scripting.
• Knowledge of AWS IAM, KMS, and Lake Formation for security and governance.
• Experience with distributed computing concepts and Hadoop.

Preferred Skills

• Experience with Snowflake, Databricks, or Apache Airflow.
• Implementation of real-time streaming using Kinesis, Kafka, or Flink.

Key Skills

Education

Any Graduate