Description

You will lead the design, development, and optimization of data platforms and pipelines within AWS environments.

Responsibilities

• Build, maintain, and optimize Spark-based data pipelines to consolidate data assets.
• Design resilient, secure, and high-performing platforms using AWS services including EC2, S3, RDS, and DynamoDB.
• Migrate complex data platforms into cloud environments while mitigating migration risks.
• Develop standardized libraries for data processing and implement automation for routine tasks.
• Partner with architects and analysts to define technical architectures for enterprise projects.
• Provide operational support, debugging, and performance optimization for cloud-based systems.

Required Skills

• 10+ years of applied experience in software engineering and system design.
• Proficiency in Python, Java, Go, or Scala.
• Strong expertise in SQL and building data pipelines with Spark.
• Hands-on experience with AWS infrastructure, including EC2, S3, RDS, DynamoDB, EKS, and ECS.
• Experience working with relational (RDBMS) and NoSQL datastores.
• Proven ability in public cloud migrations and technical troubleshooting.
• Experience with container orchestration services like Docker and Kubernetes.
• Strong analytical, problem-solving, and communication skills.

Preferred Skills

• Experience with infrastructure as code using Terraform.
• Production experience with ACID compliant formats such as Hudi, Iceberg, or Delta Lake.
• Familiarity with data observability solutions and governance frameworks.

Key Skills

Education

Any Graduate