Description

You will design and maintain large-scale data processing architectures on AWS, handling real-time streaming and batch analytics.

This role is on-site.

Responsibilities

• Build and optimize event-driven data platforms using Kinesis, Flink, and Elasticsearch.
• Develop serverless data pipelines with Lambda, Fargate, Step Functions, and Glue.
• Manage data storage and analytics using PostgreSQL, S3, Apache Iceberg, and Redshift Spectrum.
• Automate infrastructure and deployments using Terraform, CloudFormation, and CI/CD pipelines.
• Monitor system health and performance using Datadog and implement efficient SQL and Python transformations.

Required Skills

• 10+ years of engineering experience.
• Deep expertise in AWS data, streaming, and compute services.
• Strong proficiency in SQL, Python, and Spark for large-scale data processing.
• Hands-on experience with Infrastructure-as-Code (Terraform / CloudFormation) and CI/CD.
• Experience with real-time and batch data processing architectures.
• Proficiency in PostgreSQL, Kinesis, Lambda, and CloudFormation.

Preferred Skills

• Experience with Apache Iceberg and Redshift Spectrum.
• Familiarity with Datadog for monitoring and observability.

Key Skills

Education

Any Gradute