Description

Build and maintain large-scale data pipelines and distributed database systems on AWS.

This role is hybrid.

Responsibilities

• Design, optimize, and maintain relational and distributed database systems using AWS RDS, MySQL, PostgreSQL, and Elasticsearch.
• Develop and manage ETL processes and data models using AWS Glue, Apache Spark, and Kafka.
• Write complex SQL queries for analytics, reporting, and data validation while implementing indexing and partitioning strategies.
• Implement batch and stream processing solutions using Spark Streaming and Lambda.
• Ensure data quality, schema design, and performance tuning across the data stack.

Required Skills

• 6+ years of experience with AWS services, specifically RDS, Lambda, Glue, and Hive.
• 6+ years of hands-on experience with Apache Spark programming, including batch and stream processing.
• 6+ years of professional experience with SQL and NoSQL databases (MySQL, PostgreSQL, Elasticsearch).
• Strong proficiency in Java and Scala programming languages.
• Familiarity with Python and Unix/Linux shell scripting.
• Experience with Kafka for data streaming and messaging.
• Advanced SQL expertise with a focus on query optimization and performance tuning.

Key Skills

Education

Any Graduate