Description

You will build and maintain platform solutions, data pipelines, and report generation systems.

This role is on-site.

Responsibilities

• Design and develop data pipelines for ingestion and transformation using Spark.
• Implement data lake ETL processes using AWS Glue or Databricks.
• Troubleshoot performance bottlenecks and data skew issues in large-scale deployments.
• Participate in architectural refinement, software design, and product realization.

Required Skills

• 5+ years of experience with Python, PySpark, and Apache Spark.
• 5+ years of experience with AWS services including Glue, DynamoDB, Lambda, and Redshift.
• Extensive experience with API development and Data Integration (Streaming, Batch, Error, and Replay).
• Proficiency in SQL and working with relational and non-relational databases.
• Hands-on experience with Elasticsearch and large-scale distributed database systems.
• Experience with GitHub, Jenkins, and Terraform.
• Knowledge of data modeling and query optimization.
• Experience with Teradata (Vantage) or other RDBMS/ETL tools.

Preferred Skills

• Experience with large scale enterprise deployments.

Key Skills

Education

Any Graduate