Description

You will design, build, and maintain large-scale data pipelines and analytics platforms.

This role is on-site.

Responsibilities

• Develop and optimize data workflows using Apache Spark and PySpark for batch and streaming processing.
• Build and manage serverless data services using AWS Lambda, Step Functions, and DynamoDB.
• Orchestrate complex data workflows with Apache Airflow and manage infrastructure on AWS EMR and Glue.
• Implement data solutions on Databricks and Snowflake to support enterprise analytics.
• Write clean, efficient code in Python, Java, and Scala to support data engineering initiatives.

Required Skills

• 10+ years of professional software development experience.
• Expert proficiency in Python and PySpark.
• Strong experience with Apache Spark (batch & streaming).
• Hands-on experience with AWS services: Step Functions, DynamoDB, Lambda, EMR, and Glue.
• Proficiency in Apache Airflow for workflow orchestration.
• Experience with Databricks and Snowflake.
• Proficiency in Java and/or Scala.

Preferred Skills

• Experience with real-time data streaming architectures.
• Background in data warehousing and ETL/ELT design patterns.

Key Skills

Education

Any Graduate