Description

You will design and manage large-scale data transformations and analytics pipelines.

Responsibilities

• Manage and transform large datasets using PySpark and Spark-Scala.
• Build and optimize data workflows using AWS services.
• Develop and maintain Python code for model evolution in collaboration with customers.
• Solve complex analytical problems within big data environments.
• Deliver client-ready technical outputs independently with minimal supervision.

Required Skills

• 10+ years of experience in analytics and data engineering.
• Expertise in Python and Spark (PySpark and Spark-Scala).
• Proficiency with Scala and SQL.
• Hands-on experience with Hadoop and Hive.
• Experience managing AWS services including Glue, Lambda, EMR, Redshift, and RDS.
• Strong database management knowledge.
• Background in Java development.

Key Skills

Education

ANY GRADUATE