Description

You will build and manage scalable data infrastructure.

This role is on-site.

Responsibilities

• Design and develop scalable data pipelines using PySpark and Scala.
• Build and maintain real-time streaming applications with Kafka.
• Develop APIs using Spring Boot for data validation and integration.
• Modernize systems leveraging AWS services like Fargate, Lambda, and Aurora.
• Automate infrastructure provisioning using Terraform.

Required Skills

• 10+ years of professional experience.
• Strong programming proficiency in Python, Java, and Scala.
• Expertise with Apache Spark, PySpark, and Kafka.
• Experience with cloud platforms, specifically AWS and GCP.
• Familiarity with data warehousing solutions like Snowflake.
• Experience with data orchestration tools such as Databricks.
• Proficiency in SQL and working with PostgreSQL or MongoDB.
• Understanding of CI/CD practices using Jenkins and Git.

Key Skills

Education

Any Gradute