Description

You will build and manage data pipelines within a SaaS cloud-based subscription management platform.

Responsibilities

• Build and deploy data pipelines using Kafka and Debezium.
• Perform complex data aggregations and transformations using SQL.
• Execute data transformation tasks using Python and PySpark.
• Manage data lifecycle stages within an Agile/SCRUM environment.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Python and PySpark for data transformation.
• Hands-on experience with Kafka and Debezium.
• Strong SQL skills for complex data aggregation.
• Experience with Delta Lake and Databricks.
• Solid understanding of all SDLC stages.
• Experience working within Agile or SCRUM methodologies.
• BE/BTech degree from a top institute.

Preferred Skills

• Understanding of machine learning algorithms.
• Familiarity with ETL tools and processes such as Matillion or Google Data Studio.
• Experience creating BI reports with Looker or Tableau.
• Ability to write APIs to extract data from databases.

Key Skills

Education

Any Graduate