Description

You will build and manage data pipelines for a SaaS cloud-based subscription management platform.

This role is remote.

Responsibilities

• Build and deploy data pipelines using Kafka and Debezium.
• Perform complex data aggregations and transformations using SQL.
• Execute data transformation tasks using Python and PySpark.
• Manage data lifecycle stages within an Agile/SCRUM environment.

Required Skills

• 5+ years of experience in data engineering.
• Proficiency in Python and PySpark for data transformation.
• Hands-on experience with Kafka and Debezium.
• Strong SQL skills for complex data aggregation.
• Experience with Delta Lake and Databricks.
• Solid understanding of all SDLC stages.
• Experience working within Agile or SCRUM methodologies.

Preferred Skills

• Understanding of machine learning algorithms.
• Familiarity with ETL tools and processes such as Matillion or Google Data Studio.
• Experience creating BI reports with Looker or Tableau.

Key Skills

Education

Any Graduate