Description

You will own the development and maintenance of ETL/ELT pipelines and streaming data workflows.

This role is on-site.

Responsibilities

• Build and maintain ETL/ELT pipelines using Databricks, Spark, SQL, and Python.
• Develop streaming and event-driven data flows with Kafka.
• Optimize pipeline performance, cost, and data quality through tuning and validation.
• Monitor pipeline health using observability tools and operational runbooks.
• Collaborate with senior engineers and analytics teams on production operations and troubleshooting.

Required Skills

• 5+ years of experience in data engineering or related software engineering roles.
• Strong proficiency in Python and SQL for data ingestion, transformation, and troubleshooting.
• Hands-on experience with Databricks and Snowflake for big data processing and storage.
• Experience developing ETL pipelines for production data workflows.
• Knowledge of Kafka-based streaming and event ingestion.

Preferred Skills

• Experience with CI/CD tools (GitLab, Jenkins, GitHub Actions) for data and software delivery.
• Familiarity with cloud platforms (AWS, Azure, or GCP) and microservices patterns.
• Strong algorithms and problem-solving fundamentals.

Key Skills

Education

Any Graduate