Description

Key Skills: Pyspark, Databricks, ETL, Python, Data Engineer, DBT, Pipeline

Roles and Responsibilities:

• Develop and optimize PySpark jobs on Databricks to process large-scale datasets.
• Build and maintain ETL/ELT workflows and end-to-end data pipelines for downstream analytics.
• Implement data transformations and modeling using dbt (Data Build Tool) with version-controlled SQL models.
• Ensure data reliability through testing, monitoring, and data quality checks across pipeline stages.
• Collaborate with analytics and engineering teams to integrate data sources and deliver curated datasets.

Skills Required:

• 5-12 years of relevant experience in data engineering
• Databricks and PySpark for scalable batch data processing.
• ETL and ELT development experience for building production data workflows.
• Data pipelines implementation with strong understanding of pipeline design and reliability.
• dbt (Data Build Tool) for SQL-based transformations, modeling, and testing.

Good to Have:

• Experience with additional orchestration, monitoring, and data quality tooling.

Education:

• Bachelor's Degree in Computer Science or related field
• Master's Degree in Computer Science or related field

Key Skills

Education

Any Graduate