Description

You will design, build, and optimize scalable data pipelines and data models across SQL and NoSQL databases.

This role is on-site.

Responsibilities

• Design and maintain ETL/ELT workflows on Databricks.
• Develop scalable data pipelines using Python and Spark.
• Optimize data transformation logic for performance and cost efficiency.
• Implement data quality, validation, and monitoring frameworks.

Required Skills

• 10+ years of experience in Data Engineering.
• Expertise in Databricks (Delta Lake, Notebooks, Spark SQL, Jobs, Workflows).
• Strong proficiency in Python for data processing and automation.
• Expert knowledge of SQL, query tuning, and schema design.
• Experience with Apache Spark (RDDs/DataFrames, optimization, partitioning).
• Familiarity with cloud platforms (AWS, Azure, or GCP).
• Experience with ETL/ELT tools like ADF, Glue, or Dataflow.
• Experience managing large-scale datasets.
• Familiarity with CI/CD practices (Git, DevOps, Jenkins).

Preferred Skills

• Any Graduate

Key Skills

Education

Any Graduate