Description

You will build and maintain data ingestion pipelines and curated views using Databricks. You will normalize legacy datasets from SharePoint, Excel, and other business systems into structured formats for analytics.

Responsibilities

• Design, build, and maintain data ingestion pipelines using Databricks and Spark.
• Implement and optimize Delta Tables for scalable and performant data storage.
• Normalize and transform legacy data sources (Excel, SharePoint, on-prem files) into structured formats.
• Develop curated and reusable data views to support reporting and downstream applications.
• Optimize pipeline performance, monitoring, and cost efficiency in cloud environments.

Required Skills

• 8+ years of experience in Data Engineering.
• Strong expertise in Databricks, PySpark, and SQL.
• Experience with data ingestion and transformation from unstructured/semi-structured sources (Excel, SharePoint, CSV, APIs).
• Hands-on experience with cloud data platforms.
• Strong experience with DBT.
• Knowledge of data modeling, curation, and normalization techniques.
• Ability to work in agile environments.

Key Skills

Education

Any Graduate