Description

You will design, build, and optimize scalable ETL/ELT pipelines for large datasets.

This role is on-site.

Responsibilities

• Design and optimize scalable ETL/ELT pipelines using Databricks, Delta Lake, Python, and SQL.
• Implement Lakehouse-based bronze/silver/gold architectures to improve data ecosystem efficiency.
• Enforce data quality frameworks like Great Expectations and optimize storage patterns for high-throughput datasets.
• Collaborate with cross-functional teams to translate business requirements into technical designs for AI/ML enablement.
• Strengthen CI/CD and data governance practices through automation and version control.

Required Skills

• 5+ years of experience in data engineering.
• Expert proficiency in PySpark and Databricks Lakehouse architectures.
• Strong background across Azure, Snowflake, Delta Lake, and Databricks.
• Proficiency in Python and SQL for data pipeline construction.
• Experience implementing CI/CD automation for data workflows.
• Familiarity with ACID transactions and schema evolution in Lakehouse environments.
• Experience handling high-throughput, complex datasets.

Preferred Skills

• Experience with Great Expectations for data quality enforcement.
• Background in translating business requirements into AI/ML technical designs.

Key Skills

Education

Any Gradute