Description

You will own the design, building, and optimization of scalable ETL/ELT pipelines.

Responsibilities

• Design, build, and optimize scalable ETL/ELT pipelines using Databricks, Delta Lake, Python, and SQL.
• Improve data ecosystem efficiency by implementing Lakehouse based bronze/silver/gold architectures.
• Enforce data quality frameworks, such as Great Expectations, and optimize storage and retrieval patterns for large datasets.
• Collaborate with cross-functional teams to translate business requirements into technical designs for AI/ML enablement.
• Strengthen CI/CD and data governance practices through automation and version control for data pipelines.

Required Skills

• 5+ years of experience in data engineering.
• Expert proficiency in PySpark and Databricks Lakehouse architectures.
• Strong background across Azure, Snowflake, Delta Lake, and Databricks.
• Proficiency in Python and SQL for data pipeline construction.
• Experience implementing CI/CD automation for data workflows.
• Familiarity with ACID transactions and schema evolution in Lakehouse environments.
• Experience handling high-throughput, complex datasets.

Key Skills

Education

Any Gradute