Description

You will design, build, and operate reliable data platforms and pipelines.

Responsibilities

• Design, build, and maintain ETL/ELT pipelines and data workflows using tools like Azure Data Factory, Databricks, Spark, and Airflow.
• Develop and optimize data models for data warehouses, lakes, or lakehouses, focusing on partitioning, indexing, and performance tuning.
• Build scalable batch and streaming processing jobs, incorporating Delta Lake or similar patterns.
• Ensure data quality, reliability, and observability by implementing tests, monitoring, and SLAs.
• Implement CI/CD and version control for all data assets and pipelines.

Required Skills

• 5+ years of experience in ETL or ELT implementation (ADF, Databricks, DBT, Airflow).
• Proven experience with big data processing frameworks.
• Cloud experience required, Azure preferred (Synapse, Data Factory, Azure Storage).
• Strong SQL expertise with hands-on experience tuning data warehouses (Synapse, Snowflake, BigQuery, Redshift).
• Solid understanding of data modeling fundamentals (star/snowflake schemas, CDC).
• Experience with CI/CD practices and Git version control.
• Familiarity with data security principles (IAM, encryption, least privilege).

Key Skills

Education

Any Graduate