Description

5+ years of experience in data engineering.

• Strong hands-on experience with Databricks on Azure.
• Strong experience with PySpark and large-scale data processing.
• Proven experience designing and implementing ETL/ELT pipelines in Azure.
• Solid experience with Azure services such as ADLS, Key Vault, etc.
• Strong SQL and data warehousing concepts; experience with orchestration tools (e.g., Databricks Jobs) preferred.
• Strong experience in performance tuning and optimization of PySpark/Databricks jobs.
• Hands-on experience with monitoring and logging for data pipelines (e.g.Databricks workflows logs).
• Exposure to data quality frameworks and practices (validation, reconciliation, error handling).
• Experience conceptualizing and delivering PoCs and converting them into scalable production-ready solutions.
• Willing to work in 2nd shift and Hybrid mode and work from client office

Key Skills

Education

Bachelor's degree