Description

You own the architecture, design, and implementation of advanced analytics solutions.

Responsibilities

• Lead the architecture and design of advanced analytics solutions using Azure Databricks/Fabric.
• Oversee the end-to-end implementation of data solutions, aligning with business needs.
• Lead development of data pipelines and ETL processes using Azure Databricks and PySpark.
• Integrate Databricks with Azure services (ADLS, Synapse, ADF) and on-prem systems.
• Provide technical leadership and mentor data engineering teams.

Required Skills

• 8+ years working on data ingestion and transformation using Databricks/Synapse and ADF.
• Strong experience with Azure Databricks (cluster management, notebooks, Delta Lake).
• Proficiency in big data tech including Hadoop, Spark, and PySpark.
• Strong understanding of Azure Data Lake, ADF, and Synapse.
• Experience with ETL/ELT, data warehousing, and data lakes.
• Experience with CI/CD and Git.
• Strong SQL skills and experience with NoSQL databases.
• Knowledge of cloud security best practices.

Preferred Skills

• Experience with Power BI and Microsoft Fabric.
• Familiarity with Auto Loader and Delta Live Tables.

Key Skills

Education

Any Gradute