Description

You will lead the development and deployment of Azure Databricks solutions within cloud environments, owning the end-to-end data pipeline lifecycle.

Responsibilities

• Design, develop, and deploy ETL processes and data ingestion pipelines using Azure Cloud services.
• Collaborate with onshore teams to translate business goals into technical workstreams and deliverables.
• Optimize model code and SQL queries to ensure faster execution and efficient resource utilization.
• Solve complex technical problems through rigorous analytical and debugging skills.

Required Skills

• 8 to 9 years of experience developing big data, relational, NoSQL, and data warehouse solutions.
• Extensive hands-on experience with Azure services: Databricks, ADLS, Azure Data Factory, Azure Functions, Synapse/DW, and Azure SQL DB.
• Proficiency in Python and PySpark for data processing and transformation.
• Strong command of SQL and procedural SQL languages.
• Solid understanding of Data Warehouse (DWH) concepts and Snowflake implementation.
• Experience with DevOps practices and CI/CD deployment pipelines.
• Knowledge of software development best practices.

Preferred Skills

• Working experience in an Agile delivery methodology.

Key Skills

Education

Any Graduate